Technical presentation - 30 minutes (including q&a)
KleidiAI is an optimization library designed to accelerate Machine Learning(ML) workloads for best-in-class performance on Arm CPUs. Since its inception in May 2024, it has experienced an eventful few months with integrations into multiple ML frameworks. This talk explores the integration aspects of KleidiAI into ML frameworks and how to get the best out of such integrations. We’ll discuss the ‘take-what-you-want’ tenet of the library, compare a couple of different styles of integrations and discuss how to achieve broad coverage of workloads for acceleration.