Webinar
Unlocking the Power and Speed of GenAI Inference on CPUs
March 19, 2025 | 08:00 AM PDT (UTC-7)
Join us for a Complimentary Live Webinar Sponsored by Linux Foundation Education and Arm Education
You won’t believe how fast this is! Join us for an insightful webinar on leveraging CPUs for machine learning inference using the recently released, open source KleidiAI library. Discover how KleidiAI's optimized micro-kernels are already being adopted by popular ML frameworks like PyTorch, enabling developers to achieve amazing inference performance without GPU acceleration. We'll discuss the key optimizations available in KleidiAI, review real-world use cases, and demonstrate how to get started with ease in a fireside chat format, ensuring you stay ahead in the ML space and harness the full potential of CPUs already in consumer hands. This Linux Foundation Education webinar is supported under the Semiconductor Education Alliance and sponsored by Arm.
This webinar will cover:
- Unbelievable GenAI Performance on CPUs: Learn how the recently released, open source KleidiAI library enhances machine learning inference on CPUs, achieving impressive performance without the need for GPUs.
- Ease of Deployment: Discover how to easily integrate and deploy ML models on CPUs using KleidiAI, ensuring efficient and high-performance AI applications.
- On-Device ML Inference: Understand the importance of leveraging CPUs for on-device ML inference on devices already in the field and future devices, helping you stay ahead in the rapidly evolving machine learning landscape.
- Next steps and Educational Material for Getting Started: Find out how to get started with educational material designed for IT students and developers alike.
Sponsored by:
Speakers
Ashok Bhat, Senior Product Manager, Arm
Ashok Bhat is a Senior Product Manager at Arm, focusing on optimizing machine learning frameworks like PyTorch, TensorFlow, JAX, LLama.cpp, and vLLM for Arm servers. He collaborates with Arm's partners to advance ML technology and improve performance across the ecosystem.
Gian Marco Iodice, Principal Software Engineer, Arm
Gian Marco Iodice is an edge and mobile computing specialist at Arm, focused on machine learning (ML). He authored the TinyML Cookbook and co-created KleidiAI (2024) and the Arm Compute Library (2017) software libraries to optimize ML performance on Arm processors. He received the MSc with honors in electronic engineering from the University of Pisa (Italy), where he specialized in HW/SW co-design for embedded systems. Within Arm, he leads the engineering developments for Generative AI.
Tim Serewicz, Vice President of Education, Linux Foundation Education
Tim Serewicz is the Vice President of Education for the Linux Foundation with over twenty years of experience working with Linux, emerging technology, and open source projects. In this role, he is accountable for the department's strategy, development, and cross-functional delivery of content. Tim also leads the Security Knowledge Framework team, building a platform of cybersecurity scenarios for developers to learn and test their skills, as well as keep current with common vulnerabilities. He also created, maintains, and teaches Quantum Computing, CKA, CKAD, and CKS Kubernetes courses and acts as an in-house subject matter expert for cloud topics for the certification team.