Developer

In this session, we will demonstrate how KleidiAI enables optimal performance for some of the world’s most advanced language models on Arm CPUs, and dive deeper into Arm Scalable Matrix Extension (SME)  and how developers can leverage SME capabilities to accelerate AI applications.

MNN engine is a lightweight AI framework developed by Alibaba Taobao Group. Its MNN-LM component combines quantization, low-bit, and sparsification technologies to support efficient inference of large language models (LLM) and multimodal models (MLLM) across various platforms. Arm CME technology significantly improves the efficiency of on-device LLM deployment of MNN by matrix computing acceleration and low-bitrate quantization support.

Migrate-ease is an innovative project designed to analyze codebases specifically for x86_64 architectures and offers tailored suggestions aimed at facilitating the migration process to aarch64. This tool streamlines the transition, ensuring a smooth and efficient evolution of your software to leverage the benefits of aarch64 architecture. In this talk, we will demonstrate how developers can use migrate-ease to simplify their migration to Arm based servers.

Arm and Stability AI have collaborated to bring cutting-edge AI audio generation directly onto Arm CPUs. In this session, we’ll show how the Stable Audio Open Small model has been fully optimized to run on smartphones with the LiteRT runtime, powered by XNNPack and KleidiAI. We’ll also share our latest advancements leveraging SME2 to achieve even greater performance, making high-quality audio generation accessible to all developers.

Tencent and Microsoft will share their experience in building a native Windows on Arm app, and what they have learned along the journey.

We are relentless in our support of innovation in real-time graphics. We will build upon the story begun with Arm Accuracy Super Resolution as a modern day best in class solution for upscaling to then share our vision for neural graphics on Arm GPUs. Attendees will take away an understanding of how Arm will deliver practical, performant neural graphics technologies for mobile graphics and spur a new wave of innovation.