All AI updates

Explore the complete news stream by source, topic and date.

2026-10-25

llama.cpp releases04:23

llama.cpp releases version b11868: enhanced Hexagon NPU multi-core Flash Attention support, with cross-platform compilation and build capabilities.

llama.cpp v2.45.0 (tag b11868) has been officially released, with the core update being the introduction of a KV-head splitting mechanism in the Hexagon backend to optimize multi-core HMX Flash Attention performance and unify the FA splitting control flag. Binary packages are simultaneously available for all major platforms, including macOS, Linux, Windows, Android, iOS, and openEuler, supporting multiple backends such as CUDA 12/13, Vulkan, ROCm, OpenVINO, SYCL, and Snapdragon (Adreno + Hexagon).

Timeline and related coverage

llama.cpp releases04:11

llama.cpp releases version b11867: server-side entry point refactored, with full support for multiple platforms and heterogeneous acceleration backends.

llama.cpp has officially released version b11867 on GitHub. Key changes include a refactored server entry point (PR #31113) and the addition of the server_role mechanism. Additionally, more than 40 precompiled binaries are now available, covering macOS, Linux, Windows, Android, iOS, and openEuler, with support for diverse hardware backends such as CPU, CUDA (12.4/12.8/13.4), Vulkan, ROCm 10.0, OpenVINO, SYCL (FP16/FP32), and Snapdragon (Adreno + Hexagon).

Timeline and related coverage

llama.cpp releases03:51

llama.cpp releases version b11866: removes redundant AMAX scaling logic from the Metal backend and streamlines the MoE computation path.

llama.cpp v.b11866 has removed the outdated src1 power-of-two AMAX scaling mechanism from the Metal backend, instead relying on a more granular per-expert-token amax scaling within the computation graph, ensuring that MoE projection activation values remain within the f16 representation range; concurrently, it also deleted the associated two-stage reduction kernels, F32-precision scheduling, and out-of-bounds test cases.

Timeline and related coverage

llama.cpp releases03:30

llama.cpp releases version b11865: adds RDMA receive boundary checking and supports multiple platform backends, including CUDA 13.4, ROCm 10.0, and Snapdragon NPU.

The llama.cpp project has released build version b11865, with core changes including the addition of memory-boundary checks in the RDMA receive logic (PR #30399) and a significant expansion of hardware-acceleration support, covering CUDA 13.4, ROCm 10.0, Vulkan, OpenVINO, SYCL, and Qualcomm Snapdragon—providing full-stack heterogeneous computing backends for CPU, Adreno, and Hexagon. macOS KleidiAI support and openEuler builds have been explicitly marked as DISABLED.

Timeline and related coverage

llama.cpp releases03:13

llama.cpp releases version b11861: fixes an inference exception caused by the minimax-m3 model’s quantized scaling tensor not being propagated.

llama.cpp v.b11861 fixes the weight distortion issue in the minimax-m3 model that occurred under NVFP4/MXFP8 quantization due to the scale tensor not being injected into the computation graph, thereby preventing “token soup” and residual vanishing; it also provides multi-platform binary builds covering macOS, Linux, Windows, Android, iOS, and openEuler.

Timeline and related coverage