Skip to content
AI NEWS JOURNAL
AI, IN PERSPECTIVE

Search AI news

Search headlines, summaries and articles to connect the dots.

Newest first

llama.cpp releases version b11871: adds a limit on JSON nesting depth to prevent service crashes

llama.cpp introduced a critical security fix in version b11871, imposing a hard limit of 128 nested JSON levels on requests to prevent HTTP thread stack overflows and service crashes caused by deep recursive parsing (triggering SIGBUS on macOS and SIGSEGV on Linux). This policy covers multiple input scenarios for the chat interface and uniformly returns an HTTP 400 error.

Timeline and related coverage

llama.cpp has released version b11870, officially supporting the DeepSeek-V4.1-Flash model.

llama.cpp has added support for the DeepSeek-V4.1-Flash (deepseek41) model in version b11870, and implemented several low-level optimizations tailored to its Engram architecture, including simplification of KV cache computation, replacement of MXFP8 with BF16 precision, and in-graph row gather operations; it also provides multi-platform binary builds covering macOS, Linux, Windows, Android, iOS, and openEuler.

Timeline and related coverage

llama.cpp releases version b11867: server-side entry point refactored, with full support for multiple platforms and heterogeneous acceleration backends.

llama.cpp has officially released version b11867 on GitHub. Key changes include a refactored server entry point (PR #31113) and the addition of the server_role mechanism. Additionally, more than 40 precompiled binaries are now available, covering macOS, Linux, Windows, Android, iOS, and openEuler, with support for diverse hardware backends such as CPU, CUDA (12.4/12.8/13.4), Vulkan, ROCm 10.0, OpenVINO, SYCL (FP16/FP32), and Snapdragon (Adreno + Hexagon).

Timeline and related coverage

llama.cpp releases version b11865: adds RDMA receive boundary checking and supports multiple platform backends, including CUDA 13.4, ROCm 10.0, and Snapdragon NPU.

The llama.cpp project has released build version b11865, with core changes including the addition of memory-boundary checks in the RDMA receive logic (PR #30399) and a significant expansion of hardware-acceleration support, covering CUDA 13.4, ROCm 10.0, Vulkan, OpenVINO, SYCL, and Qualcomm Snapdragon—providing full-stack heterogeneous computing backends for CPU, Adreno, and Hexagon. macOS KleidiAI support and openEuler builds have been explicitly marked as DISABLED.

Timeline and related coverage

llama.cpp releases version b11861: fixes an inference exception caused by the minimax-m3 model’s quantized scaling tensor not being propagated.

llama.cpp v.b11861 fixes the weight distortion issue in the minimax-m3 model that occurred under NVFP4/MXFP8 quantization due to the scale tensor not being injected into the computation graph, thereby preventing “token soup” and residual vanishing; it also provides multi-platform binary builds covering macOS, Linux, Windows, Android, iOS, and openEuler.

Timeline and related coverage