跳到正文
AI NEWS JOURNAL
llama.cpp releasesAI NEWS / JOURNAL

b11922

测试:修复针对已训练模型的多序列拆分重放及部分状态情形(#31216)* 测试:修复针对已训练模型的多序列拆分重放 回滚快照由解码回滚尾部的图谱捕获,而参考上下文则以不同的批次形状解码同一前缀。这两种状态在最后几位上存在差异,且已训练模型会在每次重放的每个标记中进一步放大这种差异。仅比较每个序列的第一个重放标记,然后在序列-1-only尾部之前,将回滚状态恢复到参考上下文中。 协助者:dsh:llama.cpp/ggml-org/Qwen3.8-Flash-Next-GGUF(MacBook,M5 Max,128GB)* 测试:要求在拆分重放中实现逐位精确的序列-1隔离 序列状态保存并不总是位完全无损——SWA掩码单元不会被保存——因此需重新加载其余部分

正在翻译为所选语言,完成后自动更新。

tests : fix multi-seq split replay and partial-state cases for trained models (#31216)

* tests : fix multi-seq split replay against trained models

The rollback snapshot is captured by the graph that decoded the rolled-back

tail, while the reference context decodes the same prefix with different

batch shapes. The two states differ in the last bits and trained models

amplify the difference with every replayed token. Compare only the first

replayed token of each seq, then restore the rollback state into the

reference context before the seq-1-only tail.

Assisted-by: dsh:llama.cpp/ggml-org/Qwen3.8-Flash-Next-GGUF (MacBook, M5 Max, 128GB)

* tests : require bit-exact seq-1 isolation in split replay

The seq state save is not always bit-lossless - SWA-masked cells are not

saved - so reload the restored state back into the rollback context. That

way both contexts enter the seq-1-only tail with byte-identical memory,

including the cell layout, and the tail logits must match bit-exact. Also

assert that the restored state round-trips bit-identical.

Assisted-by: dsh:llama.cpp/ggml-org/Qwen3.8-Flash-Next-GGUF (MacBook, M5 Max, 128GB)

* tests : drop the n_swa partial-state check from ps

The check keys off llama_model_n_swa(), which returns 0 for dsv4 even

though its raw KV cache has a 128-cell sliding window. The partial state

grows with the tokens there by design, so the flatness check is wrong.

Keep the partial <= full invariant.

Assisted-by: dsh:llama.cpp/ggml-org/Qwen3.8-Flash-Next-GGUF (MacBook, M5 Max, 128GB)

**Website:**

-

**Attestations:**

-

**macOS/iOS:**

- [macOS Apple Silicon (arm64)](https://github.com/ggml-org/llama.cpp/releases/download/b11922/llama-b11922-bin-macos-arm64.tar.gz)

- macOS Apple Silicon (arm64, KleidiAI enabled) [DISABLED](https://github.com/ggml-org/llama.cpp/pull/23780)

- [macOS Intel (x64)](https://github.com/ggml-org/llama.cpp/releases/download/b11922/llama-b11922-bin-macos-x64.tar.gz)

- [iOS XCFramework](https://github.com/ggml-org/llama.cpp/releases/download/b11922/llama-b11922-xcframework.zip)

**Linux:**

- [Ubuntu x64 (CPU)](https://github.com/ggml-org/llama.cpp/releases/download/b11922/llama-b11922-bin-ubuntu-x64.tar.gz)

- [Ubuntu arm64 (CPU)](https://github.com/ggml-org/llama.cpp/releases/download/b11922/llama-b11922-bin-ubuntu-arm64.tar.gz)

- [Ubuntu s390x (CPU)](https://github.com/ggml-org/llama.cpp/releases/download/b11922/llama-b11922-bin-ubuntu-s390x.tar.gz)

- [Ubuntu x64 (Vulkan)](https://github.com/ggml-org/llama.cpp/releases/download/b11922/llama-b11922-bin-ubuntu-vulkan-x64.tar.gz)

- [Ubuntu arm64 (Vulkan)](https://github.com/ggml-org/llama.cpp/releases/download/b11922/llama-b11922-bin-ubuntu-vulkan-arm64.tar.gz)

- [Ubuntu x64 (CUDA 12)](https://github.com/ggml-org/llama.cpp/releases/download/b11922/llama-b11922-bin-ubuntu-cuda-12.8-x64.tar.gz) - [CUDA 12.8 libraries](https://github.com/ggml-org/llama.cpp/releases/download/b11922/cudart-llama-b11922-bin-ubuntu-cuda-12.8-x64.tar.gz)

- [Ubuntu x64 (CUDA 13)](https://github.com/ggml-org/llama.cpp/releases/download/b11922/llama-b11922-bin-ubuntu-cuda-13.4-x64.tar.gz) - [CUDA 13.4 libraries](https://github.com/ggml-org/llama.cpp/releases/download/b11922/cudart-llama-b11922-bin-ubuntu-cuda-13.4-x64.tar.gz)

- [Ubuntu arm64 (CUDA 13)](https://github.com/ggml-org/llama.cpp/releases/download/b11922/llama-b11922-bin-ubuntu-cuda-13.4-arm64.tar.gz) - [CUDA 13.4 libraries](https://github.com/ggml-org/llama.cpp/releases/download/b11922/cudart-llama-b11922-bin-ubuntu-cuda-13.4-arm64.tar.gz)

- [Ubuntu x64 (ROCm 10.0)](https://github.com/ggml-org/llama.cpp/releases/download/b11922/llama-b11922-bin-ubuntu-rocm-10.0-x64.tar.gz)

- [Ubuntu x64 (OpenVINO)](https://github.com/ggml-org/llama.cpp/releases/download/b11922/llama-b11922-bin-ubuntu-openvino-2026.4.1-x64.tar.gz)

- [Ubuntu x64 (SYCL FP32)](https://github.com/ggml-org/llama.cpp/releases/download/b11922/llama-b11922-bin-ubuntu-sycl-fp32-x64.tar.gz)

- [Ubuntu x64 (SYCL FP16)](https://github.com/ggml-org/llama.cpp/releases/download/b11922/llama-b11922-bin-ubuntu-sycl-fp16-x64.tar.gz)

- [Linux arm64 (Snapdragon: CPU, Adreno GPU, Hexagon NPU)](https://github.com/ggml-org/llama.cpp/releases/download/b11922/llama-b11922-bin-linux-arm64-snapdragon.tar.gz) - [setup guide](https://github.com/ggml-org/llama.cpp/blob/master/docs/backend/snapdragon/linux.md)

**Android:**

- [Android arm64 (CPU)](https://github.com/ggml-org/llama.cpp/releases/download/b11922/llama-b11922-bin-android-arm64.tar.gz)

- [Android arm64 (Snapdragon: CPU, Adreno GPU, Hexagon NPU)](https://github.com/ggml-org/llama.cpp/releases/download/b11922/llama-b11922-bin-android-arm64-snapdragon.tar.gz) - [setup guide](https://github.com/ggml-org/llama.cpp/blob/master/docs/backend/snapdragon/README.md)

**Windows:**

- [Windows x64 (CPU)](https://github.com/ggml-org/llama.cpp/releases/download/b11922/llama-b11922-bin-win-cpu-x64.zip)

- [Windows arm64 (CPU)](https://github.com/ggml-org/llama.cpp/releases/download/b11922/llama-b11922-bin-win-cpu-arm64.zip)

- [Windows arm64 (OpenCL Adreno)](https://github.com/ggml-org/llama.cpp/releases/download/b11922/llama-b11922-bin-win-opencl-adreno-arm64.zip)

- [Windows x64 (CUDA 12)](https://github.com/ggml-org/llama.cpp/releases/download/b11922/llama-b11922-bin-win-cuda-12.4-x64.zip) - [CUDA 12.4 DLLs](https://github.com/ggml-org/llama.cpp/releases/download/b11922/cudart-llama-bin-win-cuda-12.4-x64.zip)

- [Windows x64 (CUDA 13)](https://github.com/ggml-org/llama.cpp/releases/download/b11922/llama-b11922-bin-win-cuda-13.4-x64.zip) - [CUDA 13.4 DLLs](https://github.com/ggml-org/llama.cpp/releases/download/b11922/cudart-llama-bin-win-cuda-13.4-x64.zip)

- [Windows arm64 (CUDA 13)](https://github.com/ggml-org/llama.cpp/releases/download/b11922/llama-b11922-bin-win-cuda-13.4-arm64.zip) - [CUDA 13.4 DLLs](https://github.com/ggml-org/llama.cpp/releases/download/b11922/cudart-llama-bin-win-cuda-13.4-arm64.zip)

- [Windows x64 (Vulkan)](https://github.com/ggml-org/llama.cpp/releases/download/b11922/llama-b11922-bin-win-vulkan-x64.zip)

- [Windows arm64 (Vulkan)](https://github.com/ggml-org/llama.cpp/releases/download/b11922/llama-b11922-bin-win-vulkan-arm64.zip)

- [Windows x64 (OpenVINO)](https://github.com/ggml-org/llama.cpp/releases/download/b11922/llama-b11922-bin-win-openvino-2026.4.1-x64.zip)

- [Windows x64 (SYCL)](https://github.com/ggml-org/llama.cpp/releases/download/b11922/llama-b11922-bin-win-sycl-x64.zip)

- [Windows x64 (ROCm 10.0)](https://github.com/ggml-org/llama.cpp/releases/download/b11922/llama-b11922-bin-win-rocm-10.0-x64.zip)

**openEuler:**

- [DISABLED](https://github.com/ggml-org/llama.cpp/pull/23705)

- openEuler x86 (310p)

- openEuler x86 (910b, ACL Graph)

- openEuler aarch64 (310p)

- openEuler aarch64 (910b, ACL Graph)

**UI:**

- [UI](https://github.com/ggml-org/llama.cpp/releases/download/b11922/llama-b11922-ui.tar.gz)

资料来源

llama.cpp releases
← 继续阅读全部动态