AI NEWS.ccIndex-Echo-S2TT-GGUF
GGUF packages for native speech-to-text translation with audio.cpp. Chinese speech produces timestamped source transcripts and English, Spanish, or Japanese translations. This port supports **S2TT only**; it does not generate translated speech. **There is room to improve 9B output parity and quantized quality**. Focused PRs with reproducible C++/Python comparisons are welcome. Note that 2B and 9B use the same C++ translation path, including the prompt, audio encoder, decoder implementation, and greedy sampler. 2B orig is parity safe, while 9B orig has drifts. 2B has 24 layers and tied token/output embeddings; 9B has 32 layers and a separate LM head. That can change how sensitive their outputs are to numerical differences, but I have not proved that it explains the 9B mismatch. These files were converted from the official 2B checkpoint at `72fd8bdc9bf8251f1c35f6d6289a950eda154395` and 9B checkpoint at `05f86cb7a38684916e193282b6cc02462ace4043`. Each GGUF embeds the audio tower, connector, text decoder, tokenizer, configuration, and audio.cpp model spec. The unused vision weights are not included.
번역 준비 중입니다. 원문을 표시합니다.
GGUF packages for native speech-to-text translation with audio.cpp. Chinese speech produces timestamped source transcripts and English, Spanish, or Japanese translations. This port supports **S2TT only**; it does not generate translated speech. **There is room to improve 9B output parity and quantized quality**. Focused PRs with reproducible C++/Python comparisons are welcome. Note that 2B and 9B use the same C++ translation path, including the prompt, audio encoder, decoder implementation, and greedy sampler. 2B orig is parity safe, while 9B orig has drifts. 2B has 24 layers and tied token/output embeddings; 9B has 32 layers and a separate LM head. That can change how sensitive their outputs are to numerical differences, but I have not proved that it explains the 9B mismatch. These files were converted from the official 2B checkpoint at `72fd8bdc9bf8251f1c35f6d6289a950eda154395` and 9B checkpoint at `05f86cb7a38684916e193282b6cc02462ace4043`. Each GGUF embeds the audio tower, connector, text decoder, tokenizer, configuration, and audio.cpp model spec. The unused vision weights are not included.