Maarufu: Data ilisasishwa 27 Oktoba 2026

Kategoria

Intaneti1,356
Mawasiliano321
Sauti na video898
Michoro na usanifu539
Ofisi na tija1,124
Zana za wasanidi3,134
Zana za AI529
Usalama na faragha385
Zana za mfumo3,114
Michezo523
Elimu na sayansi239
Mtandao na TEHAMA284

Pakua llama.cpp b7964

LLM inference in C/C++

Hili ni toleo la zamani. Toleo la sasa ni b9994. llama.cpp b9994 · Lilitolewa:

Faili za kisakinishi b7964

UsanifuAinaUpeoUkubwa wa failiPakuaSHA256
64-bit ZIP → Portable — — github.com VirusTotal

Kiungo na SHA256 vinatoka kwenye manifest ya jumuiya ya Windows Package Manager. Linganisha hashi ya faili uliyopakua kabla ya kuiendesha.

Maelezo ya toleo

model : support Step3.5-Flash (#19283)
- Support Step3.5-Flash
- fix: norm.weight + 1 (HF zero_centered=true)
- step35: simplify GGUF conversion + drop redundant rope KVs
- Address review feedback
- rename limits -> clamp
- Apply suggestions from code review
Co-authored-by: Sigbjørn Skjæret sigbjorn.skjaeret@scala.com
- Apply suggestion from @CISC
Co-authored-by: Sigbjørn Skjæret sigbjorn.skjaeret@scala.com
- rename swiglu limits -> swiglu clamp in LLM_KV
- avoid CI fail
- Apply suggestions from code review
- Apply suggestions from code review
- disabled KV shifting for LLM_ARCH_STEP35
- Apply suggestions from code review
- mistakenly removed cmath
- add model size && apply missed suggestion
- assert partial_rotary_factors
- fix CI errors:
- load freq_base_swa
Co-authored-by: lvyichen lvyichen@stepfun.com
Co-authored-by: Sigbjørn Skjæret sigbjorn.skjaeret@scala.com
macOS/iOS:
- macOS Apple Silicon (arm64)
- macOS Intel (x64)
- iOS XCFramework
Linux:
- Ubuntu x64 (CPU)
- Ubuntu x64 (Vulkan)
- Ubuntu s390x (CPU)
Windows:
- Windows x64 (CPU)
- Windows arm64 (CPU)
- Windows x64 (CUDA 12) - CUDA 12.4 DLLs
- Windows x64 (CUDA 13) - CUDA 13.1 DLLs
- Windows x64 (Vulkan)
- Windows x64 (SYCL)
- Windows x64 (HIP)
openEuler:
- openEuler x86 (310p)
- openEuler x86 (910b, ACL Graph)
- openEuler aarch64 (310p)
- openEuler aarch64 (910b, ACL Graph)

https://github.com/ggml-org/llama.cpp/releases/tag/b7964

Lebo

Shiriki