Αυτή είναι παλαιότερη έκδοση. Η τελευταία έκδοση είναι η b9994. llama.cpp b9994 · Κυκλοφορία:
Αρχεία εγκατάστασης b12314
| Αρχιτεκτονική | Τύπος | Εμβέλεια | Μέγεθος αρχείου | Λήψη | SHA256 |
|---|---|---|---|---|---|
| 64-bit | ZIP → Φορητό | — | — | github.com | VirusTotal |
| ARM64 | ZIP → Φορητό | — | — | github.com | VirusTotal |
Ο σύνδεσμος και το SHA256 προέρχονται από το κοινοτικό manifest του Windows Package Manager. Συγκρίνετε το hash του ληφθέντος αρχείου πριν το εκτελέσετε.
Σημειώσεις έκδοσης
opencl: add decomposed FA for Adreno (#32046)
- opencl: add decomposed FA
Assisted-by: Claude Opus 5.5
Co-authored-by: Hongqiang Wang wangh@qti.qualcomm.com
Co-authored-by: Shaofei Qi shaoqi@qti.qualcomm.com
- opencl: build FA MQ kernel on first FA call
- so allows warmup to early build neccessary kernels
Assisted-by: Claude Opus 5.5
- opencl: handle inf for fully masked row
- opencl: refine condition for using fa decomp
- opencl: support dp4a for PV mm
Assisted-by: Codex
- opencl: add direct PV for FA decomp to avoid V transpose for small batch
Assisted-by: Codex
- opencl: enable direct pv by default
- opencl: expand X2E decomposed FA to smaller heads and batches
- Lower the default head dimension threshold from 256 to 128 on X2E.
- Allow DK64 with P8, no attention sinks, GQA >= 2 and n_kv >= max(1024, 2*n_q).
- Allow P8 with V transpose for 2-31 queries when direct PV is unavailable, DK >= 128 and n_kv >= 1024.
Assisted-by: Codex
- opencl: adjust format
Co-authored-by: Li He lih@qti.qualcomm.com
Co-authored-by: Hongqiang Wang wangh@qti.qualcomm.com
Website:
- https://llama.app
Attestations:
- https://github.com/ggml-org/llama.cpp/attestations/66552799
macOS/iOS:
- macOS Apple Silicon (arm64)
- macOS Apple Silicon (arm64, KleidiAI enabled) DISABLED
- macOS Intel (x64)
- iOS XCFramework
Linux:
- Ubuntu x64 (CPU)
- Ubuntu arm64 (CPU)
- Ubuntu 24.04 s390x (CPU)
- Ubuntu 26.04 s390x (CPU)
- Ubuntu 26.04 s390x (zDNN)
- Ubuntu x64 (Vulkan)
- Ubuntu arm64 (Vulkan)
- Ubuntu x64 (CUDA 12) - CUDA 12.8 libraries
- Ubuntu x64 (CUDA 13) - CUDA 13.5 libraries
- Ubuntu arm64 (CUDA 13) - CUDA 13.5 libraries
- Ubuntu x64 (ROCm 10.0)
- Ubuntu x64 (OpenVINO)
- Ubuntu x64 (SYCL FP32)
- Ubuntu x64 (SYCL FP16)
- Linux arm64 (Snapdragon: CPU, Adreno GPU, Hexagon NPU) - setup guide
Android:
- Android arm64 (CPU)
- Android arm64 (Snapdragon: CPU, Adreno GPU, Hexagon NPU) - setup guide
Windows:
- Windows x64 (CPU)
- Windows arm64 (CPU)
- Windows arm64 (OpenCL Adreno)
- Windows x64 (CUDA 12) - CUDA 12.4 DLLs
- Windows x64 (CUDA 13) - CUDA 13.5 DLLs
- Windows arm64 (CUDA 13) - CUDA 13.5 DLLs
- Windows x64 (Vulkan)
- Windows arm64 (Vulkan)
- Windows x64 (OpenVINO)
- Windows x64 (SYCL)
- Windows x64 (ROCm 10.0)
openEuler:
- DISABLED
- openEuler x86 (310p)
- openEuler x86 (910b, ACL Graph)
- openEuler aarch64 (310p)
- openEuler aarch64 (910b, ACL Graph)
UI:
- UI