Toto je starší verze. Nejnovější verze je b9994. llama.cpp b9994 · Datum vydání:
Instalační soubory b8140
| Architektura | Typ | Pro koho | Velikost souboru | Stáhnout | SHA256 |
|---|---|---|---|---|---|
| 64bit | ZIP → Přenosná verze | — | — | github.com | VirusTotal |
Odkaz a SHA256 pocházejí z komunitního manifestu Windows Package Manageru. Před spuštěním porovnejte hash staženého souboru.
Seznam změn
hexagon refactor all Ops to use local context struct (#19819)
- hexagon: refactor set/get/sum-rows ops to use local context
- hexagon: refactor ROPE and Softmax Ops to use local context
Improves performance a bit by precomputing things and saving in the context.
- hexagon: refactor activation ops to use local context struct
- hexagon: refactor unary ops to use local context struct and DMA/VTCM
- hexagon: use aligned hvx_scale function
- hexagon: remove unused fields from op_context
- hexagon: rewrite ROPE to use DMA and VTCM scratchpad
- hex-rope: keep N rows in scratchpad (instead of just two)
- hex-rope: introduce rowidx cache
- hex-rope: remove unused fields
- hex-rope: rewrite dma prefetch logic to allow for multi-row fetch/compute
also removes the need for fastdiv.
- hex-rope: minor formatting
- hex-rope: use indices and unroll the loops
- hex-rope: more updates to cleanup rope-block handling
- hexagon: cleanup supported type/dims checks
- hexagon: all reduce funcs replicated across lanes
There is no need to explicitly replicate the first value.
- snapdragon: update adb and windows scripts to use ubatch-size 256
Updated Ops support handles larger ubatches.
macOS/iOS:
- macOS Apple Silicon (arm64)
- macOS Intel (x64)
- iOS XCFramework
Linux:
- Ubuntu x64 (CPU)
- Ubuntu x64 (Vulkan)
- Ubuntu x64 (ROCm 7.2)
- Ubuntu s390x (CPU)
Windows:
- Windows x64 (CPU)
- Windows arm64 (CPU)
- Windows x64 (CUDA 12) - CUDA 12.4 DLLs
- Windows x64 (CUDA 13) - CUDA 13.1 DLLs
- Windows x64 (Vulkan)
- Windows x64 (SYCL)
- Windows x64 (HIP)
openEuler:
- openEuler x86 (310p)
- openEuler x86 (910b, ACL Graph)
- openEuler aarch64 (310p)
- openEuler aarch64 (910b, ACL Graph)