Obľúbené: Dáta aktualizované: 27. októbra 2026

Kategórie

Internet1 356
Komunikácia321
Audio a video898
Grafika a dizajn539
Kancelária a produktivita1 124
Vývoj3 134
Umelá inteligencia529
Zabezpečenie385
Systémové nástroje3 114
Hry523
Vzdelávanie a veda239
Sieť a IT284

llama.cpp b8140 na stiahnutie

LLM inference in C/C++

Toto je staršia verzia. Najnovšia verzia je b9994. llama.cpp b9994 · Dátum vydania:

Inštalačné súbory b8140

ArchitektúraTypPre kohoVeľkosť súboruStiahnuťSHA256
64-bit ZIP → Prenosná verzia — — github.com VirusTotal

Odkaz a SHA256 pochádzajú z komunitného manifestu Windows Package Managera. Pred spustením porovnajte hash stiahnutého súboru.

Zoznam zmien

hexagon refactor all Ops to use local context struct (#19819)
- hexagon: refactor set/get/sum-rows ops to use local context
- hexagon: refactor ROPE and Softmax Ops to use local context
Improves performance a bit by precomputing things and saving in the context.
- hexagon: refactor activation ops to use local context struct
- hexagon: refactor unary ops to use local context struct and DMA/VTCM
- hexagon: use aligned hvx_scale function
- hexagon: remove unused fields from op_context
- hexagon: rewrite ROPE to use DMA and VTCM scratchpad
- hex-rope: keep N rows in scratchpad (instead of just two)
- hex-rope: introduce rowidx cache
- hex-rope: remove unused fields
- hex-rope: rewrite dma prefetch logic to allow for multi-row fetch/compute
also removes the need for fastdiv.
- hex-rope: minor formatting
- hex-rope: use indices and unroll the loops
- hex-rope: more updates to cleanup rope-block handling
- hexagon: cleanup supported type/dims checks
- hexagon: all reduce funcs replicated across lanes
There is no need to explicitly replicate the first value.
- snapdragon: update adb and windows scripts to use ubatch-size 256
Updated Ops support handles larger ubatches.
macOS/iOS:
- macOS Apple Silicon (arm64)
- macOS Intel (x64)
- iOS XCFramework
Linux:
- Ubuntu x64 (CPU)
- Ubuntu x64 (Vulkan)
- Ubuntu x64 (ROCm 7.2)
- Ubuntu s390x (CPU)
Windows:
- Windows x64 (CPU)
- Windows arm64 (CPU)
- Windows x64 (CUDA 12) - CUDA 12.4 DLLs
- Windows x64 (CUDA 13) - CUDA 13.1 DLLs
- Windows x64 (Vulkan)
- Windows x64 (SYCL)
- Windows x64 (HIP)
openEuler:
- openEuler x86 (310p)
- openEuler x86 (910b, ACL Graph)
- openEuler aarch64 (310p)
- openEuler aarch64 (910b, ACL Graph)

https://github.com/ggml-org/llama.cpp/releases/tag/b8140

Štítky

Zdieľať