مشهور: معلومات په AP ۱۴۰۵ لړم ۲۸ تازه شول

کټګورۍ

انټرنېټ۱٬۴۱۶
اړیکې۳۲۸
غږ او ویډیو۹۳۸
ګرافیک او ډیزاین۵۶۳
دفتري او تولیدي۱٬۱۷۹
د پراختیا وسایل۳٬۲۸۴
د AI وسایل۶۰۸
امنیت او محرمیت۴۰۸
د سیستم وسایل۳٬۱۸۷
لوبې۵۴۳
زده کړه او ساینس۲۴۲
شبکه او IT۲۹۳

llama.cpp b12314 ډاونلوډ

LLM inference in C/C++

دا یوه زړه نسخه ده. اوسنۍ نسخه b9994 ده. llama.cpp b9994 · د خپرېدو نېټه:

د نصب فایلونه b12314

جوړښتډولد نصب ساحهد فایل اندازهډاونلوډSHA256
64-bit ZIP → پورټېبل — — github.com VirusTotal
ARM64 ZIP → پورټېبل — — github.com VirusTotal

لینک او SHA256 د Windows Package Manager د ټولنې له مانیفسټ څخه اخیستل شوي. د ډاونلوډ شوي فایل له چلولو مخکې یې هش پرتله کړئ.

د خپرونې یادښتونه

opencl: add decomposed FA for Adreno (#32046)
- opencl: add decomposed FA
Assisted-by: Claude Opus 5.5
Co-authored-by: Hongqiang Wang wangh@qti.qualcomm.com
Co-authored-by: Shaofei Qi shaoqi@qti.qualcomm.com
- opencl: build FA MQ kernel on first FA call
- so allows warmup to early build neccessary kernels
Assisted-by: Claude Opus 5.5
- opencl: handle inf for fully masked row
- opencl: refine condition for using fa decomp
- opencl: support dp4a for PV mm
Assisted-by: Codex
- opencl: add direct PV for FA decomp to avoid V transpose for small batch
Assisted-by: Codex
- opencl: enable direct pv by default
- opencl: expand X2E decomposed FA to smaller heads and batches
- Lower the default head dimension threshold from 256 to 128 on X2E.
- Allow DK64 with P8, no attention sinks, GQA >= 2 and n_kv >= max(1024, 2*n_q).
- Allow P8 with V transpose for 2-31 queries when direct PV is unavailable, DK >= 128 and n_kv >= 1024.
Assisted-by: Codex
- opencl: adjust format
Co-authored-by: Li He lih@qti.qualcomm.com
Co-authored-by: Hongqiang Wang wangh@qti.qualcomm.com
Website:
- https://llama.app
Attestations:
- https://github.com/ggml-org/llama.cpp/attestations/66552799
macOS/iOS:
- macOS Apple Silicon (arm64)
- macOS Apple Silicon (arm64, KleidiAI enabled) DISABLED
- macOS Intel (x64)
- iOS XCFramework
Linux:
- Ubuntu x64 (CPU)
- Ubuntu arm64 (CPU)
- Ubuntu 24.04 s390x (CPU)
- Ubuntu 26.04 s390x (CPU)
- Ubuntu 26.04 s390x (zDNN)
- Ubuntu x64 (Vulkan)
- Ubuntu arm64 (Vulkan)
- Ubuntu x64 (CUDA 12) - CUDA 12.8 libraries
- Ubuntu x64 (CUDA 13) - CUDA 13.5 libraries
- Ubuntu arm64 (CUDA 13) - CUDA 13.5 libraries
- Ubuntu x64 (ROCm 10.0)
- Ubuntu x64 (OpenVINO)
- Ubuntu x64 (SYCL FP32)
- Ubuntu x64 (SYCL FP16)
- Linux arm64 (Snapdragon: CPU, Adreno GPU, Hexagon NPU) - setup guide
Android:
- Android arm64 (CPU)
- Android arm64 (Snapdragon: CPU, Adreno GPU, Hexagon NPU) - setup guide
Windows:
- Windows x64 (CPU)
- Windows arm64 (CPU)
- Windows arm64 (OpenCL Adreno)
- Windows x64 (CUDA 12) - CUDA 12.4 DLLs
- Windows x64 (CUDA 13) - CUDA 13.5 DLLs
- Windows arm64 (CUDA 13) - CUDA 13.5 DLLs
- Windows x64 (Vulkan)
- Windows arm64 (Vulkan)
- Windows x64 (OpenVINO)
- Windows x64 (SYCL)
- Windows x64 (ROCm 10.0)
openEuler:
- DISABLED
- openEuler x86 (310p)
- openEuler x86 (910b, ACL Graph)
- openEuler aarch64 (310p)
- openEuler aarch64 (910b, ACL Graph)
UI:
- UI

https://github.com/ggml-org/llama.cpp/releases/tag/b12314

ټګونه

شریکول