Maarufu: Data ilisasishwa 27 Oktoba 2026

Kategoria

Intaneti1,356
Mawasiliano321
Sauti na video898
Michoro na usanifu539
Ofisi na tija1,124
Zana za wasanidi3,134
Zana za AI529
Usalama na faragha385
Zana za mfumo3,114
Michezo523
Elimu na sayansi239
Mtandao na TEHAMA284

Pakua llama.cpp b8532

LLM inference in C/C++

Hili ni toleo la zamani. Toleo la sasa ni b9994. llama.cpp b9994 · Lilitolewa:

Faili za kisakinishi b8532

UsanifuAinaUpeoUkubwa wa failiPakuaSHA256
64-bit ZIP → Portable — — github.com VirusTotal

Kiungo na SHA256 vinatoka kwenye manifest ya jumuiya ya Windows Package Manager. Linganisha hashi ya faili uliyopakua kabla ya kuiendesha.

Maelezo ya toleo

CUDA & CPU: support F32 kernel type for CONV_TRANSPOSE_2D (#17094)
- Refactor CUDA 2D transpose implementation to support multiple kernel types and improve parameter handling
- Introduced a conv2d_transpose_params struct for better parameter management.
- Updated conv2d_transpose_kernel to be templated for different kernel types (float and half).
- Modified ggml_cuda_conv_2d_transpose_p0 to handle both F16 and F32 kernel types.
- Enhanced test cases to validate functionality for both kernel types.
- Refactor test cases for 2D convolution transpose to support dynamic kernel types
- Updated test_conv_transpose_2d structure to improve parameter handling by reordering constructor arguments.
- Enhanced test case generation to iterate over kernel types, allowing for flexible testing of different configurations.
- Removed hardcoded kernel type instances in favor of a loop for better maintainability and scalability.
- Refactor ggml_compute_forward_conv_transpose_2d to support both F16 and F32 tensor types.
- Refactor conv2d transpose kernel to use a template for kernel type, enhancing flexibility for different data types.
Update test cases to include both F16 and F32 tensor types for comprehensive coverage.
- Update ggml/src/ggml-cuda/conv2d-transpose.cu
Co-authored-by: Aman Gupta amangupta052@gmail.com
- Update ggml/src/ggml-cpu/ggml-cpu.c
Co-authored-by: Aman Gupta amangupta052@gmail.com
- Refactor conv2d transpose implementation by removing the conv2d_transpose_params struct and dispatching with direct kernel launch.
- Enhance cpu conv2d transpose implementation by introducing a templated kernel type for improved flexibility with F16 and F32 data types.
Co-authored-by: Aman Gupta amangupta052@gmail.com
macOS/iOS:
- macOS Apple Silicon (arm64)
- macOS Intel (x64)
- iOS XCFramework
Linux:
- Ubuntu x64 (CPU)
- Ubuntu x64 (Vulkan)
- Ubuntu x64 (ROCm 7.2)
- Ubuntu s390x (CPU)
- Ubuntu x64 (OpenVINO)
Windows:
- Windows x64 (CPU)
- Windows arm64 (CPU)
- Windows x64 (CUDA 12) - CUDA 12.4 DLLs
- Windows x64 (CUDA 13) - CUDA 13.1 DLLs
- Windows x64 (Vulkan)
- Windows x64 (SYCL)
- Windows x64 (HIP)
openEuler:
- openEuler x86 (310p)
- openEuler x86 (910b, ACL Graph)
- openEuler aarch64 (310p)
- openEuler aarch64 (910b, ACL Graph)

https://github.com/ggml-org/llama.cpp/releases/tag/b8532

Lebo

Shiriki