llama.cpp b10437 yüklə

model : add support for MiniMaxText01ForCausalLM and MiniMaxM1ForCausalLM (#27018)
- llama : support for MiniMax-Text-01 model
- chore : renames to match the other MiniMax models
- model : add logits mask as MiniMax-Text-01 embeddings tensor has zero-valued embeddings for tokens >= 200032 that produce zero logits disrupting the token sampling process
- llama : replace hardcoded conditions with hparams.is_recr()
- model : used build_rs() for recurrent state management
- chore : code cleanup
- model : optimized MiniMax-Text-01 by removing the state tranpose operations
- chore : removed unnecessary ggml_cont() in MiniMax-Text-01 implementation
- llama : add generic logits mask graph input
- model : permuted diag_decay dimensions to avoid doing it inside MiniMax-Text-01 graph
- chore : code cleanup
- chore : code cleanup
- model : use token positions when calculating MiniMax-Text-01 decay tensors
- convert : add support for MiniMaxM1ForCausalLM as it seems to be the same as MiniMaxText01ForCausalLM
- chat : add jinja template for MiniMax-M1
Co-authored-by: QscQ qscqesze@gmail.com
- chore : code cleanup
- tests : MINIMAX_01-related fixes
- chore : silence Python lint errors
- vocab : remove unnecessary vocab type
- convert : update MiniMaxText01Model conversion to use yield when modifying tensors
- convert : suppress tokens with zero-valued embeddings during MiniMax-Text-01 conversion
- llama : removed logits mask - no longer necessary as token suppression is used instead
- model : use common functions to make MiniMax-Text-01 implementation more concise
Co-authored-by: Sigbjørn Skjæret sigbjorn.skjaeret@huggingface.co
- model : use common functions to make MiniMax-Text-01 implementation more concise
Co-authored-by: Sigbjørn Skjæret sigbjorn.skjaeret@huggingface.co
- convert : override non-working built-in chat template during conversion
- tests : skip arch MINIMAX_01 tests for WebGPU backend (it breaks again)
Co-authored-by: Stanisław Szymczyk sszymczy@gmail.com
Co-authored-by: QscQ qscqesze@gmail.com
Co-authored-by: Sigbjørn Skjæret sigbjorn.skjaeret@huggingface.co
Website:
- https://llama.app
macOS/iOS:
- macOS Apple Silicon (arm64)
- macOS Apple Silicon (arm64, KleidiAI enabled) DISABLED
- macOS Intel (x64)
- iOS XCFramework
Linux:
- Ubuntu x64 (CPU)
- Ubuntu arm64 (CPU)
- Ubuntu s390x (CPU)
- Ubuntu x64 (Vulkan)
- Ubuntu arm64 (Vulkan)
- Ubuntu x64 (ROCm 7.14)DISABLED
- Ubuntu x64 (OpenVINO)
- Ubuntu x64 (SYCL FP32)
- Ubuntu x64 (SYCL FP16)
Android:
- Android arm64 (CPU)
Windows:
- Windows x64 (CPU)
- Windows arm64 (CPU)
- Windows arm64 (OpenCL Adreno)
- Windows x64 (CUDA 12) - CUDA 12.4 DLLs
- Windows x64 (CUDA 13) - CUDA 13.3 DLLs
- Windows arm64 (CUDA 13) (preview) - CUDA 13.4 DLLs
- Windows x64 (Vulkan)
- Windows x64 (OpenVINO)
- Windows x64 (SYCL)
- Windows x64 (ROCm 7.14)
openEuler:
- DISABLED
- openEuler x86 (310p)
- openEuler x86 (910b, ACL Graph)
- openEuler aarch64 (310p)
- openEuler aarch64 (910b, ACL Graph)
UI:
- UI