MiMo-V2.5-GGUF (preview available)
Hi, AesSedai here - I've put up a PR to support the text-to-text inference of MiMo V2.5 with llama.cβ¦
AI tools, cybersecurity and development news aggregated from top sources β saved permanently with unique URLs.
MiMo-V2.5-GGUF (preview available)
Hi, AesSedai here - I've put up a PR to support the text-to-text inference of MiMo V2.5 with llama.cβ¦
Hipfire dev update: full AMD arch validation incoming (RDNA 1 thru 4, plus Strix Halo and bc250)
Hipfire local dev lab coming together. MS-S1 MAX (Strix Halo, RDNA 3.5) + R9700 (RDNA 4 Pro) just laβ¦
Why isnβt LLM reasoning done in vector space instead of natural language?
Why donβt LLMs use explicit vector-based reasoning instead of language-based chain-of-thought? What β¦
llama.cpp's Preliminary SM120 Native NVFP4 MMQ Is Merged
https://github.com/ggml-org/llama.cpp/pull/22196 And somehow we already got some GGUFs for it! httpsβ¦
ggml-cuda: add flash-attn support for DKQ=320/DV=256 with ncols2=32 (β¦ by lnigam Β· Pull Request #22286 Β· ggml-org/llama.cpp
Improves the speed of Mistral Small 4 on CUDA (there was a CPU fallback before) (I wonder if itβs sβ¦
Mistral Workflows
submitted by /u/FiReaNG3L [link] [comments]β¦
Mistral-Medium 3.5 (128B) spotted ?
Found a reference to this model in a vLLM commit submitted by /u/tkon3 [link] [comments]β¦
I've created a LoRA for Gemma 3 270M making it probably the smallest thinking model?
https://huggingface.co/firstbober/gemma-3-270M-it-smol-thinker Here is an example of the output: ```β¦
XiaomiMiMo MiMo-V2.5 (not pro) - Architecture: Sparse MoE (Mixture of Experts), 310B total / 15B activated parameters
https://huggingface.co/XiaomiMiMo/MiMo-V2.5 Interesting because unlike its bigger brother it can be β¦
daily ritual at this pointβ¦
submitted by /u/onil_gova [link] [comments]β¦
Mistral Medium Is On The Way
Interestingly enough, Mistral Small is written as Mistral-Small-4-119B-2603. Their medium model willβ¦
convert : add support for Nemotron Nano 3 Omni by danbev Β· Pull Request #22481 Β· ggml-org/llama.cpp
https://huggingface.co/ggml-org/NVIDIA-Nemotron-3-Nano-Omni NVIDIA Nemotron 3 Nano Omni is a multimoβ¦