AI tools, cybersecurity and development news aggregated from top sources β saved permanently with unique URLs.
CUDA: reduce MMQ stream-k overhead by JohannesGaessler Β· Pull Request #22298 Β· ggml-org/llama.cpp
CUDA prompt processing speedup on MoE check this https://github.com/ggml-org/llama.cpp/pull/22298#isβ¦
Field report: coding with Qwen 3.6 35B-A3B on an M2 Macbook Pro with 32GB RAM
TL;DR: I finally have this working and doing real work within the tight specs of my 32GB RAM Mac. Soβ¦
Decreased Intelligence Density in DeepSeek V4 Pro
In the V3.2 paper, they mentioned: Second, token efficiency remains a challenge; DeepSeek-V3.2 typiβ¦
"Weights are coming".Xiaomiβs MiMo V2.5 Pro has landed at 54 in the Artificial Analysis Intelligence Index.
From: - Xiaomi MiMo on π: https://x.com/XiaomiMiMo/status/2047840164777726076 - Artificial Analysis β¦
Qwen3.6-27B at ~80 tps with 218k context window on 1x RTX 5090 served by vllm 0.19
Qwen3.6-27B is out for a few days and the NVFP4 with MTP is dropped earlier on HF: https://huggingfaβ¦
DeepSeek V4 Update
DeepSeek V4 Update submitted by /u/techlatest_net [link] [comments]β¦
I'm glad we have deepseek
other companies are slowly going away from open weight, not releasing base models, delaying open weiβ¦
AMA Announcement: Nous Research, The Opensource Lab Behind Hermes Agent (Wednesday, 8AM-11AM PST)
Hi r/LocalLLaMA π We're excited for Wednesday's guests, The Nous Research Team! Kicking things off Wβ¦
This is where we are right now, LocalLLaMA
the future is now submitted by /u/jacek2023 [link] [comments]β¦
Deepseek V4 AGI comfirmed
submitted by /u/Swimming-Sky-7025 [link] [comments]β¦
r/LocalLLaMa Rule Updates
As the sub has grown (and as AI based tools have gotten better) with over 1M weekly visitors, we've β¦
Best Local LLMs - Apr 2026
We're back with another Best Local LLMs Megathread! We have continued feasting in the months since tβ¦