Qwen 3.6-35B-A3B KV cache bench: f16 vs q8_0 vs turbo3 vs turbo4 from 0 to 1M context on M5 Max
Took TheTom's TurboQuant Metal fork of llama.cpp (github.com/TheTom/llama-cpp-turboquant, the featurβ¦
AI tools, cybersecurity and development news aggregated from top sources β saved permanently with unique URLs.
Qwen 3.6-35B-A3B KV cache bench: f16 vs q8_0 vs turbo3 vs turbo4 from 0 to 1M context on M5 Max
Took TheTom's TurboQuant Metal fork of llama.cpp (github.com/TheTom/llama-cpp-turboquant, the featurβ¦
Something from Mistral (Vibe) tomorrow
Model(s) or Tool upgrade/New Tool? Source Tweet : https://xcancel.com/mistralvibe/status/20491476458β¦
Introducing Laguna XS.2 and Laguna M.1
submitted by /u/abkibaarnsit [link] [comments]β¦
Benchmarking Local LLM/Harness Combinations
Hi, I'm trying to find the best local model/harness combinations for agentic coding tasks involving β¦
Nemotron-3-Nano-Omni-30B-A3B-Reasoning, New model?
It is Audio-Image/vids-Text -> Text Original BF 16 https://huggingface.co/nvidia/Nemotron-3-Nano-Omnβ¦
Ling-2.6-flash
submitted by /u/Namra_7 [link] [comments]β¦
Lemonade OmniRouter: unifying the best local AI engines for omni-modality
Iβve always liked how if I ask ChatGPT to make or edit an image, it just does it. Local AI should beβ¦
A new revolutionary way to build guardrails and evaluate your agents
For those of you who already know me, you may be aware of my history with AI agents, which began aboβ¦
I'm Not a Dev But I Use Qwen 3.6 35b to Code
Full disclosure: I used to program a bit, but I was garbage at it so I found a new career. This was β¦
Poolside Laguna XS.2
33B A3B MoE, Apache 2 licensed. Reported agentic results put it about level with Qwen 3.5 35B A3B, bβ¦
Abliterlitics: Benchmarks and Tensor Comparison for Heretic, Abliterlix, Huiui, HauhauCS for GLM 4.7 Flash
This is a follow up to the previous benchmark and tensor analysis of abliteration techniques across β¦
Lessons from building a coding agent for 8k context windows: token budgeting, parallel executors, and per-file isolation
Most AI coding tools (Cursor, Aider, Claude Code) assume you have a 200k-token model. If you're runnβ¦