AI tools, cybersecurity and development news aggregated from top sources — saved permanently with unique URLs.
Are you quanting your memory?
Title. Curious about how people are generally dealing with the kv cache. BF16? Q8? Q4? Turboquant or…
What kind of device is suitable for running local LLM?
Since copilot has changed it's billing model, become super expensive, I'm starting to think the poss…
OBLITERATUS by elder_plinius anyone actually used it on a real model? Worth running over Heretic for MoE targets?
https://github.com/elder-plinius/OBLITERATUS submitted by /u/AutomaticDriver5882 [link] [c…
Qwen3.6-27B-NVFP4 - images
Model: Abiray-Qwen3.6-27B-NVFP4.gguf Specs: - Legion 7i Gen10 - NVIDIA GeForce RTX™ 5090 - Intel® Co…
New rules 1 week check-in
Its been 1 week since we announced new rules: https://www.reddit.com/r/LocalLLaMA/comments/1su3ao4/r…
Great analysis of how the different KV rotation methods perform. Tl;dr: saw is what you want.
submitted by /u/fredandlunchbox [link] [comments]…
Been using Qwen-3.6-27B-q8_k_xl + VSCode + RTX 6000 Pro As Daily Driver
So in response to the Great Token Reconning of 2026, I decided to try out Qwen 3.6 as a daily driver…
Anthropic's analysis of Claude usage for personal guidance
Key takeaways for me: 6% of usage accounts for personal guidance ("seeking not just information bu…
NVIDIA / SemiAnalysis Misleading Marketing
NVIDIA and SemiAnalysis have been posting these ridiculous graphs, one of which was Jensen Huangs ba…
Your local LLM predictions and hopes for May 2026
Which of these do you think we'll get in May? Also, feel free to pick/rank which ones you'd want the…
Need help deciding what to spend 4-5k on for a local rig.
Right now I think ive narrowed down my 2 options for what im trying to do, Either a DGX spark like t…
Best Agentic Coding model I can run on the new Macbook M5 Max?
16-inch MacBook Pro - M5 Max Component Specs Chip Apple M5 Max CPU 18-core (6 super cores @ 4…