AI tools, cybersecurity and development news aggregated from top sources — saved permanently with unique URLs.
Microsoft Aion 1.0 Instruct and Aion 1.0 Plan models!
Microsoft announced 2 new on-device models at Microsoft Build 2026. Aion 1.0 Instruct: efficiency a…
Nous Research — Hermes Desktop
submitted by /u/zxyzyxz [link] [comments]…
How to use llama.cpp to quantize to NVFP4?
Trying to run MiniMax M2.7 NVFP4 via llama.cpp but not seeing any GGUFs anywhere on huggingface. So …
Why do we benchmark quants on perplexity and prose but never on tool call validity?
The mixed precision quant discussion here lately, MoE aware stuff that keeps shared experts and the …
Which Web Search API gives the cleanest Markdown output for local RAG parsing?
Web search APIs are essential for grounding local LLMs, but feeding raw HTML or messy JSON snippets …
Why are quants on KV cache increase before weight quants?
I'm cases where ram is limited I've seen a preference for increasing kvcache precision instead of th…
Weird issue with OpenCode and Qwen3.6
I’m using Qwen3.6-27B running on my server with llama-server for AI coding with OpenCode. Sometimes …
What memory system are you using for your agents?
Are you using a specific third party memory system for your agents, like claude code but also Hermes…
Whoever fixed the Nixos flake build, Thank you!
Thank you so much for your work. We love you! Also, PSA to the 5 people here who build llama.cpp on …
In Q8_0 weight quantization, why can't we just skip blocks of 32 that have very large outliers?
Looking for someone with an expert-level understanding. I understand that we can skip layers and sub…
Mellum2-12B-A2.5B-Thinking-GGUF at Q8
Its a shitty python programmer, but it shits really really really fast on my 5090 submitted by …
DolphinGemma release when?
Of all the promised and never delivered models out there, this one hurts me the most :( submitted…