AI tools, cybersecurity and development news aggregated from top sources — saved permanently with unique URLs.
KLD comparison of oQ, Q, MXFP and UD MLX quantizations
https://preview.redd.it/19qgxrcbx6yg1.png?width=1500&format=png&auto=webp&s=f690859d4e099d2fa88b40b0…
Devs using Qwen 27B seriously, what's your take?
For developers using Qwen 27B for coding, Codex style: what's your honest take? So far, for me, it's…
Qwen 3.6-35B-A3B KV cache part 2: PPL, KL divergence, asymmetric K/V, 64K row on M5 Max
Followup to yesterday's post: https://www.reddit.com/r/LocalLLaMA/comments/1sy7srk/. Comments asked …
Writing an LLM compiler from scratch: PyTorch to CUDA in 5,000 lines of Python
Hey r/LocalLLaMA, I wanted to come up with a simple overview of the modern ML compiler stack, essent…
Building a fully local PDF-to-audiobook workflow with Kokoro 82M, Qwen and llama.cpp
Hey everyone, I’ve been building a local-first desktop PDF reader that can read technical books alou…
Where do you see yourself in the next 5 years
I’m seriously believe this is the future. Soon, there will be people running around the town, helpin…
inclusionAI/Ling-2.6-1T · Hugging Face
Ling-2.6-1T: A Trillion-Parameter Comprehensive Flagship Model for Complex Tasks Today, we are thril…
Granite Speech 4.1
submitted by /u/nuclearbananana [link] [comments]…
AMA with Nous Research -- Ask Us Anything!
Hey everyone, emozilla here (u/emozilla), co-founder and CTO of Nous Research. We're the makers of H…
Mistral Medium 3.5 Launched
Looks great for the parameter count Open Weights. modified MIT -> no commercial usage without paying…
Introducing the IBM Granite 4.1 family of models (3B/8B/30B)
submitted by /u/abkibaarnsit [link] [comments]…
PS5’s can now be hacked to run Linux - perhaps some potential for local inference?
I look forward to the Local LLM community getting llama.cpp to run on these. Could be a good value. …