r/LocalLLaMA

The first AI Model in Egypt 🇪🇬

Following up on the Horus project — the first fully built-from-scratch language model in Egypt. If t…

APEX MoE quants update: 25+ new models since the Qwen 3.5 post + new I-Nano tier

Quick follow-up on APEX, the MoE-aware mixed-precision quant strategy. The original post was just ab…

Comparison of the development status of various claw/assistant projects

I was reading the Github of an assistant project I'm interested in, and one of the comments said it …

Building on a LLM Quants Testing Site/Ressource - Sharing a few insights from first month, so you can share your thoughts and wishes for the future.

Wanted to share some insights into a project I am building. The focus is to make it easier to unders…

M3 Ultra + DGX Spark = M5 Ultra-lite?

So I saw an article recently about exo disaggregated prefill with DGX Spark and M3 Ultra - prefill o…

Roundtable chat with Talkie-1930 and Gemma 4 31B

Talkie-1930-13b-it and Gemma 4 31b in the same chat. Talkie is a 13B vintage language model from 19…

The more I use it, the more I'm impressed

Qwen 3.6 27b vs Codex GPT 5.5 / Claude Opus 4.7 My local llm discovered a bug that they both missed …

LLMSearchIndex- an Open Source Local Web Search Library with over 200 million indexed Web Pages for RAG applications

I've been pretty unsatisfied with web search options for local LLM/RAG systems. Most setups either r…

Llama.cpp MTP support now in beta!

Happy to report that llama.cpp MTP support is now in beta, thanks to Aman (and all the others that h…

Live demo of LocalVQE: Tiny ~1M param audio model that cancels echo and noise in realtime

submitted by /u/richiejp [link] [comments]…

[Release] TinyMozart v2 85M 🎶

Hello r/LocalLLaMA ! I am proud to present the second version of TinyMozart... This is an improved v…

Deep research + report "a la McKinsey" with Hermes Agent and qwen3.6-35b-a3b Q6_K.

Hi there. Not native English speaker. Not AI edited, so bear with me. 15+ years as social researcher…