r/LocalLLaMA

Let's call repetition loops the "Spiral of Death"

This is a low hanging fruit and I've been surprised that it's not called that from the moment I've d…

When is Andrej Karpathy going to look at a chicken nugget and tweet that it helped him solve AGI, which in turn inspires 6 random devs to create GitHub projects giving us actual AGI?

Karpathy appreciation post. Seriously tho, he’s done this like a bunch of times lately. Every time h…

VS Code's new "Agents window" lets you use local AI models. Still requires an Internet connection and a Github Copilot plan (because we can't have nice things)

At first I was excited to see this, but I guess I'll wait till someone figures out what people actua…

inclusionAI/Ring-2.6-1T · Hugging Face

Introducing Ring-2.6-1T: a trillion-parameter flagship reasoning model designed for real-world compl…

A VERY lightweight open web-search tool for smaller local LLMs

Hey everyone, Been playing around with local agent setups lately, mostly Cline/Roo with smaller mode…

[MIT] RLCR: Teaching AI models to say "I'm not sure"

Confidence is persuasive. In AI systems, it is often misleading. Today's most capable reasoning mode…

Got local Qwen 3.5/3.6 generating meeting summaries entirely offline on an M4 Max. Demo with Wi-Fi off. This is the future.

I'm the founder behind Hedy, an AI meeting app. I'm a huge supporter of Local AI, and we've been wor…

NVFP4 Kimi2.6 and Kimi 2.5 released by Nvidia

The NVIDIA Kimi-K2.6-NVFP4 model is the quantized version of the Moonshot AI's Kimi-K2.6 model, whic…

Dropping learning rate fixed my Qlora fine-tune more than anything else i tried

Been fine-tuning llama 3.1 8b with Qlora for a classification task using about 8k samples. I was get…

Scenema Audio: Zero-shot expressive voice cloning and speech generation

We've been building Scenema Audio as part of our video production platform at scenema.ai, and we're …

My own local first ai harness

Hi, i just wanted to share what im playing with for last couple weaks. I built my own AI harness: Ti…

[Benchmark] 5090RTX: Promt Parsing, Token Generation and Power Level

Inspired by https://www.reddit.com/r/LocalLLaMA/comments/1tayu5t/stop_wasting_electricity/ I've deci…