r/LocalLLaMA

Remember around 2023-2024 when we did partys (wizardlm, nous capybara and dolphin) and finetunes?

Yes, I remember it. It was peak. Now those models get outpeformed by 2026-era models. I want to revi…

Any local coding success with MiMo-2.5 ?

I am experimenting with AesSedai--MiMo-V2.5-GGUF--IQ3_S and llamacpp for coding but it quickly gets …

Would you consider getting an NVIDIA RTX Spark laptop?

If yes, why? If no, also say why. I’d consider one if it’s faster at local AI inference than my curr…

Using Gemma 4 E4B with the LiteRT engine - ~2.4x speedup over Q4 GGUF in text generation, image processing roughly the same

I know there is a PR in llama.cpp to support MTP for the 26b and 31b versions of Gemma 4, but as far…

I trained a 75M parameter LLM from scratch on 18B tokens and it beats a model almost double its size

I trained a small language model from scratch called KeyLM. It is 75M params, decoder-only, and ther…

Why don't we still have any games with AI agents used as NPC characters?

Do you remember this NVIDIA AI-NPC presentation from 3 years ago? https://www.youtube.com/watch?v=5R…

I Put a Datacenter GPU in My Gaming PC for £200

Hey there! I wrote a blogpost about my experience running local models on a V100 from a newbie persp…

Putting Code Under a Microscope: Wavelet-Based Context for LLMs

submitted by /u/yogthos [link] [comments]…

A Simple Coding Benchmark: Step 3.7 vs Qwen 3.5 122B-A10B vs Qwen 3.6 27B vs Qwen 3.6 35B-A3B

submitted by /u/remeh [link] [comments]…

Benchmarks of 20 small LLMs on a 6GB RTX 4050

I'm looking for models that can run on my GPU and actually do something useful. I think that any sma…

Minimax M3 appears to have no political censorship

I'm currently working on a chinese/CCP AI bias benchmark, and this has stood out as an outlier. All …

StepFun 3.5 MTP by pwilkin · Pull Request #23274 · ggml-org/llama.cpp

so we have StepFun MTP, before Gemma MTP (https://github.com/ggml-org/llama.cpp/pull/23398) :) su…