r/LocalLLaMA

Buy recommendations on a thight Budget to aid my RX 6800

So after a few hours of reserach, im torn between getting either a radeon vii or 2 p100 (both option…

Are older Titan cards still viable?

Looking at older Nvidia cards under £200 for Gemma/Qwen MOE coding. Is there any reason to avoid old…

Qwen Who? DiffusionGemma running at 1,500 tk/s on a Digital Pregnancy Test.

First Doom, now DiffusionGwmma 4. We are truly living in the future. Who even needs a new Qwen relea…

How do i prevent llama.cpp from offloading on Swap?

I have tried preventing this issue by using llama.cpp flags. However, I still have the issue: whenev…

How I implemented ASR bias for voice transcription models [Open Source]

I've been spending the last couple of weeks building a Wispr Flow clone as an open source project. F…

Anthropic Ain’t Rolling Back Anything

( I used AI to convey this message) Anthropic is being criticized for letting Claude silently give w…

NVFP4 with llama.cpp - FAQs?

Lets clarify all things related to NVFP4 in this thread. Sharing few questions & links here. Looks l…

Model recommendations for family photo classification / identification

I recently had a big family photo digitalization done for photos up to 130 years old. There are tons…

Refiner: Robotics library from the ex-Hugging Face pre-training team

ex-Huggingface pre-training team just announce a new library create for robotics data refinment! It …

Minimax M3 open weights release planned for Friday

submitted by /u/rmhubbert [link] [comments]…

Infinite Music Glitch on my Arduino with Magenta Realtime 2

I built a local voice AI realtime music setup where my ESP32 microcontroller talks to my MacBook ove…

"How NVIDIA Built Nemotron 3 Open Model" by "Caleb Writes Code" x "Joey Conway"

submitted by /u/Jeidoz [link] [comments]…