r/LocalLLaMA

How I implemented ASR bias for voice transcription models [Open Source]

I've been spending the last couple of weeks building a Wispr Flow clone as an open source project. F…

Anthropic Ain’t Rolling Back Anything

( I used AI to convey this message) Anthropic is being criticized for letting Claude silently give w…

NVFP4 with llama.cpp - FAQs?

Lets clarify all things related to NVFP4 in this thread. Sharing few questions & links here. Looks l…

Model recommendations for family photo classification / identification

I recently had a big family photo digitalization done for photos up to 130 years old. There are tons…

Refiner: Robotics library from the ex-Hugging Face pre-training team

ex-Huggingface pre-training team just announce a new library create for robotics data refinment! It …

Minimax M3 open weights release planned for Friday

submitted by /u/rmhubbert [link] [comments]…

Infinite Music Glitch on my Arduino with Magenta Realtime 2

I built a local voice AI realtime music setup where my ESP32 microcontroller talks to my MacBook ove…

"How NVIDIA Built Nemotron 3 Open Model" by "Caleb Writes Code" x "Joey Conway"

submitted by /u/Jeidoz [link] [comments]…

I thought Chinese censorship didn't affect me. I was wrong.

I was debugging some code and LLM crashed out: ``` The debug_log config defaults to "debug.json" and…

I'm not complaining

Well, this is something I can get behind. submitted by /u/Complete-Sea6655 [link] [comment…

AMD R9700 vs GB10

I have a budget of 5K, and want to buy some gpus my requirement is 48gb+ vram, because I finetune sm…

I am not a smart man, please help me figure out my weird poor man's multigpu frankensetup

I have the following old consumer GPUs in my house: 9070 XT 16gb 5700 XT 8gb GTX 1080 TI 12gb GTX…