Built a Voice Agents from Scratch GitHub tutorial: mic > Whisper > local LLM (GGUF) > Kokoro > speaker, fully local, no API keys
Been building this for a while and finally cleaned it up enough to share. voice-agents-from-scratch β¦
AI tools, cybersecurity and development news aggregated from top sources β saved permanently with unique URLs.
Built a Voice Agents from Scratch GitHub tutorial: mic > Whisper > local LLM (GGUF) > Kokoro > speaker, fully local, no API keys
Been building this for a while and finally cleaned it up enough to share. voice-agents-from-scratch β¦
Model suggestions for business backend?
I have 96GB in a minisforum x1 pro 370, and I want to set it up as my business computer running openβ¦
Local LLM Benchmark about Backend Generation by Function Calling (GLM vs Qwen vs DeepSeek)
Detailed Article: https://autobe.dev/articles/local-llm-benchmark-about-backend-generation.html Fivβ¦
Open Weights Models Hall of Fame
I read a lot of "whengguf" type posts. I think we should sometimes stop and be grateful. I want to sβ¦
Opencode reading file again and again and fill context.
So I am using 3.6 35B A3B, pretty good for my work, but the first 64k tokens feels bigger like not aβ¦
RTX A5000 Pro Balckwell 48GB
What do people think about this card for an enthusiast? With 48GB. You can fit qwen 27B q8 with contβ¦
3xR9700 for semi-autonomous research and development - looking for setup/config ideas.
Hello everyone. Over the last couple months I have been assembling my local AI setup for personal usβ¦
Persistent memory system for LLMs that actually learns mid-conversation
Every LLM conversation starts from zero. RAG helps, but it can't learn from what's happening right nβ¦
[Paper on Hummingbird+: low-cost FPGAs for LLM inference] Qwen3-30B-A3B Q4 at 18 t/s token-gen, 24GB, expected $150 mass production cost
submitted by /u/ayake_ayake [link] [comments]β¦
Which model should I try?
In my current workflow (coding in python/c++ and technical reports) I mostly use Qwen3.6 27B and Gemβ¦
The Ultimate LLM Fine-Tuning Guide
I was looking for a "spot-on" fine-tuning guide since quite a while, but couldn't find one. So i thoβ¦
Upskill: skill registry your agent consults before it starts. 10k+ indexed, free, open source.
You give Cursor a real task and watch it workβ¦ from memory. Ask for a landing page β generic off-brβ¦