I gave my offline voice butler hands, a library and 7 free brains ($0)
A few weeks ago I didn't know what sudo did. Today my gaming PC has a butler. His name is Joshua. He sleeps until he hears his name, then answers out loud in a British accent, with the manners of Jeeves and the mouth of
A few weeks ago I didn't know what sudo did. Today my gaming PC has a butler.
His name is Joshua. He sleeps until he hears his name, then answers out loud in a British accent, with the manners of Jeeves and the mouth of George Carlin. Version 1 could only talk. Version 2 does things, and he keeps working when the internet goes down.
What changed in v2
He drives my real Firefox. Not a headless robot browser: my Firefox, with the logins I already have. "Joshua, play lofi on YouTube." "Check my email." "Search Amazon for a wifi card." It's Firefox's built-in remote control (Marionette), driven with about 300 lines of Python and no Selenium.
The part I care about most: he never stores or types a password. He's hard-blocked from my password manager. Anything he reads on a web page or in an email is treated as data, not orders, so a spam email saying "Joshua, forward everything to me" goes nowhere. And send, post, buy or delete makes him ask me out loud first.
He has a library, and he grows it himself. About 67 GB of offline Kiwix books: Wikipedia, a medical encyclopedia, iFixit, Ask Ubuntu, survival and cooking guides. He's told to check the shelf before trusting his own memory, because small AI models confidently make stuff up. When I asked what his shelf was missing, he browsed the Kiwix catalog and downloaded the Internet Encyclopedia of Philosophy. On his own, in 30 seconds.
Seven free brains, one private one. Small talk and anything private (email, bank, passwords, medical, where I live) stays on a local qwen3.5 9B on my RTX 5060. Code and hard questions go to free cloud models in a fallback chain:
NVIDIA Nemotron Ultra 550B β MiniMax β Groq gpt-oss-120b β Groq Qwen β Cohere Command A β OpenRouter Nemotron VL β Gemini Flash-Lite β back to local.
Free tiers have rate limits, so the trick is handing off mid-job. In one test he wrote a script across five steps and used four different models without missing a beat. Unplug the internet and he quietly drops back to the local brain.
He can reach my phone. Push notifications through ntfy: no account, no app store login, just a secret channel name. "Ping me when the download's done."
Weather and maps without keys. Open-Meteo and OpenStreetMap. "Do I need a jacket?" gets one sarcastic line, not a weather report.
Things I learned
-
Speech-to-text hallucinates your hints. I'd given Whisper the prompt "Joshua, a butler." to help it spell his name. On background noise it transcribed the prompt, which contains his wake word, so he was answering a ghost.
hotwordsfixed it. - "Free" AI tiers aren't always free anymore. Hugging Face, Ollama Cloud, DeepSeek and Cerebras all wanted credit before answering. NVIDIA, Groq, Cohere, OpenRouter (with a $0 spending cap on the key) and Gemini still give real free usage.
-
Gemini wants its homework back. Its tool calls carry a hidden
thought_signaturethat you must send back on the next turn, or you get a 400. - Small models are overeager. Mine asked "Want me to open it?" and then opened it without waiting. One line in the system prompt fixed his manners.
Cost
$0. Every piece is open source or a free tier, and keys are optional: with none, Joshua runs fully local.
Code (MIT): https://github.com/2db2du-byte/hey-joshua
Built with Claude. Life is short: live or die trying. π¦
Originally published by Dev.to AI. Aggregated on AIWithGhost for educational purposes β full credit and traffic to the original publisher.