AI tools, cybersecurity and development news aggregated from top sources — saved permanently with unique URLs.
Kokoro - Local installation. Multilingual.
Hello, I hope everyone is doing well. I'd like to consult with someone who has experience using Koko…
QATs Q4_0 from Google have more precision than Q4_K_XL from Unsloth (at least some)
I wanted to try new QATs and opened two collections on HF (which HF found for me): https://huggingfa…
Gemma4_31b_fp8 keeping up with Sonnet_4.6_medium in my harness.
https://preview.redd.it/9t0qvx6k5z5h1.png?width=1400&format=png&auto=webp&s=88dd83cdd6aa484dcf102bf0…
Best Local TTS solution
So I have been testing a bunch of different solutions for local TTS - nothing so far comes close to …
Galaxy Z Fold6 as a local inference node — llama.cpp/Vulkan, homelab telemetry, SHA-256 model verification
Built a small Android app called Pocket Node that runs llama.cpp inference on-device. Here's what it…
how to run gemma-4-12b-it-qat-w4a16-ct in vllm or any version quantized of the model
when running by using transformers it runs by using vllm some weird error come up plese can any body…
What's your experience with Gemma4 QAT?
Hey everyone! Not a native speaker, so please correct my english where I make mistakes, (can only le…
Is Gemma 4 12b good for coding?
How are you using it? Quantized? At what quantization level? On what hardware? Thank you for the inf…
Fully Unserious Post - Fully Hallucinated Operating System
Watched this with a mixture of disbelief and "this is brilliant/ludicrous" - if you're into offbeat …
Hear Me Out, Pi Fans Lurking Here
Not For Thee Maybe After watching several interviews with Pi's creator, Mario Zechner, I've come to …
club-3090 adds experimental FP8 support for Qwen3.6-27B!
It’s finally here! Something many of us running dual RTX 3090 rigs have been anticipating. club-3090…
Preferred two LLM combo
I’m using my MacBook Pro M1 Pro with 32GB to run Qwen3.5-35B in Q4 as my coding agent. I have a gam…