AI tools, cybersecurity and development news aggregated from top sources — saved permanently with unique URLs.
Stop pretending self-hosting is cheaper. It's not. We do it for different reasons and we should say so.
Did the math on my own rig last week and I'm tired of seeing this sub repeat the "local is cheaper" …
Strix Halo users, a rejected PR can give you up to 30% faster PP for MOEs.
Here's the PR by pedapudi. https://github.com/ggml-org/llama.cpp/pull/21344 It's merge request has b…
Self-hosted STT better than Whisper Large V3 Turbo that matches AssemblyAI quality?
I’m already using Whisper Large V3 Turbo self-hosted, but the accuracy still isn’t where I need it. …
I finally put my NPU (Intel Arrow Lake) to use doing ASR for my smart home
I wrote about what I found in a deep dive elsewhere (which I will no mention because Reddit doesn't …
Running on a macbook, and having issues with crashing? Maybe this will help...
Just a friendly pointer on getting around some issues on macbooks. I hope someone finds this useful.…
Qwen3.5 35B A3B uncensored heretic Native MTP Preserved is Out Now With the Full 785 MTPs Preserved and Retained, Available in Safetensors, GGUFs. NVFP4, NVFP4 GGUFs and GPTQ-Int4 Formats
Safetensors, llmfan46/Qwen3.5-35B-A3B-uncensored-heretic-v2-Native-MTP-Preserved: https://huggingfac…
CXMT started selling ram to corsair
They started producing cheaper ram for corsair, hopefully it will get cheaper for consumers https:/…
Is this LLM challenge even possible?
Ive been trying for hours now and I just can't get anything from this model othen then random words,…
model : add support for talkie-1930-13b by niklassheth · Pull Request #22596 · ggml-org/llama.cpp
https://huggingface.co/talkie-lm/talkie-1930-13b-it talkie-1930-13b-it talkie-1930-13b-it is a 13…
One letter to appease them all
submitted by /u/ivari [link] [comments]…
Is something went wrong with those online free model, why I feel they worse than Gemma 4 26B A4B Q4_KM ??
It started with I just want to make a chat app like roleplay with characters but Gemma 4 26B A4B Q4_…
Shard - getting to 10× KV cache compression
TL;DR. Shard is a drop-in HuggingFace Cache that makes Llama-3.1-8B's KV memory about 10× smaller at…