AI tools, cybersecurity and development news aggregated from top sources — saved permanently with unique URLs.
Llama.cpp VS LiteRT on a custom Xiaomi 12 Pro 24/7 Server (V2 Redesign)
https://preview.redd.it/sm4ysgdw1w2h1.png?width=1376&format=png&auto=webp&s=3705932403919814fbf2008a…
Local, low code, node based agentic development workspace... that actually works?
Does it exist? I've been trying a few options and so far they've all been either horribly broken, ou…
Is there a proxy network server for qwen27b to try fix leaking <tool_call> from content/reasoning_content?
Sometimes toolcall appears in the end of content, sometimes in the end of reasoning_content. On rece…
Optimizing speed & quality on Qwen3.6 27b
Does the inference speed below seem optimal for the hardware, or could there be further room for imp…
Have we passed the peak of inflated expectations?
I noticed the number of people in this sub going down a bit and checked out some google trends. Any …
LLaMa.cpp basic question
I'm trying to install LLaMa with PI agent. I ran curl -fsSL https://pi.dev/install.sh | sh export PA…
Gemma4 26b a4b Apex quant is quite good
I tried mudler's apex quant for gemma4 26b a4b and it was amazing! I got 38tps at 90.000 context wit…
Experimental "Preserve Thinking" Jinja Template for Gemma4 31B in llama.cpp
https://huggingface.co/stevelikesrhino/gemma-4-31B-it-nvfp4-GGUF/blob/main/gemma4-improved.jinja Yal…
meituan-longcat/LongCat-Video-Avatar-1.5 · Hugging Face
🚀 Model Introduction We are excited to announce the release of LongCat-Video-Avatar 1.5, an upgraded…
club-rdna16: practical 16GB AMD/Radeon local LLM testing repo
Following on from club-5060ti, I’ve been doing some testing with my desktop AMD GPU and wanted to ma…
397B competitor that fits in 256 RAM?
Does one exist? I noticed 3.6 QWEN did not release locally in 397B-17B. Anything that can compete lo…
G4-MeroMero-26B-A4B-it-uncensored-heretic Is Out Now, a Finetune of gemma-4-26B-A4B-it, With KLD of 0.0152 and 12/100 Refusals!
When I previously posted the uncensored version of the 31B version of the MeroMero finetune, quite a…