AI tools, cybersecurity and development news aggregated from top sources — saved permanently with unique URLs.
Playing One Night Werewolf (Gemma4 & Qwen3.6)
Finally feel like it’s possible. I have a custom build (vibe coded) UI on llama.cpp, allows model sw…
Simpler self hosted alt to Open WebUI
Got Qwen3.6 27B running on my newly assembled 4x 3090 rig (s/o 3090-club) and I'm trying to get the …
I taught my 1B to follow instructions. It got worse at following instructions...
Same SFT recipe (SlimOrca 50K, LoRA r=16, 1 epoch). Three models trained from scratch at 1B, 2B, and…
running Qwen 3.6 35b A3B on 2x 5060TI
i ran Qwen 3.6 35b A3B two 5060TI 16gb ( 32 gb vram also i have 32gb dram but i don't like offloadin…
we really all are going to make it, aren't we? 2x3090 setup.
i'm blown away. i saw someone made a post the other day about "club-3090" and after having sonnet pa…
New Linux user, need help compiling llamacpp
Hi I’m a new Linux user transitioning from Windows, and I have some questions about compiling llama…
24+ tok/s from ~30B MoE models on an old GTX 1080 (8 GB VRAM, 128k context)
I got Qwen 3.6 35B-A3B and Gemma 4 26B-A4B running on a $200 secondhand machine (i7-6700 / GTX 1080 …
Web-Search is coming to a screeching performance halt as Google shuts down their free search index, and traffic defenders like Cloudflare challenge AI at every gateway. What are our options?
Google is closing its free tier to just 50 domains for site-specific search, and an inheritance date…
Side Projects.
Little something I put together to play with for larger contexts than my 9070xt. 8700k, dual P100…
MI50s Qwen 3.6 27B @52.8 tps TG @1569 tps PP (no MTP, no Quant)
TL;DR Results from the title are for single inference with 2 prompt of 1k and 15k tokens. So no MTP …
I made a UI and server for using Anthropic's new Natural Language Autoencoders locally with llama.cpp
Anthropic's first open weight models, Natural Language Autoencoders, are just finetunes of popular o…
Efficient pretraining with token superposition by Nous Research
submitted by /u/de4dee [link] [comments]…