AI tools, cybersecurity and development news aggregated from top sources — saved permanently with unique URLs.
2 old RTX 2080 Ti with 22GB vram each Qwen3.6 27B at 38 token/s with f16 kv cache
PLEASE KEEP IN MIND BOTH OF MY CARDS ARE POWER LIMITED TO 150W (i hate noise) ------- Just wanted t…
ByteDance-Seed/Cola-DLM · Hugging Face
Cola DLM (Continuous Latent Diffusion Language Model) is a hierarchical continuous latent-space diff…
internlm/Intern-S2-Preview · Hugging Face
Introduction We introduce Intern-S2-Preview, an efficient 35B scientific multimodal foundation model…
I have (even faster) DeepSeek V4 Pro at home
Few days ago I posted about my DeepSeek V4 Pro at home - now time for an update. Yesterday I finally…
Used over a million tokens in three separate sessions to test Qwen 3.6 35b (new Multi-token Prediction version)
In my opinion, MTP models are 100% game changer for local LLMs. In terms of speed, I was getting aro…
China modded GPU (eg. 4090 48gb) --> I'm gonna figure it out. IS THERE NO ONE ELSE CURIOUS??
There's a dearth of information (in the english world) about these cards. The good recent video is p…
MiniMax M2.7 ultra uncensored heretic is Out Now with 4/100 Refusals, Available in Safetensors and GGUFs Formats!
llmfan46/MiniMax-M2.7-BF16-ultra-uncensored-heretic: https://huggingface.co/llmfan46/MiniMax-M2.7-BF…
Need a second pair of eyes, this Qwen3.6 27B quant recipe consistently thinks less and is correct
Ok, hear me out. This all started when I was trying to understand why this Qwen3.6 27B INT8 Autoroun…
RDNA3 Flash Attention fix just dropped by llama.cpp b9158
https://github.com/ggml-org/llama.cpp/releases submitted by /u/Bulky-Priority6824 [link] […
I trained Qwen3.5 to jailbreak itself with RL, then used the failures to improve its defenses
RL attackers are becoming a common pattern for automated red teaming: train a model against a live t…
Llama-Studio, WebUI for llama-server Management
Hey all, I have built myself a WebUI for configuring and managing llama-server sessions, and want t…
I Let a Small Model Train on Its Own Mistakes. It Reached 80% on HumanEval and Beat GPT-3.5 on Math
A few months ago, I got stuck on one line in the DeepSeek-R1 paper. It said models could improve thr…