AI tools, cybersecurity and development news aggregated from top sources — saved permanently with unique URLs.
vLLM PR adding native HIP W4A16 kernel was merged
The performance increase introduced by the PR is awesome. Makes my ROCm rig a lot more useful. Numbe…
A moment of thanks for DeepSeek
Even when I'm not using their models, they're sharing their R&D which benefits the whole ecosystem a…
Shoutout to Gemma4 as a conversational assistant / agent
I'm seriously impressed by Gemma4 26B A4B. On my M5 MacBook Pro (so still not that much memory bandw…
Qwen 3.6 27B overdoing it
Although I'm very impressed with Qwen3.6 and is my most used model, I feel that sometimes it being t…
llama: use f16 mask for FA to save VRAM by am17an · Pull Request #23764 · ggml-org/llama.cpp
now you can download more VRAM ;) (by downloading new llama.cpp version) submitted by /u/jacek…
How do I make MTP work in llama-server?
Downloaded IQ4_NL gguf from unsloth/Qwen3.6-35B-A3B-MTP-GGUF. git cloned a recent llama.cpp (version…
Claude Opus apparently distilled Qwen
https://x.com/junthekey/status/2060068858065559784/photo/1 https://preview.redd.it/xb3e4znhz04h1.png…
Use HTML as the primary chat language for your agents so they can draw diagrams
A week or two ago Thariq published an article on how good AI's were at working with HTML and that th…
New LFM2.5 8b A1b model!!
Performance is on par with Nemotron 3 Nano, at an even higher speed! I will be adding support to Sma…
What would you suggest the best model for fine tuning email classification under 2b size.
I am looking at Qwen 3.5 1.7b , any other recommendations!! submitted by /u/Wonderful-Ad-5952 …
Liquid AI releases LFM2.5-8B-A1B
Liquid AI released LFM2.5-8B-A1B, an edge model designed to power real-life applications. It builds…
Step 3.7 Flash Config + Early Data on 2x RTX 6000's
Setup Step 3.7 Flash on two Blackwell RTX Pro 6000's and got it running and recorded the configs and…