AI tools, cybersecurity and development news aggregated from top sources — saved permanently with unique URLs.
Qwen3.6-27B vs 35B, I prefer 35B but more people here post about 27B...
I've had better results quality wise with 35B AND it's much faster than 27B. Just curious cause I se…
I made a visualizer for Hugging Face models
I built hfviewer.com, a small tool for visually exploring Hugging Face model architectures. You can …
Tinygrad Driver testing!
Boutta Thrash some MoE speeds on a blackwell + m3 Ultra RDMA cluster. Theres a bit less than 2tb of …
Qwen/SAE-Res-Qwen3.5-27B-W80K-L0_100 · Hugging Face
I can't believe my luck! one of my next research steps was going to be on vector based model steerin…
Ban phrases on llama.cpp with this script.
Check the README for setup instructions: https://github.com/BigStationW/llama-cpp-phrase-ban subm…
Implemented TurboQuant and results don’t fully match paper
I attempted to implement TurboQuant (arXiv:2504.19874) from scratch over the last few days. Thought …
I BUILT MY FIRST MODEL FROM SCRATCH
Sup, I'm Crownelius, I made that popular opus distill dataset. TODAY YOU ARE INTRODUCED TO SHARD a …
I built a transformer in C++17 from scratch — no PyTorch, no BLAS, no dependencies. Trains on CPU. 0.83M params, full analytical backprop, 76 min to val loss 1.64.
For the past few months I've been working on Quadtrix.cpp — a complete GPT-style language model impl…
Warpdrv - my open-source Llama.cpp launcher for daily-driving Qwen 35b + 27b on Strix Halo + RTX Pro.
I wanted to share an open-source app that I built for running LLMs locally on my setup. My setup Har…
Bruh
Do reporting bots even do anything? submitted by /u/Icy_Butterscotch6661 [link] [comments]…
Qwen 3.6 wins the benchmarks, but Gemma 4 wins reality. 7 things I learned testing 27B/31B Vision models locally (vLLM / FP8) side by side. Benchmaxing seems real.
Hey guys, A couple of weeks ago, I asked this sub for the hardest Vision use cases you were dealing …
Kv cache quantization: ignorance, or malice?
I run Qwen-3.6 27B with the FP8 safetensors on vllm for long-horizon agentic coding harness workload…