16x Spark Cluster (Build Update)
Build is done. 16 DGX Sparks on the fabric, all hitting line rate. Setup was time consuming but honeβ¦
AI tools, cybersecurity and development news aggregated from top sources β saved permanently with unique URLs.
16x Spark Cluster (Build Update)
Build is done. 16 DGX Sparks on the fabric, all hitting line rate. Setup was time consuming but honeβ¦
Update on 2019 Mac Pro
This post is for the haters it has best every one of my expectations so far. An amazing machine. Wilβ¦
Finetuning Dataset: Claude Opus 4.6/4.7 - 8.7k Chats
https://huggingface.co/datasets/angrygiraffe/claude-opus-4.6-4.7-reasoning-8.7k A synthetic fine-tunβ¦
Running llama.cpp on Snapdragon Hexagon NPU seems promising
https://github.com/ggml-org/llama.cpp/blob/master/docs/backend/snapdragon/README.md I have an Onepluβ¦
nvidia/Gemma-4-26B-A4B-NVFP4
Can confirm it works on a 5090, with 80% allocation (of 32gb) I got around 50k context. It's 18.8GB β¦
Qwen 3.6 27B vs Gemma 4 31B - making Packman game!
Gemma just crushed Qwen in a local LLM gamedev contest! Device: MacBook Pro M5 Max, 64GB RAM Qwen 3.β¦
Cuda + ROCm simultaneously with -DGGML_BACKEND_DL=ON !
I invested quite a bit of time and it wasn't easy but finally I can run models like Minimax 2.7 Q4 uβ¦
Final Monster: 32x AMD MI50 32GB at 9.7 t/s (TG) & 264 t/s (PP) with Kimi K2.6
32 MI50 32GB setup moonshotai/Kimi-K2.6 int4 @ 9.7 tok/s (output of 136 tok) and 263 tok/s (input ofβ¦
Sulphur 2 uncensored video gen
I'll try to keep this as short as possible, but me and a team of people have been working to create β¦
AMD Halo Box (Ryzen 395 128GB) photos
This demo unit was running Ubuntu and the light strip is apparently programmable. submitted by β¦
Got hipfire running in Docker on my RX 7900 XTX alongside llamacpp
Been dealing with long context failures on Qwen3.6 27B and stumbled onto hipfire. Spent an evening dβ¦
Mistral medium 3.5 128B, MLX 4bit, ~70 GB
This model seems utterly broken for now. I do not recommend downloading or using it, unless you are β¦