AI tools, cybersecurity and development news aggregated from top sources — saved permanently with unique URLs.
I built mlx-Chronos — a community benchmark leaderboard for local LLM engines on Apple Silicon (oMLX, Rapid-MLX, mlx-lm, Ollama)
Hey! I'm a CS student and I got tired of not being able to compare MLX inference engines properly — …
13 abliterated Gemma 4 E2B variants, 44 GPU hours, Benchmark and Comparison - Abliterlitics
I compared 13 abliterated variants of Gemma 4 E2B across weight analysis, KL divergence, HarmBench s…
Anyone using OpenClaw/Hermes with third-party skills?
Hi everyone, I’m posting on behalf of a friend who works with a university research team. She is loo…
DIY Local 2x DGX Spark cluster cooler with automatic temperature controlled fan.
I’ve found that DGX Sparks can get pretty warm when you cluster them together. You are forced to kee…
Diffusion in prod: how are you handling spiky GPU load and cold starts?
We keep running into the same wall scaling diffusion workloads: pipelines that are fine at 100 reque…
DeepSWE benchmarks indicate that DeepSeek v4 Pro only passes 8% of tasks
Is this accurate? I use DS v4 in OpenCode and find it nearly on par with Sonnet 4.6, so I'm surprise…
Stepfun 3.7 Flash is very good
If you can fit Stepfun 3.7 Flash into RAM, try it! It's feeling close to GLM 5.1 quality in terms of…
MiMo 2.5 Q6 vs DS 3.2 Q8 vs GLM 5.1 Q8
For 2 months or so I had been using GLM Q5, recently upgraded to Q8, which was an improvement. Use c…
Flash Attention for llama.cpp on RDNA3: 47% less KV VRAM than Vulkan f16 K, KLD almost losselss on F16 K / q4_0 V. Part 1.
The normal tradeoff in llama.cpp attention is: quantize your KV cache and lose quality, or keep fp16…
<Think> toggle button for llama.cp web chat for QWEN3.6
https://preview.redd.it/od6suf6j7g4h1.png?width=619&format=png&auto=webp&s=d31fb903ea68f58e3a641bfd2…
Built Bloc: a package manager for local AI models, agents, and tools
Hey everyone, I've been working on a small free and open-s project called Bloc [https://bloc-theta.v…
Is there a definitive way or cookie cutter way to benchmark variations of the same model for their KLD?
I'm looking to do some comparisons between different Qwopus3.6-27B-v2-NVFP4 models, namely A, B, and…