AI tools, cybersecurity and development news aggregated from top sources — saved permanently with unique URLs.
cyankiwi AWQ 4-bit — 26.05 update, NVFP4 + FP8 Dynamic quantization and benchmarks across Qwen3.6 4-bit quants
We are happy to share cyankiwi AWQ update: better AWQ implementation, now with NVFP4 and FP8 Dynamic…
You guys were right - Qwen 3.6 35B IS good...and KV Cache DOES matter.
WARNING: I'm speed typing this, no time to organizea/format, so if short paragraph chunks bother you…
Qwen3.6 27B collapse in performance for agentic coding
Hi everyone, I've been trying to optimize my setup to use OpenCode with Qwen 3.6 27B (Unsloth quant …
Dynamic KV Cache Quantization and Load-on-demand mmproj/MTP: my llama.cpp wishlist
We all know the struggle of optimizing your VRAM usage: quantized model, quantized kvcache, mmproj o…
Run (your largest) local models from your iPhone
submitted by /u/BustyMeow [link] [comments]…
Qwen 3.6 27B 30GB Same top p: 98.358 ± 0.033 % vs UD Q8 K XL 33GB Same top p: 97.426 ± 0.041 %
This is not a diss to Unsloth, they make great quants and really move this community forward. I've b…
Nemotron 3 Ultra. 550 billion parameters, 55B active. 1 million context
submitted by /u/AnticitizenPrime [link] [comments]…
I can fit 28% more context after building llama.cpp with OpenBLAS. Huh?
I've noticed a weird difference when building llama.cpp with the Vulkan and OpenBLAS backends vs. bu…
I accidentally crippled my 4x RTX 3090 LLM rig with a hidden PCIe 2.0 x4 slot and fixing it doubled Mistral 128B performance
I’m posting this as a warning for anyone building multi-GPU local LLM rigs with older workstation/HE…
NVIDIA Nemotron 3 Ultra is out.
Not sure how much this is in the "local" world but interesting what they are putting out. https://d…
The DeepSWE benchmark was runned rather incompetently and the results are completely invalid
submitted by /u/Charuru [link] [comments]…
Unsloth on Apple Silicon- Pre-announcement announcement
submitted by /u/openSourcerer9000 [link] [comments]…