AI tools, cybersecurity and development news aggregated from top sources β saved permanently with unique URLs.
Qwen3.6-27B IQ4_XS FULL VRAM with 110k context
Qwen3.6-27B IQ4_XS Bloat: Reverting llama.cpp commit saves 16GB VRAM (14.7GB vs 15.1GB) + KVCache Teβ¦
meantime on r/vibecoding
words of wisdom submitted by /u/jacek2023 [link] [comments]β¦
Qwen 3.6 27B BF16 vs Q4_K_M vs Q8_0 GGUF evaluation
Evaluated Qwen 3.6 27B across BF16, Q4_K_M, and Q8_0 GGUF quant variants with llama-cpp-python usingβ¦
Has anyone made a decent Zorklike text game that runs on local LLM? Like a full release
Thinking something between zork and a text version of the machine-learning video game in enders gameβ¦
Deepseek Vision Coming
From Xiaokang Chen on π: https://x.com/PKUCXK/status/2049066514284962040 submitted by /u/Nunkiβ¦
An attempt to unify all compute devices at one's disposal and run local models - smolcluster
Iβm currently building smolcluster, a project focused on demystifying how distributed learning actuaβ¦
AMD Radeon RX 6900 XT - ROCm vs Vulkan - Gemma 4 and Qwen 3.5 speed benchmarks
Did some quick tests after building llama.cpp with ROCm 6.4.2 and latest Vulkan for my 6900 XT gemmaβ¦
Do the "*Claude-4.6-Opus-Reasoning-Distilled" really bring something new to the original models?
No offense to the fine-tune model providers, just curious. IMO the original models were already traiβ¦
Load balancer for vLLM server instances?
Hello all, the docs for the vLLM production stack suggested autoscaling the vllm worker instances baβ¦
First direct side by side MoE vs Dense comparison.
https://arxiv.org/pdf/2507.17702 submitted by /u/Different_Fix_2217 [link] [comments]β¦
[7900XT] Qwen3.6 27B for OpenCode
I'm just looking for some advice on optimally setting up Qwen3.6 27B for OpenCode. The VRAM is a litβ¦
I got 3Γ faster HFQ4 prefill on Strix Halo in hipfire with an opt-in MMQ path
I recently contributed an experimental HFQ4-G256 MMQ prefill path to hipfire, an RDNA-focused LLM inβ¦