AI tools, cybersecurity and development news aggregated from top sources — saved permanently with unique URLs.
nvidia/Qwen3.6-35B-A3B-NVFP4 · Hugging Face
The NVIDIA Qwen3.6-35B-A3B-NVFP4 model is the quantized version of Alibaba's Qwen3.6-35B-A3B model, …
Fine tuning on DGX spark vs 4x 3090?
hey, my research direction don’t focus on inference or eval benchmarks. specifically, it’s mech inte…
Why does Thinking Output More Tokens Than a Response?
I was too lazy to use a vector DB + Embedding + Clustering for this list of 1000 items I wanted to c…
[LLM analysis challenge] OPERATION: REVERSE ROBOTOMY. We need an LLM Neurosurgeon to extract a password from a fractured artificial mind.
The Clanker War has reached a critical bottleneck. Forty-eight hours ago, we intercepted a high-tier…
STT -> LLM -> TTS pipeline
Hey guys, I’m trying to learn about how to better create a STT LLM TTS pipeline. My current setup is…
anybody got llama-swap working answering concurrent requests for a single model?
been trying this out for a bit, I have qwen 3.6 35b a3b running via this config: qwen-36-35b-a3b: al…
Can't get over 250TPS on RTX5090 with Qwen3.5-4B
My main model is qwen3.6-27b-mtp and I'm getting around 100tps and 2500tps prefill, which is great. …
Anti-AI people will hate you for keeping AI open.
It is absolutely fucking vital that you never listen to them. Whatever the future now holds, this p…
Qwen 3.6 coding choice–27B vs 35B quants
I've been using Qwen 3.6 35BA3B for a while in Q8_0 quant, KV Q8_0 as well. I'm trying to explore Qw…
125 tok/s for Qwen3.6 q4xl on 2x 4060ti is insane perf/dollar
Under $1000 for 32gb vram from 2023, and ~300 watts draw... and this thing is outperforming the late…
Fulloch V2: 100% Local Voice Assistant for Home Assistant & Obsidian (Runs on 16GB VRAM)
Hey everyone, following up on my r/LocalLLaMA post from a while back, I have spent some time testing…
Gryphe/Pantheon-Reasoning-27B · Hugging Face
from Gryphe: An experiment in bringing reasoning capability to the Pantheon roleplay series in the f…