Qwen3.6 27B seems struggling at 90k on 128k ctx windows
I have RX 7900 XTX, running Qwen3.6 27B Q4_K_XL. got 400ish pp and 30s tps. every work below 64k is β¦
AI tools, cybersecurity and development news aggregated from top sources β saved permanently with unique URLs.
Qwen3.6 27B seems struggling at 90k on 128k ctx windows
I have RX 7900 XTX, running Qwen3.6 27B Q4_K_XL. got 400ish pp and 30s tps. every work below 64k is β¦
PSA: llama-swap released a new grouping feature, matrix, allowing you to fine tune which models can run together
Previously a model could only be present in a single group. Now you can create whatever groups you wβ¦
DeepSeek released 'Thinking-with-Visual-Primitives' framework
https://preview.redd.it/47r9qee44cyg1.png?width=1450&format=png&auto=webp&s=0d6f9687115be6ff96d0a194β¦
Actual comparison between locally ran Qwen-3.6-27B and proprietary models
Hey y'all! I've recently written a text in Russian about my experience comparing Qwen-3.6-27B with lβ¦
Granite 4.1: IBMβs 8B Model Is Competing With Models Four Times Its Size
https://research.ibm.com/blog/granite-4-1-ai-foundation-models submitted by /u/Successful_Bowβ¦
Qwen-27B as a Local Agent β It Actually Works Now
It's been a busy week testing and trying to get the 27B model set up correctly. TL;DR: The only setβ¦
I built a 5M model to see if it outperforms my 350M model...
Hi r/LocalLLaMA ! I built a 5M Llama model with HF Transformers on 2x T4 in Kaggle to see, if it is β¦
Can't replicate Reddit numbers with Qwen 27B on a 3090TI.
I feel like i'm going insane. I see people here posting 30 - 100+ tok/s (100+ being with speculativeβ¦
Notes on what actually breaks when you run a coding agent on small local models
I've spent the last few weeks running real multi-file coding tasks through small local models and smβ¦
Qwen-Scope: Official Sparse Autoencoders (SAEs) for Qwen 3.5 models
Qwen Team released Qwen-Scope β a collection of Sparse Autoencoders (SAEs) for the Qwen 3.5 family (β¦
How are you maintaining your AI apps post-launch? Model bugs vs engineering bugs, and what's your debugging stack?
I've been going down a rabbit hole tinkering about what actually happens after you ship an LLM-powerβ¦
Tenstorrent TT-QuietBox 2 Specifications (Blackhole)
Source: https://docs.tenstorrent.com/systems/quietbox/quietbox-bh-2/specifications.html Currently suβ¦