Pushing the limit: minimax m2.7 q8_0 128k on 2x3090, 256GB DDR4
CPU is just a secondhand 10900x. Using 128k context, unquantized kv cache. Model is at q8_0 to mitigβ¦
AI tools, cybersecurity and development news aggregated from top sources β saved permanently with unique URLs.
Pushing the limit: minimax m2.7 q8_0 128k on 2x3090, 256GB DDR4
CPU is just a secondhand 10900x. Using 128k context, unquantized kv cache. Model is at q8_0 to mitigβ¦
"Generate a photorealistic realtime render of a human face with webGL" (Qwen3.5-122B-A10B UD-Q3_K_XL)
submitted by /u/_TheWolfOfWalmart_ [link] [comments]β¦
MTP experiences on 7900xtx?
Hi! I have been using Qwen3.6 35B A3B happily the past few weeks, and I wanted to try out Qwn3.6 27Bβ¦
Apple silicon costs more than OpenRouter: an analysis
I am not the author. My two cents: I'm not suggesting we don't all know local AI is expensive, at lβ¦
Grafting vision onto text models for fun and profit.
So as we know.. llama.cpp separates the vision or other multimedia from the main weights. Converselyβ¦
M5 vs DGX Spark vs Strix Halo vs RTX 6000
Hey guys, super simple. There have been a lot of online debates about the new M5 Macs vs DGX Sparks β¦
Any good MOE ~60B models? I have 64GB vram
I have a build with 2 x MI50 32GBs and 64 gigs of DDR4 (bought before rampocolypse for ~630 USD totaβ¦
Moving from Composer 2/Kimi 2.6 to Qwen3.6:35b-a3b
I can't believe it, but I'm able to do my daily software development work on this model. We have a 5β¦
I can't get Qwen3.6 27B to outperform Qwen-Coder-Next and I'm not sure why
In my real-world usage (opencode) and in my synthetic benchmarks, Coder-Next (Q5) demolishes the whoβ¦
I hope that someday we will have a 124B Gemma.
submitted by /u/cgs019283 [link] [comments]β¦
Are local models good enough yet for AI meeting memory?
Iβve been testing different ways to handle AI meeting notes and realized the most useful part isnβt β¦
ROCm 7.13 nightly adds strix halo optimizations
https://www.phoronix.com/news/ROCm-7.13-Released Quote: ...new optimizations for Ryzen AI Max 300 "Sβ¦