DeepSeek V4 Flash, up to 32 tok/s on AMD Ryzen AI MAX+ 395
Hey fellow llamas. we have something new for Strix Halo owners we thought would be useful to share. β¦
AI tools, cybersecurity and development news aggregated from top sources β saved permanently with unique URLs.
DeepSeek V4 Flash, up to 32 tok/s on AMD Ryzen AI MAX+ 395
Hey fellow llamas. we have something new for Strix Halo owners we thought would be useful to share. β¦
Sorry, but did Dario just say that closed-weights, in-secret models are worse than open-weights ones?
submitted by /u/BritishDudeGuy [link] [comments]β¦
I built an Android app for Qwen3 TTS on-device
It's more of a showcase demo at the moment, but Qwen3TTS 0.6B runs usable fast in Q4. On my Galaxy Sβ¦
I built a tiny proxy that gives GLM 5.2 vision (or any text LLM) β MIT
VisionBridge lets you give text-only LLMs vision. It's tiny OpenAI-compatible proxy that lets reasoβ¦
GLM-5.2 on 8xB200: the deployment math nobody spells out - NVFP4 + 2x TP=4 replicas should beat TP=8 by ~2x. Full config guidance inside.
We have 8xB200 nodes and users keep asking us how to serve GLM-5.2 on them. Our engineering team wenβ¦
Anthropic Research - "Verbalizable Representations Form a Global Workspace in Language Models"
submitted by /u/cuolong [link] [comments]β¦
local already feels good enough
This is specifically for coding, technical planning, and hardware setup. _____ The only times Qwen β¦
Gepard : 0.6B streaming TTS built for real-time dialogue - 20Γ realtime factor, ~50ms time-to-first-audio, vLLM-native, Apache 2.0
We just open-sourced Gepard 1.0, a TTS model built for real-time conversation. Itβs streaming-first:β¦
I tested freshly merged DFlash in llama.cpp on Qwen 3.6 27B Local AI win. 4.44x faster at 36K context. Here are my findings RTX 6000 PRO.
Hey guys, A month ago I posted my MTP benchmarks here (3.34x on Gemma 4). DFlash support just mergedβ¦
Qwen3.6-27B - Effect of KV quantization on KLD - Q8, Q6, Q5 (bartowski)
Lower is better - Quantization increases from right to left I recently made a post here about how I β¦
mistral.rs v0.9.0: up to 1.8x faster CPU decode than llama.cpp on x86 and ARM!
https://preview.redd.it/nuk5rxceptbh1.png?width=1448&format=png&auto=webp&s=300344dd4c6552379e8536b8β¦
I tested Anthropicβs new Jacobian Lens on open models, then it turned into a local-model hallucination router
Anthropic dropped their Global Workspace / Jacobian Lens paper yesterday, and I thought it was too cβ¦