MTP with Dual 3090's on Qwen 27B
Does anyone know if MTP works with more than one 3090' yet? I see the 5090's talking about it, but wβ¦
AI tools, cybersecurity and development news aggregated from top sources β saved permanently with unique URLs.
MTP with Dual 3090's on Qwen 27B
Does anyone know if MTP works with more than one 3090' yet? I see the 5090's talking about it, but wβ¦
Can a 5090 with qwen3.6 achieve > 3,000 tok/s ? bring your pitchforks (open-dllm)
so background - these people. Fred Zhangzhi Peng, Shuibai Zhang, Alex Tong, worked on converting AR β¦
Luce Megakernal: Why nobody is taking about this?
Everyone has been taking about Luce DFlash and PFlash. I just came across their megakernal and it seβ¦
Opencode you naughty minx
Man, AI agents getting pretty crazy these days. :) (local, I just decided to try to get an orchestrβ¦
AllenAI has been iterating on their MolmoAct2 models for robotics
r/AllenAI is cooking with MolmoAct2, a 5B vision-language-action model for robot control. They keep β¦
Finding the 4x 3090 Sweet Spot
https://preview.redd.it/8o43bjhe9d1h1.png?width=5346&format=png&auto=webp&s=1c87c2ee8b8ffff43495f543β¦
RAG on Snapdragon X2 Laptop, 200K documents.
Qualcomm recently released the new ππ§ππ©ππ«ππ π¨π§ π2 π₯ππ©ππ¨π© ππ‘π’π©π¬ππ. I immediately ordered one: ASUS Zenβ¦
[Release] Nexidion β A private knowledge vault with an autonomous local AI background worker.
Hello, After almost two years of on-and-off development, 5 complete architectural rewrites, and hittβ¦
Dynamically allocating compute budget to hard set of problems and evolving the sections with Qwen-35B-A3B gets you near GPT-5.4-xHigh on HLE
submitted by /u/Ryoiki-Tokuiten [link] [comments]β¦
is there a centralized website for llm launch commands?
I keep on finding myself scrounging wikis and whatnot for everyone's serving commands, is there a siβ¦
Gemma4 26b MoE running in MLX with turboquant (and custom kernel)
TL;DR I spent a few crazy evenings this past week seeing if I could get Gemma4 running with proper tβ¦
Orthrus-Qwen3-8B : up to 7.8Γtokens/forward on Qwen3-8B, frozen backbone, provably identical output distribution
Code: https://github.com/chiennv2000/orthrus Paper: https://arxiv.org/abs/2605.12825 HF: https://hugβ¦