Ai Rig finally done and stable, perfect winter heater
8x3090 my ocd wouldn't let me have different gpu models so ended up with 8 gigabyte gaming OC. I bouβ¦
AI tools, cybersecurity and development news aggregated from top sources β saved permanently with unique URLs.
Ai Rig finally done and stable, perfect winter heater
8x3090 my ocd wouldn't let me have different gpu models so ended up with 8 gigabyte gaming OC. I bouβ¦
Update: tandem.cpp β DeepSeek-V4.1 on a 64 GB PC with a 16 GB card, and AMD (ROCm) support
Quick update on tandem.cpp, my patch set for llama.cpp that runs MoE models too big for your VRAM faβ¦
nex-agi/Nex-N2.6 Β· Hugging Face
Nex-N2.6 is a multimodal agentic model from Nex-AGI, built on GLM-5.3-Flash. It is designed for compβ¦
tiny-voca: a fully open 4.5M-parameter TTS (code, weights, dataset). Runs 70x real time on a CPU
I made a small English text-to-speech model called tiny-voca. It has 4.5M parameters, two voices, anβ¦
After medusa halo we get siren halo
Will have dedicated GDDR7 VRAM (Graphics Double Data Rate 7 Video RAM). Interesting that AMD is follβ¦
Why donβt we have national open AI models?
Deepseek spent about $6m on 4.1 apparently. Published all of their work. US gov says donβt trust Chiβ¦
Qwen4 Flash wishlist
After using 3.8QFN for some time I have to the conclusion that my wish list for QF4 now only consistβ¦
I know itβs very expensive but is anyone using a dgx station b300 ? Is it that good for local llms ?
Iβd like to know what real users get out of them, speed wise and also concurrent users. Iβm talking β¦
The lawyer who posts here about his V100s got his story picked up by Tomβs Hardware
submitted by /u/General-Spite1222 [link] [comments]β¦
ARC 1.0: A decision model for routing AI agents across cloud and local models (0.6B, Apache 2.0)
ARCβthe Adaptive Routing Controllerβreads an agentβs conversation and produces signals for choosing β¦
How long are we gonna depend bunch of model creators (like Qwen, Gemma, NVIDIA, etc.,) for ~100B models?
I think we're fine till 2027 with models(~100B .... Qwen 4.X & 5, Gemma-5, NVIDIA would release someβ¦
IBM trains two small open models to ignore orders hidden in documents
I like this. Prompt injection is a bit issue with small models submitted by /u/mawcopolow [β¦