AI tools, cybersecurity and development news aggregated from top sources — saved permanently with unique URLs.
I tried running a 1.56TB MoE model on a 6GB RTX 4050 Laptop, Here’s the result
The Test Bench Setup I tested running a massive 1.56TB Mixture-of-Experts (MoE) checkpoint (96 shard…
Nvidia is expected to raise GeForce RTX GPU prices again by up to 30%
submitted by /u/ab2377 [link] [comments]…
Zuck's opinion: The AI Future Is for Everyone
’Tis the season of AI open letters and manifestos, apparently. Mark Zuckerberg has now entered the d…
SK Hynix stock fell some 40% in the last 30 days, finally cheap RAM and GPUs again?
They actually halted trading on the Korean stock exchange today. Finally some hope? And do you think…
I got Kimi-k3 running.....
Results: prompt eval: 40 tokens / 97.5s → 0.41 tok/s eval: 400 tokens / 1769.9s → 0.23 tok/s total: …
Unsloth has begun dropping Kimi K3 GGUFs. The MXFP4 (it's 1.5 TB) and mmproj are already there.
submitted by /u/_TheWolfOfWalmart_ [link] [comments]…
Who is LoRA?
Why does she need so much VRAM? submitted by /u/InfusedBush [link] [comments]…
Now, this: 1,100 current/former frontier-AI employees sign a petition calling for US gov't to step in for "pacing" frontier development
So, it appears that this is the week of open letters in AI🥲... an open letter signed by current and …
Should we be calling Elon a liar?
Last year he said grok 3 would be open sourced in about 6 months. A year later and nada. https://x.c…
White-hat hacking IS the defense to black-hat hacking. The techniques are the same. How does Dario expect companies to do it if their models refuse?
You patch security holes by intentionally finding them. If the models refuse to do it, how can compa…
A 5B-active model doesn't know much, and I've stopped counting that as a flaw
Bit of a change of mind post. I skipped the low active param stuff for a while because every one I t…
Gemini Distillation Service
So looks like Google is now going to offer distilling as a service. submitted by /u/giveen […