2-bit copy in VRAM + exact residual in system RAM as the verifier: speculative decoding for models that don't fit your GPU
Hi Guys!, Recently I was making a research and development, but I do not have time to go further witβ¦
AI tools, cybersecurity and development news aggregated from top sources β saved permanently with unique URLs.
2-bit copy in VRAM + exact residual in system RAM as the verifier: speculative decoding for models that don't fit your GPU
Hi Guys!, Recently I was making a research and development, but I do not have time to go further witβ¦
Kitten-TTS 2: New Open-source SOTA 1.58 bit TTS (CPU-only with voice cloning, multilingual, emotion control)
KittenML has just released code and weights of Kitten-TTS 2, which is a super-efficient frontier TTSβ¦
Recursive Flint - the "Qwen3.8 35B" we've all been waiting for?
This model looks really impressive. TL;DR -- Coding agent model. 40B params with 2.5B active. Resounβ¦
Inference time abliteration
AbliteratedOutTheBox is a llama.cpp fork that abliterates any model you load, live at inference, witβ¦
Amazing free 3090 speedup hack, verified works 15% PP, 5% TG for free
I saw this today on X and decided to try it, I havent seen it posted here yet. I ran it on a single β¦
Tried running 748B DeepSeek-V4.1-Flash on a β¬2k PC
I bought a used PC with an RTX 3090 24 GB, 128 GB DDR4 and an Intel i9-9900X last year for under β¬2,β¦
When will we see these changes? --> China Is Doubling RAM Production to Keep Everyday Gadget Prices from Skyrocketing
submitted by /u/chemist_slime [link] [comments]β¦
Now that 3090 frenzy warning post makes sense.
I don't have a 3090 to confirm, but curious if the anyone in this community can back this up. Good wβ¦
IBM Granite Speech 5.0 2B
submitted by /u/seamonn [link] [comments]β¦
OK, fine, Qwen 3.8 Flash Next is nice
I held off as long as I could, but finally gave in and set up strata. I am pretty blown away. 3.8 27β¦
RecursiveSI/flint (40B A2.5B) Β· Hugging Face
submitted by /u/coder543 [link] [comments]β¦
Be prepared, GPU price increase incoming --> Samsung sells out 100% of all 2027 HBM capacity - HBM prices expected to jump 200% next year, DRAM prices expected to see a double-digit price increase
submitted by /u/chemist_slime [link] [comments]β¦