AI tools, cybersecurity and development news aggregated from top sources — saved permanently with unique URLs.
Extracting MoE experts from Kimi K3
Has anyone yet tried to extract experts from kimi (or GLM 5.2) per chance? There is REAP that remove…
3090 owners, what vram tempature do you get under ai load?
Hello Can you please share the tempature you get on your rtx 3090 under active llm load? Im trying t…
Quantizing Kimi K3 (2.8T A50B) to GGUF ourselves - Q3_K_S works, 1.1 TB on disk
we're experimenting with our own dynamic GGUF quants of kimi k3, made from the original weights with…
Are you guys not scared of where we're heading? A year ago, GPT-5 was considered one of the best models in the world. Today, we have open-weight models like Qwen3.6-27B that are competitive enough to run locally on high-end consumer hardware. The pace of progress is absolutely brutal.
I think the claims about having Mythos level-model in our laptops in 1-2 years might not be so crazy…
The open-weights carousel never stops.
submitted by /u/InternationalGap3698 [link] [comments]…
Kimi K3 for local use (1.56TB → 594GB) compressed and released by Unsloth
The model was quantized to 8, 4, 2, and 1 bit. Characteristics: Q8: 8-bit 1.56 TB, lossless Q4: 4-b…
I pre-trained a 700m on 18B tokens optimized for Python and Wikitext | TheOneWhoWill/Shibai-700M-Base · Hugging Face
I know this is the 1000000th new sub billion parameter model out there and probably isn't as good as…
PSA: llama.cpp now loads MTP tensors by default for any draft-mtp arch, even with MTP disabled
If your GGUF has MTP/NextN tensors baked in (GLM-5.2, hy_v3, qwen35moe, step35, etc.), recent llama.…
Ilintar's Official Guide To Model Selection
Inspired by multiple discussions here and on some Discords I frequent, I've decided to share with yo…
Everyone posts day-one impressions. What's still in your stack a month later?
Day one threads are the least useful thing we produce here and we produce a lot of them. Model drops…
Has anyone tried Qwen3.7 flash on openrouter? How does it compare to our Qwen 3.6 27B?
This might be the next open weight release by qwen team. What you feel like is improved or have beco…
First Kimi K3 results on home lab ~ 4t/s
I've got better results than expected for 768gb DDR5 and 2x5090. Using fork https://github.com/pwil…