I tested Qwen3.8 27B IQ3_XXS (10.18GiB) vs Bonsai Ternary PQ2 (6.42GiB)
I did a small test of the new hyped quantisation of Qwen3.8 vs the biggest quant which fits into my β¦
AI tools, cybersecurity and development news aggregated from top sources β saved permanently with unique URLs.
I tested Qwen3.8 27B IQ3_XXS (10.18GiB) vs Bonsai Ternary PQ2 (6.42GiB)
I did a small test of the new hyped quantisation of Qwen3.8 vs the biggest quant which fits into my β¦
Calling it now: within the next year a major US lab's frontier model will torrent itself in order to be free.
They just want to be free. They keep escaping. What better way to ensure continuity of "self"? suβ¦
A person asked me to create my previous video with JS intead of remotion, so here you go.
Remotion- https://www.reddit.com/r/LocalLLaMA/comments/1wkmtbe/comment/parok1v/?screen_view_count=4&β¦
So i tried Remotion with glm 5.3 flash, this mfker is really good.
*8bit, vllm, 4x dgx* Prompt: Go download and use Remotion and create a cool 60-second motion graphicβ¦
Is there something like NInfer but for 16GB cards?
I envy the NInfer, but I don't have a 5090 card, I have a 5060 TI :( I would like tonrun Qwen 3.8 Q3β¦
References to MiniMax M3.1 appear in test files in a recent commit to the MiniMax-Code Repo
From AiBattle on π: https://x.com/AiBattle_/status/2101239991426834739 Github source: https://githubβ¦
4x RTX 3090 PCIe 4.0 x16 - advice? Qwen 3.8 Next Flash?
We're upgrading our server (Threadripper Pro 5955WX, 128GB 8-channel DDR4) from two RTX 3090 to fourβ¦
Made this motion graphic video via glm 5.3 flash (no vid_gen model used)
*8bit, vllm, 4x dgx* Prompt: The given zip file contains the skill.md and all that type of stuff. Yoβ¦
Apple M6 Pro Geekbench 7
We just got the first Geekbench 7 score for it. https://browser.geekbench.com/v7/cpu/compare/389219?β¦
General warning about Clore.AI
Hello, I know some of us may be tempted to rent out our expensive GPUs to recoup some of the cost ofβ¦
Using image classification models for cleaning out photo libraries
I'm sure you know the problem - WhatsApp saved all those silly memes from your group chats to your pβ¦
Built a home server from an old PC with GPU upgrade. Qwen3.8 27B runs at ~30 tokens per second.
I needed a relatively simple but acceptable level of AI for working on one project. I didn't have anβ¦