AI tools, cybersecurity and development news aggregated from top sources — saved permanently with unique URLs.
Reviewing speed optimizations on llamacpp for large MoE models on multiGPU rigs? (fitparams vs -ngl/-ncmoe vs other flags, P2P, overclocking)
In anticipation of MiniMax reported upcoming open-weight release of M3, wanted to do comprehensive r…
I tried the same prompt people are talking about in the vibecoding subreddit on my local setup
In reference to this: https://www.reddit.com/r/vibecoding/comments/1u26r5z/we_gave_the_same_exact_pr…
DifussionGemma 4 on 4x7900xtx
Just got 100 tps on generation, but in total time it around 45-60 t/s in case of prompt processing w…
Any chances for a 12B diffusion Gemma?
Currently recompiling my llama.cpp with support for diffusion Gemma, but I know on my hardware it wo…
Guide: LM Studio & ComfyUI with OpenWebUI on a single GPU
Hi everyone, I figured out how to host both ComfyUI and LM Studio on my one AI server with a single …
DiffusionGemma 26B A4B results on my 5090
# DiffusionGemma 26B A4B — Tuning Results https://huggingface.co/unsloth/diffusiongemma-26B-A4B-it-…
DiffusionGemma under real workloads feels very different from benchmark demos
okay after testing DiffusionGemma a bit more internally we genuinely can’t tell if this is the start…
As we know Minimax M3 is just going to be open sourced in few days and because of that I was surfing on internet searching for its scores and I found out pretty interesting results. Is Minimax M3 really that good in agentic stuff and in coding? Is it better than older gpt models?
Has anyone personally compared the Minimax M3 model against other proprietary models to determine it…
Can't seem to enable reasoning in llama.cpp
Hi, I'm trying to use some LLMs which I know support reasoning (TheDrummer Rocinante X 12B model) bu…
Reasoning, but without actually *drafting* replies?
I've been experimenting a bit today with letting models reason for creative tasks, rationale being t…
Small models are overconfident because they're distilled from large models
Small models are trained to copy big models' answers and their confidence. If they are trained to kn…
[NEW MODEL] SupraLabs just released Supra1.5-50M Base (Experimental)!
SupraLabs just released Supra1.5-50M Base (Experimental)! Hey r/LocalLLaMA! We're back with a new ex…