AI tools, cybersecurity and development news aggregated from top sources — saved permanently with unique URLs.
Duality of r/LocalLLaMA
submitted by /u/HornyGooner4402 [link] [comments]…
Power-limit vs TG/s for 2x3090
Trying to find the sweet-spot to tradeoff between power and tg/s. 250W seems to be a sweet spot for …
I'm done with using local LLMs for coding
I think gave it a fair shot over the past few weeks, forcing myself to use local models for non-work…
For Non-hallucinating work, MiMo 2.5 delivers
MIT license and fully open source. MiMo-V2.5-Pro was just 3 points from Opus 4.7 max and the normal …
Kimi K2.6 vs DeepSeek V4 Pro
How are you finding these models, which one do you find to be better for real use cases? So far we'r…
Local model on coding has reached a certain threshold to be feasible for real work
We ran open-weight 27B–32B models on Terminal-Bench 2.0 (89 tasks, terminal-bench-2.git @ 69671fb) t…
Anyone tried this yet? LLM with knowledge date in the 1930s
submitted by /u/The_frozen_one [link] [comments]…
Last llama.cpp update broke web search tool calling with Qwen 3.6 27b.
At least in open-webui. Nothing has changed except for the backend update. The gguf is unsloth's Q4-…
Guys this is so fun!
Running my own models. I was having some trouble getting vLLM going so dropped down to LM Studio whi…
End-2-end tutorial on fine-tuning, the whole journey
I put together a hands-on tutorial that takes you from problem framing to fine-tuning, step by step.…
Microsoft Presents "TRELLIS.2": An Open-Source, 4b-Parameter, Image-To-3D Model Producing Up To 1536³ PBR Textured Assets, Built On Native 3D VAES With 16× Spatial Compression, Delivering Efficient, Scalable, High-Fidelity Asset Generation.
TRELLIS.2 is a state-of-the-art large 3D generative model (4B parameters) designed for high-fidelity…
2 x 5060 ti: Any better configs for Qwen 3.6 27B / 35B?
I have been trying various setups, quants etc for Qwen 3.6 27B and 35 A3B on my 2 x 5060 TI 16 GB se…