AI tools, cybersecurity and development news aggregated from top sources — saved permanently with unique URLs.
qwen3.6-35b-a3b-mtp running on GTX 1060 6GB
I have this old 10-year old Dell T5810 workstation with 32GB ddr3(?) memory and a E5-2698v3 (16 core…
Is NVIDIA still the default best choice for local LLMs in 2026?
submitted by /u/pmv143 [link] [comments]…
👋Welcome to r/AI_Sabotage - Introduce Yourself and Read First!
My system is called guaardvark. www.github.com/guaardvark/guaardvark www.guaardvark.com Looking …
Need Help Choosing a Harness for Qwen 3.6 27B
I've burned a week trying to customize my agent manually - building my own front end - but I've gott…
Best sub-40B model that outpeforms (or matches) GPT-5 mini?
I have been trying GPT-5 mini on Duck.ai and on LMArena (gpt-5-mini-high) and it was very good. I wa…
X-Post of lightweight wheely robots. How / what are they running as the brains? Local? IoT-Style? Networked?
submitted by /u/Mchanger [link] [comments]…
What is the smallest amount of RAM sufficient to run any available on HF GGUF LLM model locally?
I am experimenting with loading large models into small RAM and interested in theoretical limits, wh…
OCR, granite-docling-258m vs granite-docling-2stage-258m: has anyone actually noticed any improvements?
IBM's granite-docling-2stage-258m granite-docling-2stage-258m Granite Docling 2stage builds upon t…
Qwopus 3.6
Has anyone tried it yet? What's it good at? submitted by /u/Perfect-Flounder7856 [link] […
BitCPM-CANN: Native 1.58-Bit Large Language Model Training on Ascend NPU
Paper: https://github.com/OpenBMB/MiniCPM/blob/main/docs/BitCPM_CANN.pdf Abstract We present BitCPM…
GPU VRAM only for small models with llama.cpp: is it possible?
I'm still in my learning process and so far I've been able to make satisfying use of my setup (4070 …
Gemma 4 2B handling structured JSON output + tool calling + reasoning traces correctly via Spring AI / LM Studio — including identifying a real Java bug in code review
Wanted to share a result I didn't expect to work. Running google/gemma-4-e2b locally through LM Stud…