AI tools, cybersecurity and development news aggregated from top sources — saved permanently with unique URLs.
How much total VRAM (or shared RAM for Mac/Halo/etc) do you have on your local server/PC?
View Poll submitted by /u/panchovix [link] [comments]…
Upgrade path from 4x 3090s
Hey everyone, looking for some upgrade advice. Right now, I’m running 4x 3090s hosting Qwen 3.6 27B …
Might they?
submitted by /u/tnhnyc [link] [comments]…
Mimo 2.5 Pro - 40t/s on 8x Nvidia Spark/GB10 cluster
I got Mimo 2.5 Pro running on my 8x Asus Nvidia GB10 cluster using mtp-2, single user request, codin…
Are local models good enough yet for AI meeting memory?
I’ve been trying to move more of my workflow local, but meeting memory is the one thing I still can’…
I've just benchmarked myself:
submitted by /u/JLeonsarmiento [link] [comments]…
Granite 4.1 Architecture Changes?
Hey all. Anyone know why IBM decided to return to a pure transformer model for Granite 4.1? They men…
What can you train or finetune with 6gb vram?
I seriously have no idea how much vram it takes to finetune or train a model in a way that makes it …
LiquidAI/LFM2.5-8B-A1B · Hugging Face
looks like you can run it on any potato (A1B)! https://huggingface.co/LiquidAI/LFM2.5-8B-A1B-GGUF fr…
Qwen3.6 35B - TXT vs Markdown vs HTML vs HTML+CSS
Theres been talk of late about using HTML rather than markdown in Claude Code. I was curious how thi…
I ran some benchmarks using oMLX tool (I know, not representative, too little sample size, leaked benchmarks 99% posible, etc.)... still quite interesting
submitted by /u/JLeonsarmiento [link] [comments]…
I built an enforcement layer for AI coding agents using a local knowledge graph and hybrid RAG
I know this sub is focused on local models but the architecture behind this applies to any LLM-power…