AI tools, cybersecurity and development news aggregated from top sources — saved permanently with unique URLs.
[Bi-Weekly Megathread] Project Showcase
Do you have something you'd like to share with the r/LocalLLaMA community. This is the place for it!…
How do you locally benchmark and compare local LLMs?
If I wanted to locally compare performance for multiple different offline LLM models across various …
How much code do AI models and harnesses add? I made an open-source benchmark to measure code complexity.
Existing benchmarks measure the solve rate and token output/cost, but don't punish excess code or ov…
Nous Research Arete-27B GGUF quants
submitted by /u/gladkos [link] [comments]…
Really cool 3d video on how the microduck ai robot works
Underrated youtube channel, thought this would be nice to share given its open source uses local ai.…
Resurrecting 2013 E-Waste: Native CUDA Mamba-1 & PyTorch 2.7.1 on Windows (Kepler–Turing, SM 3.5–7.5)
Hello! I want to share an active development project. If you have a drawer full of old NVIDIA GPU's …
Intel Arc Pro B70 32GB ($1,299) vs NVIDIA RTX 5090 ($6,500+) on Qwen3.8-27B: about 1/2 speed gen (1/3 speed prefill) for 1/5 price, after best setup
I got an Arc Pro B70 (32GB) last week for $1,299 direct from ASRock official store on Amazon (B65 is…
Kimi-K3.1-Pro-Coder (2.8T) | 1.77 TB -> 775 GB (-56%) | 36.8 TPS (Batch) / 10.8 TPS on 1x Blackwell | 96.7% on both AIME 2025 and LiveCodeBench
Up front: I know a 775 GB quant is not for everyone, and this is definitely a more experimental setu…
Next-Concept Modeling: Fast, Parallel Coarse-to-Fine Text Generation: This will completely change everything!
Essentially we could very soon run opus 5.5 level of intelligence on 32gb Vram. Its many folds more …
Anyone tried this yet?
Terminal-RSI-27B is a Qwen3.8-27B-based terminal-agent model released by the Terminal-RSI project. I…
What are people finding local models actually useful for?
I think that a lot of people get into local models because they get a sense of potential with this s…
GPT-5.5 dataset across my used 25 billion tokens!
Cheers for u/New_Comfortable7240 for santitisation! 12,121 tool calls here! submitted by /u/-M…