AI tools, cybersecurity and development news aggregated from top sources — saved permanently with unique URLs.
[Help] Running big dense models faster
I have been trying Mistral 3.5 on my 4x RTX 3090 rig with llama.cpp. Inference is slow (about 11 t/s…
found a new project memory MCP with hybrid recall (BM25 + vectors + RRF) on FFT Qwen3.5-4B
submitted by /u/9gxa05s8fa8sh [link] [comments]…
I built "Semvec": A Constant-Cost Semantic Memory for LLMs (Looking for testers!)
Hey everyone, if you build LLM applications, autonomous agents, or just use Claude/Cursor for coding…
Having an always-on machine running LLMs locally at home while on the move with a lightweight machine - Experiences?
Hi! I’m currently retraining in data science and my current laptop is an 8 GB MacBook Air, so natura…
What are some good use cases for Gemma Embedding 2?
Does anyone know of any use cases of Gemma Embedding 2? Or is it solely for search? submitted by …
What's your tps on 3090 + Qwen 3.6 27B in real tasks?
I struggle to wrap my head around all this. My goal is local agent to solve low complexity tasks, in…
What is The best and expressive AI TTS (running locally?) for voice acting?
I am only doing this for private hobby projects.But I haven’t been up to date with the best TTS? Whi…
We are finally there: Qwen3.6-27B + agentic search; 95.7% SimpleQA on a single 3090, fully local
LDR maintainer here. Thanks to the strong support of r/LocalLLaMA community LDR got very far. I have…
[RELEASE] - Finally, my first TTS model is out! 🎙️ Flare-TTS 28M
Hey r/LocalLLaMA ! I am back with a new model, and it's something special today 😃 It's Flare-TTS 28M…
What about a website to share our model settings and optimisations ?
Hello folks, I'm thinking about creating a website to share our settings and configurations for our …
MiniMax M2.7 AWQ-4bit on 2x Spark vs 2x RTX 6000 96GB - performance and energy efficiency
Hello, This model/quant is my daily driver and I wanted to have some reference benchs for comparing …
Hybrid on-device inference on Android: llama.cpp + LiteRT + NPU/GPU routing
Hi everyone, I’m the maintainer of Box — a fork of Google’s AI Edge Gallery that I’ve been extending…