AI tools, cybersecurity and development news aggregated from top sources — saved permanently with unique URLs.
Dual GPU llama.cpp speedup
Llama.cpp has had a long standing issue with "--split-mode tensor", you'll get great results but it …
Using Local LLMs for research
Hey there. I am an undergrad who has been doing mostly SWE, but will be doing ML research under my p…
Is that was a right purchase for Qwen3.6 27/35
Hi. I had a pc (b550 + 3900x + 32GB DDR4 + 3080 10GB). But it vram amount is miserable. after long i…
Jackrong/Qwopus3.5-9B-Coder-GGUF · Hugging Face
Qwopus3.5-9B-coder is specially optimized and fine-tuned for high-performance 🤖 Agentic Coding, comp…
Llama.cpp MTP with Qwen3.6 27B on Headless RTX 3090
Saw some posts around PP being slower, so they were cautious on trying it. Here's a real-world datap…
Deepseek V4's 1M context window: the breaking point
Just ran to verify deepseek v4's context claim of 1M and ran it across three production codebases li…
Strix Halo ROCm + MTP Notes (May 2026)
With the MTP merge into mainline llama.cpp I wanted to try out some other optimizations i could thin…
How does Pi coding agent control Qwen's thinking verbosity? (Qwen 35B A3B, llama-server)
I'm running Qwen 35B A3B via llama-server with reasoning budget set to -1 (unlimited) for testing. I…
Testing llama.cpp MTP support on Qwen3.6 - RTX 5090
Setup: - RTX 5090, 32 GB, Linux - Built llama.cpp from 4f13cb7 (the official ghcr.io/ggml-org/llama.…
Looking to migrate off of Ollama and LMStudio
Hello, I'm currently using Ollama / lm studio for things like code inference and proof reading email…
"Elias Thorne" is what eight different LLMs name a lighthouse keeper. He's also selling cancer treatment advice on Amazon
Disclosure: I wrote this article with the purpose of contributing to the wider conversation of how w…
Hardware Recommendations for realtime voice and a simple personal assistant/organisation agent.
Hi Guys Been looking into building a localLLM box to run at home to do things like ingest emails and…