AI tools, cybersecurity and development news aggregated from top sources — saved permanently with unique URLs.
Getting a feel for how fast X tokens/second really is.
I love following all your adventures with local LLM setups. Quality and size of the models are impor…
I cannot decide for local OCR model for most of the tasks preferably I would like more individual experiences than reviews.
I have a 16GB VRAM GPU and I'm looking for a reliable local OCR model. Ideally it should stay under …
MTP Option
I have read that MTP has been merged into main. I have pulled the branch and re-built but the option…
LM Studio / Windows / Vulkan possible to prioritize GPU order?
With CUDA you can prioritize GPU usage which worked well with a 3090ti and 3060 12GB. Under 24GB, fa…
Building out my tool library, any recommendations? I just added email capability and im starting to get hyped!
I'm using OpenWebUI and and making tools/skills to improve my models functionality. I am currently u…
NCCL-Free Tensor Parallelism on Dual Blackwell PCIe llama.cpp b9095 released!
b9095 finally makes -sm tensor work on dual consumer Blackwell PCIe GPUs without NCCL If youre on du…
Speeding up local LLM for usable coding agent
TL;DR: Qwen 3.6 35B-A3B (Q4_K_M) is running slow at around 9 t/s with 72% filled context (36147 toke…
DS4
The developer that created Redis, Salvatore Sanfilippo, has released a new project on GitHub named D…
We tried vectors, ASTs, and brute-force context stuffing for code retrieval. Graphs with LLM-generated semantics worked best. Here's what we learned.
We spent the last year building a code indexing system and tried pretty much every retrieval approac…
I have DeepSeek V4 Pro at home
Just wanted to share that I used u/LegacyRemaster slightly modified (Q4_K_M conversion support) Deep…
Hello from 10KM high! - Thanks to Qwen 3.6 35b a3b!
Typing this on a cramped flight, but I was having issues connecting to the plane's wifi on my ubuntu…
Has anyone bought a 3080 20GB mod recently?
I think it would suit my needs perfectly, but I'm scared of getting scammed on Alibaba so looking fo…