AI tools, cybersecurity and development news aggregated from top sources — saved permanently with unique URLs.
Has anyone set a local LLM up as a language learning tool?
I've been learning German recently, and it occurred to me that I could point some of my AI horsepowe…
Qwen doesn't work for free
submitted by /u/Dion-AI [link] [comments]…
We built and open-sourced Caliby: An embedded, high-performance vector database for AI Agents (Beats pgvector by 4x, outperforms FAISS on disk)
Hi Reddit, we are a team of database researchers (including a PhD from MIT DB Group) and we just ope…
What llamacpp's webui has and what it lacks
I've been on a quest testing chat UI's for development. So far out of Jan.ai, AnythingLLM, librechat…
How long for llama.cpp official support of MTP?
Hello there (beginner here) I've been unable to build myself llama.cpp for my Strix Halo (Windows 11…
Shel Silverstein predicts LLM's (and its hallucinations), cira 1981
Ran across this cartoon / poem on accident as I was reminiscing about my favorite childhood poet, Sh…
Those of you who like Gemma4 models - how are you guys using them?
I have been using local LLM for coding quite a lot as well as some other tasks (like data extraction…
Qwen3.6 35B A3B uncensored heretic Native MTP Preserved is Out Now With KLD 0.0015, 10/100 Refusals and the Full 19 MTPs Preserved and Retained, Available in Safetensors, GGUFs. NVFP4, NVFP4 GGUFs and GPTQ-Int4 Formats
llmfan46/Qwen3.6-35B-A3B-uncensored-heretic-Native-MTP-Preserved: https://huggingface.co/llmfan46/Qw…
Tribue to April's LLM releases
April 2026 was a turning point for local LLMs. Ths is my tribute. submitted by /u/Everlier […
MTP is all about acceptance rate
So I was very excited about the MTP stuff especially since Gemma4 has become my "daily driver" for s…
Qwen 35B-A3B is very usable with 12GB of VRAM
Hardware: RTX 3060 12GB 32GB DDR4-3200 Windows CUDA 13.x Model: Qwen3.6-35B-A3B-MTP-IQ4_XS.gguf Th…
Got MTP + TurboQuant running — Qwen3.6-27B -- 80+ t/s at 262K context on a single RTX 4090
So I've been messing around trying to get MTP working alongside TBQ4_0 (TurboQuant's lossless 4.25 b…