AI tools, cybersecurity and development news aggregated from top sources — saved permanently with unique URLs.
Locally-hosted language-learning AI you can talk to comparable to Pingo AI?
I recently tried Pingo AI (trial form) but would rather set something up locally instead. The langu…
CUDA: add fast walsh-hadamard transform by am17an · Pull Request #23615 · ggml-org/llama.cpp
Implemented(by u/am17an) FWHT for CUDA, speed-up for cases when we quantize the kv-cache. 1-2% boost…
Is there any case of a less quantised smaller model outperforming a more quantised larger model?
As per the title Such as Gemma 4 31B Q4 K S vs Gemma 4 26B A4B Q8 Or Qwen 3.6 27B Q4 K M vs Qwen 3.6…
Can you jailbreak Llama 3.1 8B? (Red-Teaming Challenge)
Hi everyone, I'm working on a runtime governance engine designed to force any autonomous agent to st…
Llama.cpp : Split Mode Tensor Fix Incoming?
Appears thay have been cooking and we might see a fix soon released for crashes on split mode tensor…
Best coding model on RTX 3060
Wondering what’s the best coding model that can fit on a RTX 3060 (12GB). Has anyone been able to do…
Whats the best Qwen 27B Q8 quant?
everyone is talking about q 4 q 5 and q 6, but. i got some coding that i feel like lower quants kept…
(Yet Another) KV cache calculator - kvanta.vcerny.cz
Hello everyone, I thought all public web-based KV cache calculators kinda suck.. so I decided to cre…
Is Qwen3.6 current king for local agentic use?
I've been testing other models but it seems like nothing even come close to Qwen3.6 35B A3B for agen…
Full Attention Strikes Back: Transferring Full Attention into Sparse within Hundred Training Steps
Long-context inference in large language models is bottlenecked by the quadratic cost of full attent…
Save Safetensor LLM from C#
Has anyone written a reliable method for saving a GPT-model from C# into a safetensor file that is c…
Sharing my 'Local-LLM-Toolkit' repo
I've been taking notes as I learn about local LLM (and regular llm stuff) stuff since getting a Mac …