AI tools, cybersecurity and development news aggregated from top sources — saved permanently with unique URLs.
what’s was your local daily driver for coding last week?
drop your favorite model and quant in the comments. View Poll submitted by /u/be566 [link] …
kv-cache : avoid kv cells copies by ggerganov · Pull Request #24277 · ggml-org/llama.cpp
Improved MTP performance (For Gemma-4) This got merged yesterday. Available b9551 onwards. submit…
Most reliable way to do PDF to JSON?
Hello everyone, I am currently stuck at automating a process where I need to parse medium-hard level…
[Benchmark] DFlash Speculative Decoding + KV Cache Compression on RTX 5090 — 3.26x Speedup
Hardware: RTX 5090 | Model: Qwen3.6-27B | Framework: BeeLlama.cpp Full benchmark scripts, raw data, …
Been watching real adversarial input hit my detection API for six months. Here's what's actually landing.
Disclosure: I built Bordair, a prompt injection detection API. This post is about attack patterns we…
Meddies PII: An Open Multilingual De-identification Model for Clinical Text
A clinical AI model does not need to know who the patient is to reason clinically. It needs the sym…
Windows keeps crashing on rtx 3090
Recently bought used 3090. Under heavy stress tests and gaming it's fine. When I load any model, it'…
vllm-doctor — a CLI tool to diagnose and monitor vLLM inference servers
vllm-doctor reads metrics from a vLLM server's /metrics endpoint or a Prometheus instance and runs r…
mindlab-research/Macaron-V1-Preview-749B • Huggingface
https://huggingface.co/mindlab-research/Macaron-V1-Preview-749B https://preview.redd.it/g64u0fyts06h…
Weird to get near linear scaling by adding another GPU?
Single steam benchmarks (club-3090) model: qwen3.6-27b-autoround-int4 BEFORE: 1x3090 *Their default…
Gemma 4 12b QAT is a regression for my use case, despite all the hype.. Not my main Squeeze
I spent the last few days trying to get consistent tool calling out of the new Gemma 4 12b QAT model…
Thoughts on Gemma4 12b vs 26a4b, which one is better?
Not talking about 31b. In terms of creative tasks, writing, chatting, not necessarily coding but ca…