AI tools, cybersecurity and development news aggregated from top sources — saved permanently with unique URLs.
Qwen3.6 27B Pure Quant: 40 tok/s on 16 GB VRAM
Hello everyone! I want to share the result of my experiment to make Qwen3.6 27B Q4_K_M fits in to my…
Qwen3.6-35B-A3B Q4 262k context on 8GB 3070 Ti = +30tps
..and on 8GB VRAM I can even push the context to 320K, 400K, 512K, and yes.. 1M. But it does start t…
NVIDIA Removes Gaming Revenue Category From Financial Reports
submitted by /u/HumanDrone8721 [link] [comments]…
Blackwell and PDL performance increase
Llama.cpp recently introduced support for Programmatic Dependent Launch (PDL), which is a new featur…
I fine-tuned Cohere Transcribe to support diarization and timestamps
Hi I'll keep it short: Cohere-transcribe is currently the best open source speech to text model (and…
Scrambling to max StrixHalo (+NVLink dual eGPU 3090 mod)
https://preview.redd.it/kz66mxzseq2h1.jpg?width=4096&format=pjpg&auto=webp&s=da98623808c4bde0dc79b23…
Can't believe I got it working! Dual GPU - 48gb VRAM llama-cpp server - R7900 + 7800XT
Setup: Kubuntu 24.04 - AMD cards - R9700 AI PRO and 7800xt (32gb + 16gb) - llama-cpp server - stack …
CODA: Rewriting Transformer Blocks as GEMM-Epilogue Programs
Transformer training systems are built around dense linear algebra, yet a nontrivial fraction of end…
Vector Policy Optimization: Training for Diversity Improves Test-Time Search
Language models must now generalize out of the box to novel environments and work inside inference-s…
How small can the orchestration model in an agent be? (separating it from code-gen — that obviously wants a big model)
I'm building a local-first agent — a plain ReAct loop (think, pick a tool, observe, repeat) on a lla…
BeeLlama v0.2.0 – major DFlash update. Single RTX 3090: Qwen 3.6 27B up to 164 tps (4.40x), Gemma 4 31B up to 177.8 tps (4.93x). Prompt processing speed near baseline.
BeeLlama v0.2.0 is here! Not quite a pegasus, but close enough. GitHub | Qwen 3.6 27B Quick Start …
trained a prompt injection detector using ml-intern and DeepSeek v4 Flash, runs in the browser
Trained a prompt injection classifier using ml-intern + DeepSeek v4 Flash. DistilBERT, F1 99%, ONNX …