AI tools, cybersecurity and development news aggregated from top sources — saved permanently with unique URLs.
If you are using big model compared to ram try and disable mtp
Little reminder, with all my testing I found out that mtp can decrease performance when using very b…
List of tiny-to-medium models for web research/coding agents
I am compiling a list of models that I think are potentially worth considering for folks who want to…
Whats the best open source OCR for batch processing pdfs in 2026?
trying to settle on a fully local setup for batch processing pdfs. like each file is around 20-25 pa…
JetBrains/Mellum2.1-12B-A2.5B-Thinking-MTP · Hugging Face
Mellum2.1 Thinking with the MTP head Multi-token prediction head The multi-token prediction (MTP) he…
Live-Swap CUDA Workloads: llama.cpp, ComfyUI, Strata & More
Berth is a lightweight GPU resource manager written in Go. It controls which applications get access…
AMA Announcement: Reflection, the lab behind behind Beam (Tuesday Nov 3rd, 8am-11am PT)
Join us on Tuesday to meet the product team at Reflection and to learn more about Beam, their first …
The Rise of GLM and China’s Zhipu AI
submitted by /u/wren6991 [link] [comments]…
8 agents × 250K context, concurrently, on two 3090s (~600+ tok/s total)
I am open to the idea that I am misguided, but my findings feel worth sharing: Short video of my UI …
LFM3 Omni 2B is INCREDIBLE
Liquid AI "showed off" that their new omni model can run on WebGPU inside your browser. Here's a vid…
Do we really need all these "speed" posts?
I appreciate the research and development that is going into these open source tools. However, there…
Sorry Sam, my "quite terrible" home DRAM is at 100% now: patched Strata to make DeepSeek V4.1 agent sessions start 20× faster on a good old standard gaming GPU, no datacenter required
Sam Altman recently said that "from a global allocation perspective, actually, it's quite terrible t…
Qwen 3.8 Flash Next NVFP4 on 64gb RAM and 5090, Basalt. Ditched windows for it. Very hyped for qwen 4 model family now.
So, I was asleep on Strata and its specialized forks. Tried basalt and i'm very impressed with the s…