AI tools, cybersecurity and development news aggregated from top sources — saved permanently with unique URLs.
[Open] useknockout - free SOTA background removal + super-res API alternative to remove.bg / Topaz, MIT, runs on Modal
Released v0.6.0 of useknockout this week. Single FastAPI service, 20 endpoints deploys to Modal in o…
Need advice on hardware purchasing decision: RTX 5090 vs. M5 Max 128GB for agentic software development
tl;dr - For software development, Qwen3.6 27B, 5090 gives you ~3x speed over M5 Max, letting you plo…
Get faster qwen 3.6 27b
Using 100k context with 3090 with MTP GGUF and getting 50 t/s on llama.cpp Thought I would knowledge…
Uploaded Unsloth Qwen3.6-35B-A3B UD XL models with MTP grafted, here are the results
Following my previous post https://www.reddit.com/r/LocalLLaMA/comments/1t5ageq, a few people asked …
Great results with Qwen3.6-35B-A3B-UD-Q5_K_XL + VS Code and Copilot
Long post, but hopefully helps somebody. Llama-cpp vulkan server running single AMD R9700. The setti…
Has anyone tried Zyphra 1 - 8B MoE?
https://x.com/ZyphraAI/status/2052103618145501459?s=20 Today we're releasing ZAYA1-8B, a reasoning M…
The GB10 Solution Atlas is now open source, the inference engine made for the community with breakneck inference speeds (Qwen3.6-35B-FP8 100+ tok/s)
Some of you saw our post a couple weeks back about hitting 102 tok/s stable on Qwen3.5-35B on a DGX …
Most people seem obsessed with token generation speed, but isn’t prefill the real bottleneck? Am I missing something?
I read this sub every day and I keep seeing benchmarks and discussions focused almost entirely on to…
Exaggerated PCI-E bandwidth concerns?
I frequently see (both here and on r/LocalLLM ) comments that multi-gpu setups are complex, problema…
ZAYA1-8B: Frontier intelligence density, trained on AMD
submitted by /u/carbocation [link] [comments]…
I analyzed 922 agentic task trace and found the secret weapon of DeepSeek v4
I recently did a benchmark of deepseek v4 in agentic tasks. Performance-wise, it's one of the best o…
Anyone want to try my llama.cpp DeepSeek V3.2 PR?
Code: https://github.com/fairydreaming/llama.cpp/tree/deepseek-dsa git clone https://github.com/fair…