AI tools, cybersecurity and development news aggregated from top sources — saved permanently with unique URLs.
Repeated generation is worth it and self-evaluation is effective
I made gemma4 12B write timestamp-anchored summaries of youtube video transcripts. I tested if the s…
Building a zero-dependency C inference engine for BitNet (1.58-bit) - lessons from hitting 36 tok/s on a Xeon CPU
Over the past few months I have been building a CPU-first inference engine from scratch in pure C99 …
Showoff Saturday: Local 4x 6000 Pro (multi-year progression)
Not the biggest or shiniest, but it's mine From gaming machine inference on the original llama model…
My first run of Kimi K3 locally.
Running across 2 clusters using llama.cpp over RPC too. Both clusters are not enough to hold everyt…
128GB vs 256gb of ram
Imagine you have 128gb of VRAM. what accompanying ram capacity you would choose (DDR4 8channel)? For…
Tesla V100 Qwen3.6 27B Performance
Looking for V100 users to share your config and it's performance. GPU: Tesla V100 PCIE 32Gb Qwen3.6 …
2027 Memory Capacity Is Reportedly Sold Out
submitted by /u/johnnyApplePRNG [link] [comments]…
Qwen3.6 27B + 35B on vLLM, single R9700 (gfx1201)
I've been tuning my new Radeon AI Pro R9700, and figured that this would be useful information for p…
DeepSeek V4 Flash 0731 appreciation post
I’m running DSV4F 0731 on dual spark, and honestly… wow. It’s an absolute workhorse, and the benchma…
Anyone else amped up over Qwen 3.8?
I’ve been using 3.6 27B Q4, and that quant is fast on an M5. The code has been average, but consiste…
Qwen 35B-A3B MoE vs 27B dense in local coding tests: ~4× faster, much smaller quality gap than I expected
I compared Qwen 35B-A3B MoE against Qwen 27B dense on a series of local coding-maintenance tasks. On…
Is anyone else finding DeepSeek-V4-Flash unreliable for non-coding tasks?
(I am not a native speaker, written by myself, so please bear with me) I really want to like DeepSee…