AI tools, cybersecurity and development news aggregated from top sources — saved permanently with unique URLs.
Speed difference between Windows 11 and Linux with llama.cpp: a myth when using medium and large MoE models
As the title says, there is no speed difference between Linux and Windows when using llama.cpp. I my…
PolyRange: Contamination-resistant offensive-AI benchmark for web targets (that ain't a benchmark, THAT's a benchmark)
Author here. The short version of why I built this: Cyber-AI evaluation is converging on the same di…
Don’t bite me for that question please…
And question is… How you earning money on your local llm setups? (Except coding ofc) I see people sp…
Use any model and any provider with the official OpenAI Codex Desktop App, without modifying its code, and continue to use the official models in parallel?
All in the title. The official OpenAI Codex Desktop App only accepts models that are from OpenAI and…
Should I buy this RTX 2060 12GB graphics card at around $260 for AI purpose ?
I’m interested in running Gemma 4 model/s for text only . It runs smooth even on my laptop but gets …
Made a program using LocalLLM based on llama.cpp for fellow Book Lovers!
TL;DR: I built an Ebook reader embedded with a compact translation model. Hi! I know this post has a…
mudler/Qwen3.6-35B-A3B-Claude-4.7-Opus-Reasoning-Distilled-APEX-MTP-GGUF just released !
Description of the module: I host 30+ free APEX MoE quantizations as independent research. My only …
what do you use your local llm?
what do you use your local llm for? for me, i run everything on linux and it ends up generating an a…
Best small model right now (~4B params) that is good with agentic tasks for personal assistant?
Looking for suggestions. I have been experimenting with gemma-4-E2B and gemma-4-E4B but the tool cal…
It's funny how everything changes, yet somehow stays the same.
submitted by /u/bigattichouse [link] [comments]…
Dell confirms XPS laptop with NVIDIA N1X at Computex ( basically a DGX Spark GB10 for consumers with Windows )
submitted by /u/fallingdowndizzyvr [link] [comments]…
My home data center
System 1: Threadripper 3960x 24c 4x 3090 ti 128gb ddr4 System 2: Xeon 8352 36c 4x 5070 ti 128gb ddr…