AI tools, cybersecurity and development news aggregated from top sources β saved permanently with unique URLs.
Anyone with 4x 5060ti based setups?
I am currently running 2x RTX 5060 ti and happened across some good sales for additional ones coinciβ¦
Strix Halo or DGX Spark for a home LLM server?
Iβm currently stuck deciding between AMD Strix Halo (128 GB AMD Ryzen AI Max+ 395 Framework Desktop)β¦
What's the current best small model?
Around 3B please thank you submitted by /u/Conscious_Nobody9571 [link] [comments]β¦
Terrible Vulkan pp/tg on Arrow Lake iGPUs
Hi, I recently tried to get llama.cpp with SYCL running on an Arrow Lake system but gave up halfway β¦
Does 'preserve_thinking' work with openwebui?
I'm running qwen3.6-35b with llama.cpp connected to openwebui. And I noticed the model fails the numβ¦
Qwen3.6 35b-a3b π€―
Originally I was a diehard fan of Gemma4 26b-a4b because it really is a remarkably intelligent llm. β¦
MTP on Unsloth
https://huggingface.co/unsloth/Qwen3.6-27B-GGUF-MTP https://huggingface.co/unsloth/Qwen3.6-35B-A3B-Gβ¦
Would a fully open SmolLM4-750M with 16K context make sense?
Iβve been thinking about a possible gap in the current small local model space: a modern fully open β¦
Getting lost in a crazy jungle of decentralized skills, docs, data... Is some sort of cross-platform knowledge-hub (MCP?) the next shit? How are you solving the knowledge problem?
When coding, I may have skills configured in Pi, other skills in Codex. A folder /docs with many marβ¦
PSA: Watch out for extra spaces in chat-template-kwargs when using Qwen3.6 with llama-server
Hey folks, just a heads-up for anyone running Qwen3.6 through llama-server. I ran into an issue wherβ¦
Why is opencode so slow in processing the prompt with llama server?
I'm running opencode and llama-server locally. I have 32gb ram and 780m igpu. With Qwen3.6 I get aroβ¦
New GGUF uploads on HF nearly doubled in 2 months
From clem on π: https://x.com/ClementDelangue/status/2053536106143261106 From Victor M on π: https:/β¦