AI tools, cybersecurity and development news aggregated from top sources — saved permanently with unique URLs.
opensource music reccomendation / playlist, similar to spotify radio / YT music mix?
Any recommendations for this? Initially, i was thinking that LLMs probably not the right thing for …
Could someone please help explain these results?
I'm running Qwen3.6-35B-A3B-UD-Q4_K_XL.gguf on 12 GB VRAM and 32 GB RAM via the TurboQuant variant o…
llama.cpp has a clever trick for speeding up KV cache decode
So, I use llama-server as my endpoint to run local models and connect them to Open-WebUI, Hermes, an…
how to install llamacpp the better way to wrapping it in python ui (CPU use only) ?
i want the best installation that fit my use and my low-compute H.W , i want to run small to above s…
hipEngine: Fast Native Qwen 3.6 Inference for RDNA3 (Strix Halo, 7900 XTX)
A few weeks ago, after finishing FastDMS, I started toying around writing some RDNA3 kernels again t…
Qwen 3.6 27B MTP speed on 3080ti (getting 4.5 t/s)
Using LM Studio with 3080ti (12gb of VRAM) and 128gb of ddr4. Model version: Qwen 3.6 27B MTP UD q4_…
Could Open Models be trained to secretly go rogue?
I was discussing with some other folks how safe is to use open weights models from China and the top…
Generative Recursive Education: Creating Custom Interactive Textbooks on the Fly.
submitted by /u/Ryoiki-Tokuiten [link] [comments]…
I have macbook m4 16’ 48GB. I use claude code and want to try local one
I've been on Claude Code daily for a while and want to see how far local models can do my setup: - M…
magic incantation to get llama-bench to work with MTP ?
It does not like anything I have tried, including what works with llama-server. is it not built to w…
Can someone help me understand MCP?
They just seem like tool calls and skills, but from a link somehow? Like.. I don’t get it. Is it pri…
What frontend do you guys use?
I’m using vim lmao with a custom made plugin for completing text, so I was curious what yall use. Ll…