AI tools, cybersecurity and development news aggregated from top sources — saved permanently with unique URLs.
How to Fine-Tune LLMs on AMD Strix Halo and Other Exotic AMD Hardware
After the first general general fine-tuning tutorial i posted here (https://www.promptinjection.net/…
Any news (or hope) of Qwen-3.6 14B and 9B distills for local coding ?
As the title suggests. I'm already testing (with some success, and few challenges) usage of Qwen-3.5…
Has anyone been able to get Draft Models to load in LM Studio?
Per title. Been trying to load Gemma E2b as draft model for 26b as target using LM Studio's UI but …
The Qwen 3.6 35B A3B hype is real!!!
My personal test for small local LLM intelligence is to check whether a model has any ability to und…
ExLlamaV3 Major Updates!
Turboderp has a been on an absolute tear recently, in the endless battle to cram new llamas into sma…
Openclaw ia trending down and will disappear soon
submitted by /u/rm-rf-rm [link] [comments]…
unsloth/MiMo-V2.5-GGUF · Hugging Face
can you run it? submitted by /u/jacek2023 [link] [comments]…
Markdown browser for LLMs
I built a markdown web renderer for AI agents. Instead of taking expensive screenshots and piping th…
As of today, what's the *most stable* model to run on a 32Gb RAM Mac w/ 256k context?
Hey everyone, I've been playing around with Gemma4 and Qwen3.6 on my 32Gb Macbook Pro M2 Max since t…
Do you use subscriptions beside Local LLM?
For me I do, my graphics card is “old” GTX 1080, it is from 2016 or 2017, forgot when already, when …
Ran some Llama.cpp RPC test to see if its worth it. And if 10Gbe needed.
Let me first say I am not doing anything with parallelism so these benchmarks and tests are not for …
I Think I Spent Way Too Much Time Messing with Local LLMs
Guys, I'm hearing coil whine in my sleep. Help /s submitted by /u/MrChilliBalls [link] [co…