AI tools, cybersecurity and development news aggregated from top sources — saved permanently with unique URLs.
How much will it cost to host something like qwen3.6 35b a3b in a cloud?
I keep hearing the model is good, I don't have the hardware for it, and I will wait to the end of th…
Pushing a 5-Year-Old 6GB VRAM laptop to Its Limits: Qwen3.6-35B-A3B
For the past few weeks, I have been trying to get this model working on my hardware. It still feels …
AMD Strix Halo refresh with 192gb!
Looks like the next strix halo, the Gorgon halo 495 max will have more then 128gb! I already bought …
Qwen3-TTS but in OpenVINO, from scratch
Hello everyone, I finally got around to preparing my implementation of Qwen3-TTS in OpenVINO format …
One bash permission slipped...
How? It kept getting chained bash commands wrong, with wrong escapes. So it created many bad directo…
Mistral Medium 3.5 on AMD Strix Halo
TLDR; it's slow as heck. Run overnight. I asked it a question about codebase architecture. For an en…
Gemma 4 E2B runs surprisingly well on my 8GB Android phone, so I built a private voice notes app around it.
Been running Gemma 4 E2B locally on my OnePlus CE 5 (8GB RAM) for a few months. Chat quality is fine…
First time GPU buyer. Got a RTX 5000 Pro. Was it a bad decision compared to two 3090s?
I’ve run models exclusively on apple silicon up until now, but wanted to up my inference game. I bo…
What a time to be alive from 1tk/sec to 20-100tk/sec for huge models
https://www.reddit.com/r/LocalLLaMA/comments/1eb6to7/llama_405b_q4_k_m_quantization_running_locally/…
A Qwen finetune, that feels VERY human
Hello guys, So TL;DR, I was asked by multiple people to make an Assistant_Pepe_32B version, but the …
Could PC x64 instruction extensions relieve hardware shortage?
Intel and AMD have jointly unveiled AI Compute Extensions (ACE), a new x86 instruction set extension…
Anyone tried +- 100B models locally with foreign languages?
I am quite curious as I tried Gemma 4 31B, Qwen 3.6 27B, GLM 4.7 30B and some others in my native la…