AI tools, cybersecurity and development news aggregated from top sources — saved permanently with unique URLs.
I got Qwen3-VL-Embedding-2B working with rkllm on an Orange Pi 5b
This shit is cool, I have a demo script where it compares over 1,300 phrases for similarity to a liv…
LLC: lightweight OpenWebUI alt - now with chat converter + custom tool calls
Posted my project here a while back and got some solid feedback via DMs. The main ask was a converte…
24GB M4 Mac - is Qwen 9B only option while system is running?
I have mac at work that I want to use local model for prototyping and basic prompts that needs to st…
Move to backend sampling for MTP draft path by gaugarg-nv · Pull Request #23287 · ggml-org/llama.cpp
improved MTP performance submitted by /u/jacek2023 [link] [comments]…
AI server under 5k?
I have a framework desktop 128GB and a 3080 12GB running qwen 7b I want to move to a proper server r…
I guess 4 units wasn’t enough.
I don’t think this thing is going to work out, if anyone wants a 4u gpu server complete with half a …
Waiting on Qwen to drop those 3.7 models be like:
Mods please be kind. This was not “low effort”. It took me several minutes to find just the right wa…
Qwen 3.6 35B GGUF: NTP vs MTP quantization results across GPUs and CPUs
Hey r/LocalLLaMA, We’ve released our ByteShape Qwen 3.6 35B GGUF quantizations in two families: stan…
CohereLabs/command-a-plus-05-2026-bf16 · Hugging Face
submitted by /u/coder543 [link] [comments]…
"AWS secures rare Mac Studios while ordinary Apple customers remain completely locked out"
https://www.techradar.com/pro/you-cant-buy-them-for-your-home-or-office-but-aws-just-snapped-up-a-ho…
AMD Ryzen AI Halo PC will cost 3999$ with 128GB memory on board
submitted by /u/Mochila-Mochila [link] [comments]…
HuggingFace benchmark datasets now let you filter by model size
Quite useful to see which model under 32B performs best on swebenchverified for example. https://hug…