AI tools, cybersecurity and development news aggregated from top sources — saved permanently with unique URLs.
new MoE from ai2, EMO
new MoE release from ai2 - EMO, 1b-active/14b-total trained on 1t tokens interesting thing is docume…
How difficult is distilling?
I remember a year or so ago when DeepSeek R1 came out and it was pretty quickly distilled into Llama…
vLLM ROCm has been added to Lemonade as an experimental backend
vLLM has the ability to run .safetensors LLMs before they are converted to GGUF and represents a new…
Testing Local LLMs in Practice: Code Generation, Quality vs. Speed
Hello, I spent the last few months building an AI agent that autonomously writes Go code using local…
The amount of new agent APIs/harnesses are dizzying, with everyone and their dog releasing their own. Can we do a compilation thread of comparisons?
Assuming you have tried multiple, please compare them. Please also post your hardware specs and soft…
You can do CUDA inference on an Apple Silicon Mac with PCI Passthrough
I have been working on a project to adapt QEMU, running on macOS, to support passing through a GPU i…
What is the next SOTA model you are excited about?
We had deepseek v4 preview recently but it wasn't much better than v3.2. What is the next SOTA local…
Local LLM for electronics design work?
Another hobby is working on electronics projects ranging from low-voltage control and signal process…
Ring 2.6 1T
Listed on Open Router only so far: https://openrouter.ai/inclusionai/ring-2.6-1t:free Ling 2.6 is op…
Unpopular Opinion: The DGX Spark Forum community of devs is talented AF and will make the crippled hardware a success through their sheer force of will.
There is a lot of disdain for DGX Sparks here on the sub. And I get it. A lot of people say “It coul…
Reports suggest DeepSeek is seeking $7.35 billion in funding and plans to release its V4.1 update next month.
DeepSeek Reportedly Seeking to Raise Over RMB 50 Billion ($7.35 Billion), Accelerating Its Commercia…
(Rant ;)) Make your benchmarks realistic
Everybody here is posting their optimizations for running different models - thats good but make the…