AI tools, cybersecurity and development news aggregated from top sources — saved permanently with unique URLs.
Without open source LLMs, US AI companies could have already monopoled the technology
For such technology with clear importance and impact on all of us, I believe that making it open sou…
Anthropic is intentionally nerfing Fable when asked to develop other LLMs
Reason 458 why local LLMs are going to be a necessity submitted by /u/onil_gova [link] [co…
Which model can watch videos for me?
Hi guys I am looking for an model under 8Gib to watch videos for me and summarize the content. ie, a…
unsloth/North-Mini-Code-1.0-GGUF · Hugging Face
GGUF for the new Cohere 30B A3B model I haven't had a chance to test this yet, but I think it's rela…
NVFP4 GGUF vs Q4_K / Q6_K GGUF for precision
Hey all Mostly a curious question. I've done a bit of research in this sub and other sites, and the …
I'm brand new to running LLMs and the sheer number of tools is overwhelming
Hey everyone. I'm brand new to running LLMs in general, even more new to running them locally, and t…
gemma4 QATs vs higher-bit regular quantizations?
I have enough RAM+VRAM to use gemma4 26b a4b up to q6_k quantizations w/ decent performance. Does an…
Without open llm competition, closed source LLM companies will become insatiable.
I can't imagine how arrogant one must be to make such a decision. People pay $200 a month for Anthro…
Releasing Apodex-1.0 Smol Models (0.8B, 2B, 4B Open-Weights) optimized for Agentic Verification + AgentHarness Evals
Hey r/LocalLLaMA, We just released Apodex 1.0, and alongside our flagship API, we are releasing the …
How I got inspired to build a version manager for llama.cpp
Hey everyone, I wanted to share a little side project I cooked up over the last week. So, long story…
Fine-tuned Qwen2.5-7B to 96% of Claude Haiku on a domain-specific task using ~$3 of API calls and zero human labelers
Built a decision-reasoning engine (Orlog) and wanted to fine-tune a local model for it instead of pa…
Furiosa AI selling inference chip to consumer market will be a game changer to local llm
This is south Korean start up all-in on inference chip: https://furiosa.ai/renegade-spec Tsmc 5nm…