AI tools, cybersecurity and development news aggregated from top sources — saved permanently with unique URLs.
MiniCPM5-1B
submitted by /u/kevinlch [link] [comments]…
The Financial Times has published an article about Heretic
https://www.ft.com/content/5630ed79-a263-41ed-9a1a-321617ae310e “The FT was able to use Heretic, a t…
The reason small-model agent stacks aren't the default has nothing to do with whether they work
Last June, NVIDIA published a position paper called "Small Language Models are the Future of Agentic…
NuExtract3 released: open-weight 4B VLM for Markdown, OCR and structured extraction (self-hostable)
Disclaimer: I work for Numind, the company behind this open-weight model TLDR: Image/text to Markdow…
Just wanted to show off how cool I think it is that my python ai has a real brain looking brain.
Not promoting or anything, just think it's oddly interesting. submitted by /u/Glittering_Focus…
Old Mac Pro still proving its worth
The “Trash Can” Mac Pro, once the most expensive machine you could buy from Apple, mine was just shy…
llama.cpp oom issue
I'm having an issue with llama.cpp going OOM (system ram, not vram) after some time, roughly 20-40 m…
Want Built a React-style looping agent with small LLMs (Qwen 3.5 9B / Gemma4) + LangGraph?
Currently experimenting with building a React-style looping agent system using small LLMs like Qwen …
OSCAR RotationZoo - Offline Spectral Covariance-Aware Rotation for 2-bit KV Cache Quantization
https://huggingface.co/Zhongzhu/OSCAR-RotationZoo OSCAR RotationZoo Precomputed K/V rotation matrice…
How local AI improved your live?
Lets share use cases which improve life quality of the people. Home assistants, psychological help, …
RAG for developer docs so local llm can code using latest library?
I was wondering if it would make local llm better at coding if it has access to the latest documenta…
Please give me your best tips for fine tuning RTX Pro 6000 on Intel i7-14700KF
So somehow I've stumbled over an RTX Pro 6000 and inserted it Intel i7-14700KF that was hosting my 4…