Info: Nvidia Cuda 13.3 landed
Cuda 13.3 Downloads Release Notes Anybody already tried llama.cpp with 13.3? submitted by /u/pβ¦
AI tools, cybersecurity and development news aggregated from top sources β saved permanently with unique URLs.
Info: Nvidia Cuda 13.3 landed
Cuda 13.3 Downloads Release Notes Anybody already tried llama.cpp with 13.3? submitted by /u/pβ¦
Found a Rust TUI coding agent that aggressively trims context with AST-level chunking. Cut my token bleed sharply with DeepSeek V4 Flash.
been hunting for a coding agent that doesn't dump my entire directory tree into every prompt. found β¦
Hyvemind OSS - Looking for some testers
Hey Llamas, I have been building this product for the last couple of months, initially for my own usβ¦
Intel b60 48gb?
2k AUD for a 48gb card, itβs certainly lodged itself into my brain. But thereβs very little in this β¦
Looks like Miminax-M3 is just around the corner
As per Minimax_AI twitter https://x.com/MiniMax_AI/status/2059286515155599595 I hope it will speed uβ¦
New DeepSWE benchmark finds Claude Opus cheats
Sadly the open models seem far behind. submitted by /u/DeltaSqueezer [link] [comments]β¦
I made a small tool to inspect retrieval results before feeding them into RAG
Iβve been messing around with live web retrieval for RAG, and the part that kept annoying me wasnβt β¦
Turning every "no thats not what i meant" in chat into actual LoRA training data
i kept running local models on my own hardware, they'd say something dumb, id sit there going "no thβ¦
Does Engram Do Memory Retrieval in Autoregressive Image Generation?
Paper: https://arxiv.org/abs/2605.13179 Abstract: The Engram moduleβa hash-keyed, Oβ(1) associativeβ¦
Folks running qwen 3.6 27b for agentic work. Do you dare to use q4_k_m?
I dont have good experience running q4_k_m, the difference to q6 is "a few errors an hour" to " a feβ¦
Add MiniCPM5 tokenizer support by zhangtao2-1 Β· Pull Request #23384 Β· ggml-org/llama.cpp
Model & GGUF to try: https://huggingface.co/openbmb/MiniCPM5-1B https://huggingface.co/openbmb/MiniCβ¦
Engine claimed 3x speedup compared to MLX
So, I was looking around at local engines, and came across runanywhere.ai. The website has a couple β¦