Llama.ccp
Someone should create llama.ccp (not .cpp) that support LLMs on Chinese-native hardware (like Huaweiβ¦
AI tools, cybersecurity and development news aggregated from top sources β saved permanently with unique URLs.
Llama.ccp
Someone should create llama.ccp (not .cpp) that support LLMs on Chinese-native hardware (like Huaweiβ¦
Man trains local model to detect and kill mosquitos with a laser
Now this is local AI innovation we can all get behind. https://x.com/stevencheng/status/20598367384β¦
I hate to be this guy but: Any good, recent CODING models in the 70-80B range?
3x 24GB vram. Qwen-coder-next is not bad. I'll continue to use it if you yell enough at me. I do a β¦
Browser Use
Currently using cloud models for my browser use and itβs great when it works but itβs one of the lasβ¦
MiniCPM5 1B - what is it?
https://huggingface.co/openbmb/MiniCPM5-1B What even is this thing? MiniCPM 4.6 was a tuned Qwen 3.5β¦
I spent months inside verl (an RL post-training framework), forked it, then stopped. Wrote up the internals, the tooling a fork costs, and a nasty NCCL bug.
I wasn't sure whether to post this here or not but a friend of mine said that a lot of researchers lβ¦
Stop asking what model to run. There are literally only two.
Can we please ban the daily "I have an RTX 3060, what should I run?" slop threads? Itβs not complicaβ¦
3060 12gb
best open Model quant that run in 3060 12gb and it's equivalent closed model in speed and time , forβ¦
RTX Spark does not have 600GB/s Bandwith
Check the slides from Computex. Every outlet that reported 600GB/s is completely wrong. That is the β¦
Stepfun 3.7 Flash: Sonic-like platformer
System Prompt: You are an expert software developer. Prompt: Task: make a Sonic The Hedgehog-like plβ¦
Qwen 3.6 27B kick balls
This is more of a quick appreciation post for Qwen 3.6 27B running locally (8-bit unsloth quant). I'β¦
ICYM: llama.cpp b9455 --SM Tensor KV Cache Fix is MERGED
Them boys can cook, one big fix after another! If you're running --sm tensor on multi-gpu this is thβ¦