I keep coming back to Qwen... Over and Over. Is there really nothing better under 120B?
I was looking for a strong coding model and a strong general model, both should be 120b or under. Afβ¦
AI tools, cybersecurity and development news aggregated from top sources β saved permanently with unique URLs.
I keep coming back to Qwen... Over and Over. Is there really nothing better under 120B?
I was looking for a strong coding model and a strong general model, both should be 120b or under. Afβ¦
"Uncensored" LLMs are measurably more optimistic than their base models
Hi. Many people think uncensored models are basically the same model that just doesn't refuse, but..β¦
The idea: on a CPU the decode speed depends on the active params per token, not the total. My objective is trying to run a 10B at 100tok/s on a mid level PC (No GPU).
On the CPU, batch 1 is memory bandwidth bound. But if token/s = bandwidth / (bytes_per_weight * actiβ¦
Understand Kimi K3 from first principles: a recommended order for anyone trying to understand this beast
Everyone is talking about Kimi K3, but if you jump straight into the technical report, youβll quicklβ¦
A slide deck you can edit with a local model or in Chrome β the whole deck is a JSON block in one HTML file (~640KB with editor and viewer included)
Over the past few months, our team has been building more and more slidedecks using web frontend tecβ¦
Microsoft did it .... again! (404 for their Mage-Flow models on HF)
Still you could grab GGUF, MLX, FP8, etc., from others on HuggingFace. https://huggingface.co/modelsβ¦
I built a GBNF grammar compiler that makes 8B models reliably call tools - here's how it works (deep dive)
I've been building a local agent in Rust (Eris) that runs on llama.cpp and uses an Obsidian-compatibβ¦
Is Laguna s2.1 fixed?
Laguna s2.1 launched about a week ago, the benchmark's that they advertised were crazy good. But It β¦
Built and released BetterGPT-150M β A compact 150M parameter completion model (+ live HF Space demo)
Hey everyone, βI recently finished pre-training BetterGPT-150M, a small, lightweight causal languageβ¦
dropped 4k on a spark, am I crazy?
Saw that the Asus Ascent 1tb was going for $3,950 from a few sources, couldn't stop thinking about iβ¦
Anyone tried the Q1 Kimi K3 yet? (555GB)
submitted by /u/Hannibalj2ca [link] [comments]β¦
A.X-K2 released
https://huggingface.co/skt/A.X-K2 https://huggingface.co/skt/A.X-K2-ALM https://huggingface.co/KRAFTβ¦