r/LocalLLaMA

Tencent compressed Hy4-preview from 1.5TB to about 200GB GGUF and kept about 98% performance.

submitted by /u/RedditUsr2 [link] [comments]…

Someone tested various Models on the Political Compass test...

submitted by /u/Thrumpwart [link] [comments]…

Exo labs claiming 4.8 tb/s memory bandwidth through m5u Mac Studio clustering

Exo labs making some very exciting and interesting claims. The headline is bandwidth scales linearly…

Qwen 3.8 27B at 50 tok/s with 100k Context on a 16GB GPU! (beellama.cpp)

I wanted to share my successful setup for running a Qwen 3.8 27B model with a massive context window…

How important is it for Chinese LLMs to reach the Opus 4.8 level?

In mid-August, Ramp published spending data collected from 70,000 U.S. companies: Fable 5 ,the most …

If your t/s is low enough, you can see speculative decoding with your own eyes

The other day I was trying out a distillation of DS4 Pro, and it came with MTP. It was slow as hell …

I always wonder how much more speed and/or context they'd be getting..

Nothing personal. I just have too much time on my hands. Probably because I spend none of it inspect…

Terminal Bench 4.0 just dropped, GLM-5.3 is at the same level as Fable 5, accounting for margin of error

Announcement: https://www.tbench.ai/news/terminal-bench-4-0 Leaderboard: https://www.tbench.ai/ Imo …

We’re the Team Behind Apodex 1.1 — Ask Us Anything!

Hi r/LocalLLaMA ! We’re Apodex, the team behind Apodex 1.1, our new model family built to scale agen…

[Megathread] GLM-5.3-Flash - former ox-alpha

Megathread for discussing the release of GLM-5.3-Flash. Quants Fine-Tunes & Abliterations Chat Temp…

Best Local Vision Language Models - August 2026

Share what your favorite models are right now and why. Given the nature of the beast in evaluating V…

Qwen 3.8 27b with DSH(DeepSeek Harness) is Amazing!! Experiences so far and perfomance.

https://preview.redd.it/wkg27e152qjh1.png?width=853&format=png&auto=webp&s=2e3f8b11ea6393041f501e95c…