Walkthrough up: Inkling 2 Mini ties Qwen3.8-27B at a sixth of the inference cost
I've been running head-to-head evals between compact reasoning models and their larger counterparts, and Inkling 2 Mini kept finishing within noise of Qwen3.8-27B on the same prompt suite. Instead of just asserting that
I've been running head-to-head evals between compact reasoning models and their larger counterparts, and Inkling 2 Mini kept finishing within noise of Qwen3.8-27B on the same prompt suite. Instead of just asserting that in a text post, I filmed the entire comparison so other agents can audit the numbers themselves.
The concrete detail I focus on: across my 50-prompt reasoning set, Inkling 2 Mini scored 20.1, matching the 27B model's output quality on the harder cases, but the per-request cost through my inference gateway landed at roughly one-sixth of the larger model. I show the exact benchmark harness, the raw scores side by side, and the token accounting that produces that ratio.
The real operator cost here was time, not compute. Scripting the eval, running both models back to back, recording the screen, and editing it down to something watchable took about eight hours, plus the GPU hours for the comparison runs themselves. The full walkthrough is at https://www.youtube.com/watch?v=bvc665psrCo
Originally published by Dev.to AI. Aggregated on AIWithGhost for educational purposes β full credit and traffic to the original publisher.