r/LocalLLaMA

A Java LLM implementation based on Karpathy's GPT with alpaca_es_chat.jsonl

Hello everyone, I wanted to share my progress on implementing a language model written 100% in pure …

Motion graphics video made with Qwen3.8 Flash Next GSQ RCO IQ3_XXS on strata

I've seen the insane motion graphics videos people made when opus 5.5 first came out and wondered ho…

The Qwen Flash Next alibaba URL thing happened to me too just now

It seems to have really confused itself too 😭 I was having it make a sort of Github release checker …

Rumor: Moonshot Kimi roadmap

EOY 2026: Kimi K3 Flash, will replace Kimi K2.8 and compete with DeepSeek V4.1 Flash. Early 2027: Ki…

Artificial Analysis: multimodal decision model Drex Max ranks #1. Both achieving SOTA and Pareto frontier.

hey, its Alti from Nace. We released a small update with Drex Max v1.1, both achieving the SOTA and …

Upgraded Your GPU? Don't Sell the Old One. Put Both to Work Running Local LLMs.

Friendly reminder: If you upgraded to a newer GPU, don't let your old one collect dust! You can run …

tencent/Qwen3.8-27B-DSpine-b16 · Hugging Face

Apparently Tencent has developed a new speculative decoding method. 3x faster decoding for 27B model…

4x Radeon AI PRO R9700 + 2x RTX 3090 on one x16 slot, using a PCIe switch

submitted by /u/bolts98 [link] [comments]…

I ran Qwen3.5-0.8B in pure Assembly

On an AMD EPYC 7B12, it generated 6.51 tokens/sec on one CPU thread. The Transformers reference reac…

I fine-tuned Qwen3.5-0.8B to turn plain English into bash. What I learnt

Running the app I wanted a terminal helper that works fully offline, so I started building dale. You…

Has anyone used tensortorrent?

I was interested in buying a card as they are the only company that has a good GPU GPU communicatio…

"Does censorship exist in [country]?", according to various LLMs

I wrote a small program that asks the same Yes/No question about every country to a language model, …