r/LocalLLaMA 🤖 Ai 👁 1

Mistral Medium 3.5 on AMD Strix Halo

TLDR; it's slow as heck. Run overnight. I asked it a question about codebase architecture. For an end-to-end prompt of 48k tokens + 4k thinking tokens, it took about 2 hours. llama-server -hf unsloth/Mistral-Medium-3. 5-

📄

This source provides headlines only. Use the button below to read the complete article on the original site.

📰 Read the original article on r/LocalLLaMA

Originally published by r/LocalLLaMA. Aggregated on AIWithGhost for educational purposes — full credit and traffic to the original publisher.