Why I moved my entire LLM pipeline from sync HTTP handlers to a job queue, and the 502 errors that finally pushed me

Sharing a postmortem of an architecture migration that took me too long to do, in case anyone’s still running an AI pipeline directly inside their HTTP handlers. The setup I run an AI pipeline that does multi-step LLM wo