Background Jobs

FastAPI BackgroundTasks looks convenient but has real limits. When it’s enough, when you need a real queue, and how to migrate without disrupting users.

Picking a Python background job system in 2026. arq for async-native + Redis, Dramatiq for simple + reliable, Taskiq for typed tasks across brokers, Celery for legacy and giant ecosystems. With code, patterns, and a clear decision rule.

A practical Celery guide: brokers, workers, idempotent task design, retries with backoff, scheduled jobs, and the production setup that actually scales.