Processing delays

Aug 11 · 04:46 UTC Affected Web App Duration 3 h 28 min

04:46 UTC

+0 min

Investigating

Web App is taking longer than usual. Requests are accepted but results are delayed.

05:48 UTC

+1 h 02 min

Identified

A spike in large uploads has created a backlog. Additional workers are being added.

07:01 UTC

+2 h 15 min

Monitoring

The backlog is draining; median processing time is back to normal.

08:14 UTC

+3 h 28 min

Resolved

All queued work has been processed. No data was lost.

Root cause

A burst of unusually large uploads exceeded the worker pool's autoscaling ceiling. The ceiling has been raised and large files now route to a dedicated queue.