Acme Status
← All incidents
Partial Resolved

Elevated error rate

Nov 5 · 02:19 UTC Affected Background Jobs Duration 20 min
02:19 UTC
+0 min
Investigating

We are seeing an elevated rate of 5xx responses from Background Jobs in one region and are investigating.

02:25 UTC
+6 min
Identified

The cause has been traced to a recent configuration push. A rollback is in progress.

02:32 UTC
+13 min
Monitoring

Rollback complete. Error rates have returned to baseline; we are monitoring for recurrence.

02:39 UTC
+20 min
Resolved

The incident is resolved. No customer data was affected.

Root cause

A configuration change to the gateway in one region set an invalid upstream timeout, causing it to drop connections under load. We have added validation to the config pipeline and a canary stage before regional rollout.