Elevated checkout latency

INC-2841 · opened 09:04 · payments team

Detected
09:04
Acknowledged
09:06
Mitigated
09:38
Duration
37m

Updates

  1. Priya PatelMonitoring09:41

    Connection pool raised to 240 and the failing region drained. Error rate is back under 0.2% and holding. Watching for one more cycle before we call it.

  2. Theo ParkIdentified09:18

    The charge worker exhausted its database pool after a migration left an index rebuild running against the orders table.

  3. On-call rotationInvestigating09:04

    Automated alert fired on p99 checkout latency crossing 8s. Paging the payments team.

Sends to 1,204 status page subscribers