Keboola - Delayed flow execution on AWS EU (eu-central-1) – Incident details

Delayed flow execution on AWS EU (eu-central-1)

Resolved
Partial outage
Started 16 days agoLasted 5 hours 51 minutes

Affected

AWS EU (eu-central-1)

Partial outage from 4:00 AM to 9:51 AM

Updates
  • Resolved
    UTC
    Resolved

    The issue affecting flows on the AWS EU (eu-central-1) stack has been resolved. An internal component responsible for advancing flows between phases was overloaded, which caused flows to remain in the processing state after their first phase. We have applied a fix and processed the backlog, and flows are running normally again.

    Flows that were delayed have continued automatically and do not need to be re-run. If you manually terminated a flow during the incident, please start it again.

    We are sorry for the inconvenience and are working on a permanent fix to prevent this from happening again.

  • Investigating
    UTC
    Investigating

    We are investigating an issue affecting flows on the AWS EU (eu-central-1) stack. Flows may stay in the processing state after their first phase finishes, and the next phases start with a significant delay or not at all. Individual jobs and legacy orchestrations are not affected.

    Our engineering team is investigating the issue. We will provide an update within 30 minutes.