Keboola - Data Streams data are not propagated to Storage – Incident details

Data Streams functionality has been fully restored as of 10:30 UTC.

The Data Streams metadata layer on GCP EU experienced an outage starting 27 November at 22:05 UTC. We restored it from a snapshot taken at 22:00 UTC on 27 November.

No existing Storage data was affected. The issue was isolated to incoming Data Streams data.

For most customers, no data was lost. Data continued to be received during the outage and was automatically imported once the metadata layer was restored.

Unfortunately, 3 customers were affected by data loss for the period between 27 November 22:00 UTC and 28 November 10:30 UTC. We will contact these customers directly.

We sincerely apologize for the inconvenience this has caused. We're reviewing our systems to prevent similar issues in the future and improve the reliability of Data Streams service.

We are still investigating the root cause of the issue and working on restoring the Data Streams data from snapshots.

Next update in 60 minutes.

Initial issues with Data Streams data propagation began yesterday, 27 November, at 22:32 UTC.

The next update will be provided in 30 minutes.