Resolved -
Since we deployed our fixes at approximately 5:27 PM ET, the Cloud.gov team has observed no further indications of failures from the services that manage AWS resources. All customer-facing services and service brokers should be fully operational. If you are still experiencing issues, please contact us at support@cloud.gov.
As always, the Cloud.gov team will be conducting a post-mortem analysis of this incident in the coming days. We will share our findings and next steps once our analysis is complete.
Jun 12, 09:25 EDT
Monitoring -
All services on Cloud.gov that manage AWS resources should now be operational. If you are still experiencing issues, please contact us at support@cloud.gov.
Jun 11, 17:27 EDT
Identified -
The Cloud.gov team has identified the cause of the outage as inadvertent access key rotation for Cloud.gov applications that manage AWS resources, such as service brokers for RDS databases.
The AWS access keys themselves that customers use to access their resources (e.g. RDS databases, S3 buckets) **are unaffected and are still working**.
The Cloud.gov team is actively working to restore functionality for services that manage AWS resources.
Jun 11, 14:48 EDT
Investigating -
Service brokers that Cloud.gov customers use to manage AWS resources (e.g. RDS, S3, etc) are currently experiencing an outage. The Cloud.gov team is investigating and will provide further updates as we know more.
Jun 11, 13:52 EDT