All Systems Operational

About This Site

Scheduled maintenance and outage information for cloud.gov customers

GovCloud Operational
Applications ? Operational
API ? Operational
Dashboard ? Operational
Login ? Operational
Logs front end ? Operational
Logs intake and storage ? Operational
Service - CDN (cdn-route) ? Operational
Service - Relational databases (RDS) ? Operational
Service - S3 ? Operational
Service - Service account ? Operational
East/West Operational
Applications ? Operational
API ? Operational
Dashboard ? Operational
Login ? Operational
Logs intake and storage Operational
Logs front end ? Operational
Service - Relational databases (RDS) ? Operational
Service - S3 ? Operational
Services cloud.gov depends on Operational
AWS EC2-us-west-1 ? Operational
AWS EC2-us-east-1 ? Operational
AWS EC2-us-west-2 ? Operational
AWS CloudFront ? Operational
AWS ELB-us-east-1 ? Operational
AWS ELB-us-west-1 ? Operational
AWS ELB-us-west-2 ? Operational
AWS RDS-us-east-1 ? Operational
AWS RDS-us-west-1 ? Operational
AWS RDS-us-west-2 ? Operational
AWS S3-us-standard ? Operational
AWS S3-us-west-1 ? Operational
AWS S3-us-west-2 ? Operational
Operational
Degraded Performance
Partial Outage
Major Outage
Maintenance
System Metrics Month Week Day
GovCloud: API Response Time
Fetching
GovCloud: Login Response Time
Fetching
East/West: API Response Time
Fetching
East/West: Login Response Time
Fetching
Past Incidents
Mar 28, 2017

No incidents reported today.

Mar 27, 2017
Completed - The scheduled maintenance has been completed.
Mar 27, 10:18 EDT
In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.
Mar 27, 09:30 EDT
Scheduled - During this maintenance window we will be upgrading the component responsible for this incident. We have already performed the actions listed in the postmortem and this component is no longer responsible for providing DNS to the platform or customer applications.

We do not expect any platform disruption during this window.
Mar 24, 11:46 EDT
Mar 26, 2017

No incidents reported.

Mar 25, 2017

No incidents reported.

Mar 24, 2017

No incidents reported.

Mar 23, 2017
Completed - The scheduled maintenance has been completed.
Mar 23, 21:37 EDT
In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.
Mar 23, 21:00 EDT
Scheduled - cloud.gov API actions (including command line interface commands and dashboard features) in the GovCloud environment will be intermittently unavailable and return errors while we do scheduled maintenance for the platform.

During this time, you should not run command line interface commands or take actions on the dashboard. For example, if you try to restage or restart an app, the deploy may return errors and fail, causing an outage for your application with no way to restart it until the maintenance is complete.
Mar 22, 12:40 EDT
Mar 22, 2017

No incidents reported.

Mar 21, 2017

No incidents reported.

Mar 20, 2017

No incidents reported.

Mar 19, 2017

No incidents reported.

Mar 18, 2017

No incidents reported.

Mar 17, 2017
Resolved - The dashboard session store has been restored, and the dashboard is available again.
Mar 17, 12:39 EDT
Investigating - The Govcloud dashboard is currently unavailable. Users may see the message "Timeout" when trying to access the dashboard. We've identified the issue is related to our Redis session store and are currently investigating a fix. Sorry for the inconvenience.
Mar 17, 11:49 EDT
Mar 16, 2017

No incidents reported.

Mar 15, 2017

No incidents reported.

Mar 14, 2017
Postmortem - Read details
Mar 14, 15:07 EDT
Resolved - We've identified a previously undocumented dependency between components of cloud.gov which was causing unexpected outages when certain key dependencies were updated. We will be making both a short-term change to stop this from happening again, and a longer-term change which will remove the need for these components to talk to each other.
Mar 14, 00:29 EDT
Identified - As of 10:16 am ET, Applications that were previously down now seem to be available in a stable way (if you have a CDN, it may take a few minutes or refreshes to clear the cached error). We have identified this as likely a platform component deployment issue, and we’re continuing to monitor and analyze the platform until we’re confident that this will not re-occur.
Feb 28, 10:42 EDT
Investigating - As of 10:02 am ET, some applications in the GovCloud environment are down and reporting errors (such as “Requested route does not exist”), and connecting to the platform is returning errors such as “Please ask your Cloud Foundry Operator to check the platform configuration” We are investigating this problem and we will provide updates as we identify it and resolve it.
Feb 28, 10:06 EDT
Update - Maintenance has been completed. We are continuing to monitor the platform to ensure the incident has been fully resolved.
Feb 25, 04:48 EDT
Update - Update: We’re currently doing maintenance in the GovCloud environment. During this maintenance period, you should not push updates to apps or restart them, because the deploy may return errors and fail, causing an outage for your application with no way to restart it until the maintenance is complete. This work should be complete within a few hours, and we’ll post an update when finished. Hopefully this is outside of work hours for you, but we do apologize for the unscheduled maintenance.
Feb 24, 21:58 EDT
Monitoring - Apps continue to be available consistently. We are reproducing the problem in another environment to confirm our hypothesis of the root cause.
Feb 24, 13:51 EDT
Identified - Applications that were previously down have been intermittently available for about 20 minutes and now seem to be available in a stable way (if you have a CDN, it may take a few minutes or refreshes to clear the cached error). We have identified this as likely a platform component deployment issue, and we’re continuing to monitor and analyze the platform until we’re confident that this will not re-occur.
Feb 24, 13:42 EDT
Investigating - As of 12:40 pm ET, some applications in the GovCloud environment are down and reporting errors (such as “Requested route does not exist”), and connecting to the platform is returning errors such as “Please ask your Cloud Foundry Operator to check the platform configuration” We are investigating this problem with all hands on deck, and we will provide updates as we identify it and resolve it.
Feb 24, 13:15 EDT