Update - From 3:51 PM ET to 3:56 PM ET, we detected another large-scale DDoS attack against the platform. Thanks to the currently deployed mitigations, the platform did not experience a full outage, but customers may have experienced elevated error rates from their applications.
Apr 15, 2024 - 16:22 EDT
Apr 15, 2024 - 16:22 EDT
Monitoring - Incident Summary
Throughout the past week, our platform has been subject to ongoing Distributed Denial of Service (DDoS) attacks, as evidenced by the previous StatusPage updates.
Thanks to our security measures and platform automation, the platform was able to recover from those attacks in under five minutes, so we immediately marked all of those previous incidents as “Resolved”. To be clear, even though we considered those incidents resolved, our investigation into their causes and how to mitigate them more effectively remains ongoing.
Since these attacks are still ongoing and varying in scale, it is possible there could be further disruptions to our platform. To centralize and to improve our communications on these incidents, we will leave this particular incident open and will update it with announcements of any further outages or implemented mitigations.
Incident Details - DDoS attack
Time Detected: 4/15/2024 8:45 AM ET
Duration: Around 2 minutes
Impact: Users may have experienced slow response times or elevated rates of 502 error responses during the attack.
Resolution: Our automated DDoS protection systems quickly identified and mitigated the attack, restoring normal service operations without significant impact.
Actions Taken
In response to these ongoing attacks, we have implemented changes to the scaling of our platform infrastructure and the way that malicious traffic is intercepted.
Since these measures are being deployed actively in response to ongoing attacks, we cannot specify exactly what they are, but hopefully once these attacks subside we can provide further clarity.
Next Steps
We will continue to monitor our systems closely and adjust our security measures as needed. We will keep our users updated on any relevant developments or preventive measures being implemented.
Once the attacks have subsided or have been sufficiently mitigated, our team will conduct a post-mortem analysis of these incidents in order to identify any potential improvements to our security posture or our incident response techniques and processes.
We will publish a summary of our post-mortem with the findings of our investigation once it is complete.
Acknowledgment
We appreciate your understanding and patience during this incident. The swift resolution of this DDoS attack underscores our commitment to providing a secure and reliable platform. If you have any concerns or questions, please do not hesitate to contact our support team at support@cloud.gov.
Thank you for your continued trust in cloud.gov.
Apr 15, 2024 - 11:45 EDT
Throughout the past week, our platform has been subject to ongoing Distributed Denial of Service (DDoS) attacks, as evidenced by the previous StatusPage updates.
Thanks to our security measures and platform automation, the platform was able to recover from those attacks in under five minutes, so we immediately marked all of those previous incidents as “Resolved”. To be clear, even though we considered those incidents resolved, our investigation into their causes and how to mitigate them more effectively remains ongoing.
Since these attacks are still ongoing and varying in scale, it is possible there could be further disruptions to our platform. To centralize and to improve our communications on these incidents, we will leave this particular incident open and will update it with announcements of any further outages or implemented mitigations.
Incident Details - DDoS attack
Time Detected: 4/15/2024 8:45 AM ET
Duration: Around 2 minutes
Impact: Users may have experienced slow response times or elevated rates of 502 error responses during the attack.
Resolution: Our automated DDoS protection systems quickly identified and mitigated the attack, restoring normal service operations without significant impact.
Actions Taken
In response to these ongoing attacks, we have implemented changes to the scaling of our platform infrastructure and the way that malicious traffic is intercepted.
Since these measures are being deployed actively in response to ongoing attacks, we cannot specify exactly what they are, but hopefully once these attacks subside we can provide further clarity.
Next Steps
We will continue to monitor our systems closely and adjust our security measures as needed. We will keep our users updated on any relevant developments or preventive measures being implemented.
Once the attacks have subsided or have been sufficiently mitigated, our team will conduct a post-mortem analysis of these incidents in order to identify any potential improvements to our security posture or our incident response techniques and processes.
We will publish a summary of our post-mortem with the findings of our investigation once it is complete.
Acknowledgment
We appreciate your understanding and patience during this incident. The swift resolution of this DDoS attack underscores our commitment to providing a secure and reliable platform. If you have any concerns or questions, please do not hesitate to contact our support team at support@cloud.gov.
Thank you for your continued trust in cloud.gov.
Apr 15, 2024 - 11:45 EDT
About This Site
Scheduled maintenance and outage information for cloud.gov customers
cloud.gov customer applications
Operational
Applications
?
Operational
Logs intake and storage
?
Operational
Service - CDN (cdn-route)
?
Operational
Service - Relational databases (RDS)
?
Operational
Service - S3
?
Operational
Service - Service account
?
Operational
Redis
?
Operational
Elasticsearch
?
Operational
Service - Custom Domain Service
Operational
External domain service
?
Operational
External domain service - CDN
?
Operational
cloud.gov customer access
Operational
Dashboard
?
Operational
Logs front end
?
Operational
Login
?
Operational
API
?
Operational
cloud.gov Pages
Operational
Web Application
?
Operational
Builds
?
Operational
Hosted Sites
?
Operational
Services cloud.gov depends on
Operational
AWS CloudFront
?
Operational
AWS elb-us-gov-west-1
?
Operational
AWS s3-us-gov-west-1
?
Operational
AWS rds-us-gov-west-1
?
Operational
AWS ec2-us-gov-west-1
?
Operational
AWS elasticsearch-us-gov-west-1
?
Operational
AWS elasticache-us-gov-west-1
?
Operational
GSA SecureAuth
?
Operational
GSA Corporate Email
Operational
cloud.gov website
?
Operational
cloud.gov compliance notification
?
Operational
Services cloud.gov Pages depends on
Operational
GitHub
Operational
GitHub Webhooks
Operational
Operational
Degraded Performance
Partial Outage
Major Outage
Maintenance
Major outage
Partial outage
No downtime recorded on this day.
No data exists for this day.
had a major outage.
had a partial outage.