Summary
On August 21, 2025 from 11:22 AM ET to 11:45 AM ET, some Cloud.gov customers experienced elevated 403 response rates when accessing hosted services. The issue was quickly identified and resolved, and service has remained stable since.
Timeline
- 11:22 AM - a configuration change was applied to traffic filtering rules.
- 11:42 AM - Some customers report elevated 403 response rates
- 11:44 AM - The configuration update was rolled back and error rates returned to normal.
- 11:45 AM - Service confirmed stable following log analysis.
Impact
- Some customers experienced elevated 403 errors between 11:22 AM and 11:45 AM.
- Not all customers were affected due to the nature of the filtering rules.
- For many, the impact was limited or not observed at all.
Resolution
The traffic filtering rule updates were reverted, restoring normal service. Monitoring confirmed that the elevated error rates stopped after the rollback.
Next Steps
- Establish a more formal review process for changes to traffic filtering.
- Define when and how customers should be notified of planned changes.
- Evaluate technical approaches to reduce the potential impact of similar updates.
Thank you for your patience. If you have any questions, please contact us at support@cloud.gov.