We will no longer post service status updates here. Please visit our GitHub Discussions page for up-to-date information about service availability and planned maintenance work: https://t.co/dr9W9Y3AAe
Investigating:
We are experiencing connectivity issues with our Mac Pro and Intel Mac mini machines. As a result, build queues on these machines are likely to be longer than usual. You may consider using M1 machines instead until the issue is resolved.
Update: The service is stable again. We haven’t seen any issues with database performance in the past hour. However, we will continue monitoring to ensure everything remains stable.
Update: We have tracked down the issue to database performance. While we were able to improve the general performance of the service, we can still see some queries taking longer than usual. We are continuing to investigate the root cause of the problem.
Monitoring: The service is functional again but we will continue monitoring to make sure it’s performing well. The build queue is slightly longer at the moment but all builds are expected to start soon.
Upcoming maintenance
On Jan 27, 2023, between 12:00-3:00 AM ET (5:00-8:00 AM UTC), our data center partner will be performing network infrastructure updates affecting the availability of our M1 and Intel macOS build machines. The expected downtime is approximately 15-20 minutes.
Upcoming maintenance
On Jan 27, 2023, between 12:00-3:00 AM ET (5:00-8:00 AM UTC), our data center partner will be performing network infrastructure updates affecting the availability of our M1 and Intel macOS build machines. The expected downtime is approximately 15-20 minutes.
Monitoring: Logs should now appear in the UI normally. We will continue to monitor the situation and make further efforts to optimize and improve the logs processing. Thank you for your patience!
During the holidays we are mostly out of office and you can expect a reply back when we return 🙂 We wish you a Merry Christmas 🎄 and a Happy New Year! ✨🍾
We are terribly sorry that this happened and will continue to work hard to avoid such situations in the future. If you have any questions or concerns, do not hesitate to get in touch with us.
Security Incident
On December 5, we became aware of a security vulnerability in one of our storages which allowed unauthorized access to list all objects in the storage, including private user data. Read about the incident details and our response here: https://t.co/5C8oOfP98i
RESOLVED: The issue has been resolved now and all builds should start shortly. We will nevertheless keep a close eye on things and will continue to monitor the situation. Thank you for your patience!
Ongoing incident: we are experiencing network issues affecting all macOS hosts. Data center engineers are working to solve the problem as soon as possible.
We will post an update once we have more details. Sorry for the inconvenience!
The codemagic.yaml file and branches are loaded fine now and we believe the issue is resolved. We will nevertheless keep a close eye on things and will continue to monitor the situation.
Ongoing incident: Some users may be experiencing issues with loading the codemagic.yaml file and branches. We are investigating the issue and will share an update once we have more information.