Opened on Saturday 13th March 2021, last updated
Resolved — All services are now back online and operating normally at full capacity. We will continue to closely monitor the situation and provide any updates if anything changes.
Monitoring — Our cloud provider is rolling out a resolution to fix the issue with our database. We are monitoring the situation closely and will slowly bringing services back online as soon as it is appropriate.
Identified — Our cloud provider has notified us that their engineering team is actively working on restoring our database. We are pushing for the fastest resolution possible that retains all our customer data. Unfortunately, we still do not have a definitive ETA and will continue posting updates as we have them.
Identified — We have received guidance from our cloud provider that this issue will not be resolved until tomorrow. Our plan to restore from a backup is not working because of additional related errors with the DigitalOcean system. At this point, their support team is unable to provide any additional assistance and we are waiting for their internal engineers to be back in the office on Monday morning.
Identified — We are continuing to communicate with our cloud provider but they have been unable to provide a resolution. We are now attempting to restore the database from a backup but the DigitalOcean system is running into issues. We sincerely apologize for this and are doing everything we can do bring services back online as soon as possible. Unfortunately, we are dependent upon our cloud provider at this time and cannot provide an estimate of when everything will be back up. We will continue to post updates as we have them.