Please let us know if you are experiencing any connection issues with the server!
Aug 28, 2023, update
We thought the planned maintenance went well. We did a long overdue OS and database server update, along with putting some procedures in place that will help with future maintenance and deployments. Unfortunately, some performance issues did not arise until more people helped us test the server. We are planning to temporarily switch back over to the old server tonight, to give us more time to address the issues, since some of the larger databases are experiencing extremely poor performance with a few of the more complicated queries.
Aug 26, 2023, maintenance
The database will be down during evening of August 26, possibly into the overnight hours. We expect to have it back up by the morning of August 27.
July 18, 2019, maintenance
The database will be down during the day and evening of July 18, possibly into the overnight hours. We expect to have it back up by the morning of July 19.
Oct. 13-15, 2018, update
We were experiencing seemingly unexplainable performance issues and tried a variety of updates to get things running smoothly again, putting the server into maintenance mode each morning and doing several restarts (which caused brief connection errors for anyone trying to use the app). We were finally able to resolve the db server startup issue. Also, we were very relieved to finally get an answer about performance from our provider:
We really appreciate how gracious and patient many of you have been this past week, even though frustrated. You can pray with us that these changes will allow this Wednesday night to run smoothly! We'll be monitoring the server closely.
Oct. 12, 2018
Here are the details of the outage, in Central Time:
- 9:34 AM, we realized the database server on app.approvedworkman.com was having issues and started investigating the cause
- 9:58 AM, the server is back online
- 11:00 AM, after experiencing intermittent issues this morning, we put the database server into Maintenance Mode while we work on resolving issues
- 12:01 AM, the server is back online
Oct. 11, 2018
Our cloud server is back online after two and a half hours of being offline. We are so sorry for any inconvenience that this may have caused you. Since things still seem so unstable right now, we are testing some upgrades on our development server now and will update the app server if all goes well. We are desperately trying to figure out why things became so unstable!
Here are the details of the outage, in Central Time:
- 9:34 AM, we had a report that app.approvedworkman.com was having problems, but unfortunately could not get in contact with the people who could resolve the issue (it was a late night last night!)
- 10:50 AM, started investigating the cause of the issue. The problem this morning confirms our thoughts that last night was not a load issue.
- 11:02 AM, we thought things were back working, but after only 15 minutes, it hung again. We restarted the app server, but again, the database server would not start up correctly.
- 12:04 PM, the server is back online
Oct. 10, 2018
Our cloud server is back online after two hours of being unstable and mostly offline. We are so sorry for any inconvenience that this may have caused you. Given the changes we had already made to our hardware which was supposed to alleviate these issues, we are now concentrating with urgency to move to a new system architecture asap. Please know that we don't take this issue lightly and are very concerned in getting the server back to being reliable for you on Wednesday nights!
Here are the details of the outage, in Central Time:
- 5:43 PM, we realized the database server on app.approvedworkman.com was having issues and started investigating the cause
- 6:11 PM, we were unable to get the database server restarted successfully, so we restarted the app server; unfortunately, the database server still had issues; meanwhile our service provider is aware of the issue and is trying to help us resolve it.
- 7:10 PM, we started making progress, but the server was up and down while we tried to get it working smoother and performance back up, since the database server issue seemed to cause our web server to get out of sorts.
- 7:50 PM, working with our provider, we got things back running. The server is back online.
Sept. 12, 2018
Our cloud server is back online after about 35 minutes of being offline. We are sorry for any inconvenience that this may have caused you. The load on Wednesday nights had become too high for our hardware, so we doubled the CPUs and substantially increased the RAM the next morning.
Here are the details of the outage, in Central Time:
- 6:34 PM, we realized app.approvedworkman.com was having issues and started investigating the cause
- 6:50 PM, we realized that CPU and memory loads were getting really high and causing issues. We restarted the server, and since many clubs were finishing up for the night, the server was able to keep up until we were able to better fix the problem
- 7:10 PM, the server is back online
Mar. 28, 2018
Here are the details of the outage, in Central Time:
- 5:38 PM, we realized that app.approvedworkman.com was not responding and started investigating the cause
- 5:42 PM, we determined that the problem was due to cloud provider issues and contacted their support team
- 6:27 PM, our provider resolved a public firewall issue with their cloud cluster and app.approvedworkman.com is now back online
Feb. 6, 2018
Our cloud server is back online after a brief period of being offline. We are sorry for any inconvenience that this may have caused you. Our cloud provider responded relatively quickly to resolve the issue.
We thank you for your patience as the issue was resolved and do not take the inconvenience lightly. We have been fortunate to not have had issues with our provider's service before, so we are optimistic that this will not be a regular occurrence and will extend grace to them as you have to us! We will however monitor the outages and will find a new provider if it ever becomes necessary.
Here are the details of the outage, in Central Time:
- 2:17 PM, we realized that app.approvedworkman.com was not responding and started investigating the cause
- 2:38 PM, we determined that the problem was due to cloud provider issues and contacted their support team
- 2:59 PM, we got a response from the cloud provider that they were working on the issue
- 3:51 PM, our provider found an issue with a service on the host machine causing our server not to start/restart properly
- 4:03 PM, our provider resolved the issue and app.approvedworkman.com is now back online