Service Degradation, Outage and Upgrade
Posted: Sat Feb 19, 2022 4:53 pm
Some of you may have noticed issues with the forum between 6:30pm on Thursday (17th) and about 5:00pm on Friday (18th).
After some investigations it turned out that the forum was being agressively crawled by some random Search Bot which had nailed the server CPU at 100% load.
I've taken steps to block this service but these things are a bit like 'whack-a-mole', when one is blocked another poorly coded will start up knocking on the door.
As I had to restart the webserver anyway I also took the opportunity to apply some outstanding updates and reboot the server completely - some of you may have noticed that the site was inaccessible for a few minutes during this time but the upshot should be more stability etc.
On the subject of upgrades, there is an update to the forum software we are using and I am planning to perform the update over the weekend of 5th/6th March. I have a test instance of the Forum on another server where I will install and test the upgrade package and work out any issues etc but I don't see any major issues coming out of these investigations. I'm also looking at some additional plugins to help reduce the burden on the moderators when it comes to spam registrations & posts.
During the upgrade the forum will be inaccessible for a period of time but I will keep this to a minimum and will post more information a few days before I flick the switch.
After some investigations it turned out that the forum was being agressively crawled by some random Search Bot which had nailed the server CPU at 100% load.
I've taken steps to block this service but these things are a bit like 'whack-a-mole', when one is blocked another poorly coded will start up knocking on the door.
As I had to restart the webserver anyway I also took the opportunity to apply some outstanding updates and reboot the server completely - some of you may have noticed that the site was inaccessible for a few minutes during this time but the upshot should be more stability etc.
On the subject of upgrades, there is an update to the forum software we are using and I am planning to perform the update over the weekend of 5th/6th March. I have a test instance of the Forum on another server where I will install and test the upgrade package and work out any issues etc but I don't see any major issues coming out of these investigations. I'm also looking at some additional plugins to help reduce the burden on the moderators when it comes to spam registrations & posts.
During the upgrade the forum will be inaccessible for a period of time but I will keep this to a minimum and will post more information a few days before I flick the switch.