othelloRob
30th December 2006, 08:51
Friday 29/December 4.32 am we suffered a disk failure in Othello::Host::Reseller CPanel2.
This affects a number of our cpanel/whm based resellers (ips x.y.z.240 to x.y.z.246).
The server halted with a kernel panic when it couldn't find one of the drives.
Server was brought back up with a replacement hard drive, and the RAID-1 mirror rebuilt.
Sadly a few of the files that were open at the time of the panic were corrupted, including the /etc folder holding the .conf files (server, website, ftp, email and cpanel setups)
This has meant a manual rebuild of apache, php, mysql and a restore from the previous nights backup of the site lists, as well as a forced cpanel reinstall, reapplying all our updates, etc.
This meant reduced levels of service for several hours as features and services were fixed, with the majority up and running by 9.20, full operation of everything was completed at 18.29.
As PHP and Apache needed rebuilding, they were both upgraded to latest stable versions of the same branch, so PHP has gone from 4.4.3 to 4.4.4 - please create a support ticket if you find any scripts no longer working as expected. We have several other servers running 4.4.4 with no known issues.
Please can you check that any recently (last 48 hours) added subdomains and addon-on domains are present in your CPanel accounts, and if you have added any new sites since Thursday 28/December, if they are not working correctly, you will need to delete them and add them again in your reseller WHM for the configuration files to pick up the new details.
This affects a number of our cpanel/whm based resellers (ips x.y.z.240 to x.y.z.246).
The server halted with a kernel panic when it couldn't find one of the drives.
Server was brought back up with a replacement hard drive, and the RAID-1 mirror rebuilt.
Sadly a few of the files that were open at the time of the panic were corrupted, including the /etc folder holding the .conf files (server, website, ftp, email and cpanel setups)
This has meant a manual rebuild of apache, php, mysql and a restore from the previous nights backup of the site lists, as well as a forced cpanel reinstall, reapplying all our updates, etc.
This meant reduced levels of service for several hours as features and services were fixed, with the majority up and running by 9.20, full operation of everything was completed at 18.29.
As PHP and Apache needed rebuilding, they were both upgraded to latest stable versions of the same branch, so PHP has gone from 4.4.3 to 4.4.4 - please create a support ticket if you find any scripts no longer working as expected. We have several other servers running 4.4.4 with no known issues.
Please can you check that any recently (last 48 hours) added subdomains and addon-on domains are present in your CPanel accounts, and if you have added any new sites since Thursday 28/December, if they are not working correctly, you will need to delete them and add them again in your reseller WHM for the configuration files to pick up the new details.