| Author | Post |
|---|
Dr Trevor Marshall
Research Team
|
Posted: Sun Jun 1st, 2008 07:23 |
|
The 'answers' site at CureMyTh1.org has been out of action for most of the evening. There was a fire in a transformer at the data center in Texas. Apparently, no files have been lost, and, as soon as we can get acess to the old server, we will move the website to the same datacenter in Missouri where this Study Site runs.
The http://AutoimmunityResearch.org site runs off a totally different server in Los Angeles. So, one way or other, you should be able to contact us at all times.
Sorry for the inconvenience 
|
Dr Trevor Marshall
Research Team
|
Posted: Sun Jun 1st, 2008 08:15 |
|
Here is the status report:This evening at 4:55pm CDT in our H1 data center, electrical gear shorted, creating an explosion and fire that knocked down three walls surrounding our electrical equipment room. Thankfully, no one was injured. In addition, no customer servers were damaged or lost.
We have just been allowed into the building to physically inspect the damage. Early indications are that the short was in a high-volume wire conduit. We were not allowed to activate our backup generator plan based on instructions from the fire department.
This is a significant outage, impacting approximately 9,000 servers and 7,500 customers. All members of our support team are in, and all vendors who supply us with data center equipment are on site. Our initial assessment, although early, points to being able to have some service restored by mid-afternoon on Sunday.
I will start the shift of the CureMy site to this new server in Missouri, so that in a few hours you should see a simple page saying that our CureMy site will be back online as soon as I can retrieve a copy of our files from the old server, which should be sometime tomorrow afternoon, I guess 
|
Dr Trevor Marshall
Research Team
|
Posted: Sun Jun 1st, 2008 18:34 |
|
The CureMy site is now functional on the new server in Missouri, I have a backup from 4 May running in a test mode.
Everything looks OK, and I am waiting for access to the latest message board files from the old server. At that point the CureMy site will be back in full operation.
|
Dr Trevor Marshall
Research Team
|
Posted: Mon Jun 2nd, 2008 06:11 |
|
The original server at the Texas data center is still not back online. I have the new Missouri site running, but am waiting to update the membership and messages databases. The server providers expect to make the older server available so I can copy that stuff later this evening.
This has taken out a larger section of the Internet than was initially suspected. The outage is being blamed on a Fire Chief who insisted that all power, including standby generators, be turned off before his men would enter the building. Which wasn't in the center's disaster recovery plan, apparently.
I am toying with the idea of putting another server on line in Los Angeles which could be used for emergency communication should our Missouri datacenter ever experience a similar problem (I am told it is supposed to be tornado-proof).
|
Dr Trevor Marshall
Research Team
|
Posted: Mon Jun 2nd, 2008 16:30 |
|
At 5am PST on Monday June 1 the old server was put back on line in Texas, and I was able to establish communication with it so I could copy the database to the new server in Missouri. We are now operational at that new host, which (hopefully) has a better disaster recovery plan than the old host in Texas.
So I am sorry for the problems, but the CureMyTh1.org site is operational again - Enjoy!
|
Current time is 04:25 | |
|
