AOA Forums AOA Forums AOA Forums Folding For Team 45 AOA Files Home Front Page Become an AOA Subscriber! UserCP Calendar Memberlist FAQ Search Forum Home


Go Back   AOA Forums > Hardware > CRASHED!

CRASHED! A topic for SEVERE and immediate Hardware and Operating System FAILURES. We will try to get you up again. NOT for Optimization questions!


Reply
 
LinkBack Thread Tools Rate Thread
  #1 (permalink)  
Old 1st June, 2008, 02:23 PM
dabaerman's Avatar
Member
 
Join Date: October 2001
Location: Auburn, WA
Posts: 2,101

AOA File Server Down??

haven't been able to get to the files section lately.

Ron
__________________
Folding 24/7 with AMD QuadCore CPU's & nVidia Cuda Powered GPU's

AOA Team fah
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
  #2 (permalink)  
Old 1st June, 2008, 02:47 PM
Chief Systems Administrator
 
Join Date: September 2001
Location: Europe
Posts: 13,075

There are currently issues with the company that hosts some of our equipment and services (This issue affects DNS servers). To cut a long story short, a transformer supplying exploded, destroying three walls in the process. The fire service have allowed people back into the building, and there's a lot of work going on to get things back in a form that will operate. About 9,000 servers have been affected by this.
__________________
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
  #3 (permalink)  
Old 1st June, 2008, 03:02 PM
Samuknow's Avatar
Member
 
Join Date: September 2001
Location: Indianapolis, Indiana
Posts: 8,941
Send a message via MSN to Samuknow

That is way on the wrong side of suck.
__________________
Quote:
Originally Posted by Daniel ~ View Post
It's OKAY WE accept you as you think you are here! ":O}
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
  #4 (permalink)  
Old 1st June, 2008, 11:27 PM
danrok's Avatar
AOA Staff
 
Join Date: March 2003
Location: Great Britain
Posts: 18,917

Is Chris Bard currently holidaying in Texas?
__________________
Desktop PC: AMD FX-8370E / Asus M5A99X Evo R2.0 Motherboard / 16GB DDR3 RAM / GeForce GTX 970
AOA Team fah
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
  #5 (permalink)  
Old 1st June, 2008, 11:38 PM
MUff1N's Avatar
Member
 
Join Date: October 2007
Location: Payson/AZ
Posts: 1,905

Thumbs up Server down for awhile...

Yea I noticed that the server was down since lastnight.
Glad to see it's back up and running!
Other forums just aren't the same as this one and I missed it!
__________________



EVGA GTX 470 SC 37% OC (855/1710/2004) 160.5Gbs
3DMark Vantage: P24352
3DMark 11: P5119
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
  #6 (permalink)  
Old 2nd June, 2008, 12:14 AM
danrok's Avatar
AOA Staff
 
Join Date: March 2003
Location: Great Britain
Posts: 18,917

Ant Invasion?

Crazy rasberry ants invade Houston | Dallas Morning News | News for Dallas, Texas | Home and Gardening | Dallas Morning News

Quote:
They are attracted to electrical equipment. Scientists don't know why. The ants have ruined pumps, fouled computers and caused fire alarms to malfunction.
__________________
Desktop PC: AMD FX-8370E / Asus M5A99X Evo R2.0 Motherboard / 16GB DDR3 RAM / GeForce GTX 970
AOA Team fah
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
  #7 (permalink)  
Old 2nd June, 2008, 12:28 AM
dsio's Avatar
Steve Jobs
 
Join Date: October 2002
Location: Brisbane, QLD, Australia
Posts: 8,037

At this point its hard to say whether or not Chrisbard was responsible for the explosion, but its definately worth the authorities looking into.
__________________
Notebook: Apple Macbook Pro 13" i7 2.7Ghz (3.4Ghz max) 8GB DDR3 1333Mhz (Mac OSX 10.6.7)
Desktop: ASUS Rampage Formula X48
Intel Core 2 Quad Q9450 (Yorkfield) @ 3.60Ghz (Folding SMP Linux)
Running Fedora 15 Linux (GNOME 3)
Dual Dell 2407WFP
AOA Team fah

Drivers, Games, Demos, Mods and Overclocking Tools At AOAFiles
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
  #8 (permalink)  
Old 2nd June, 2008, 12:54 AM
dsio's Avatar
Steve Jobs
 
Join Date: October 2002
Location: Brisbane, QLD, Australia
Posts: 8,037

In a side note this should be fixed rather quickly. When a datacenter of this kind of scale has a problem this serious, its sort of like the Chinese responding to an earthquake. They get swarms of sysadmins and electrical / network engineers working around the clock and are willing to do almost anything and any cost to get up and running ASAP.

To put it one way, if the hurricane Katrina disaster had been handled the way they handle a datacenter, New Orleans would have been rebuilt within a week.
__________________
Notebook: Apple Macbook Pro 13" i7 2.7Ghz (3.4Ghz max) 8GB DDR3 1333Mhz (Mac OSX 10.6.7)
Desktop: ASUS Rampage Formula X48
Intel Core 2 Quad Q9450 (Yorkfield) @ 3.60Ghz (Folding SMP Linux)
Running Fedora 15 Linux (GNOME 3)
Dual Dell 2407WFP
AOA Team fah

Drivers, Games, Demos, Mods and Overclocking Tools At AOAFiles
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
  #9 (permalink)  
Old 2nd June, 2008, 12:11 PM
PorPorMe's Avatar
Member
 
Join Date: January 2008
Location: Spokane, Wa
Posts: 3,131

OHHH---It's nice to have you back!
__________________
AOA Team fah

1ST Thermaltake V9 Case * Windows 7 x64 * Gigibyte GM-MA74GM-S2 * Phenom X4 9650 2.3Ghz @ 2.76GHz * G Skill 4 GB DDR2 * EVGA Geforce 9800GT 512GB * Antec 650w


Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
  #10 (permalink)  
Old 2nd June, 2008, 02:35 PM
dabaerman's Avatar
Member
 
Join Date: October 2001
Location: Auburn, WA
Posts: 2,101

I e-mailed Dan~ yesterday and he gave me the story. hella mess I'd say.
dsio is right on about getting things fixed in a hurry. woke up this morning to
find things back to usual.

Ron
__________________
Folding 24/7 with AMD QuadCore CPU's & nVidia Cuda Powered GPU's

AOA Team fah
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
  #11 (permalink)  
Old 2nd June, 2008, 02:49 PM
Member
 
Join Date: April 2005
Location: AZ
Posts: 2,446

Good to see it back, although I did a get a ton of stuff done yesterday.
__________________
Biostar TForce X58 - Core i7 920 - 12GB Corsair Dominator DDR3 - EVGA 560ti - PCP&C 750W - Dual boot, Arch Linux/WinXP
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
  #12 (permalink)  
Old 2nd June, 2008, 02:57 PM
chrisbard's Avatar
Benchmarker
 
Join Date: March 2003
Location: Earth
Posts: 8,252
Send a message via Yahoo to chrisbard

Cool

Quote:
Originally Posted by danrok View Post
Is Chris Bard currently holidaying in Texas?
No but my Uncle is paying a visit to a certain "gentle"man from there and I tell ya; he's imune to garlic
__________________
I've heard that linux community came up with better implemented security in it's latest Linux Mint Gold version, it's actually preventing the user to log in, thus posing 0 risk in contamining the computer with malware! Well done to the open source community!

Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
  #13 (permalink)  
Old 2nd June, 2008, 03:08 PM
dsio's Avatar
Steve Jobs
 
Join Date: October 2002
Location: Brisbane, QLD, Australia
Posts: 8,037

Though AOA is no longer in any danger, the datacenter in Houston is substantially rooted still, with the second floor being brought on line again, and the bottom floor still offline as the damage done by the explosion was significantly greater than previously expected.

Sometime in the next 24 hours the remaining servers will be brought back online (3000 of them) but its a stopgap solution: They can't run them on mains power yet due to extensive hardware that needs to be replaced, so all 3000 of those machines need to be run on diesel power via the backup generators for at least a week, possibly longer depending on part availablity.

Its one of the bigger datacenter disasters I've heard of, and definately the largest that I've been directly involved in.

Some links:

Slashdot | Explosion At ThePlanet Datacenter Drops 9,000 Servers
H1 Data Center Offline - Status Updates Available Here - The Planet Forums
Fire at The Planet takes down thousands of websites | The Register
__________________
Notebook: Apple Macbook Pro 13" i7 2.7Ghz (3.4Ghz max) 8GB DDR3 1333Mhz (Mac OSX 10.6.7)
Desktop: ASUS Rampage Formula X48
Intel Core 2 Quad Q9450 (Yorkfield) @ 3.60Ghz (Folding SMP Linux)
Running Fedora 15 Linux (GNOME 3)
Dual Dell 2407WFP
AOA Team fah

Drivers, Games, Demos, Mods and Overclocking Tools At AOAFiles
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
  #14 (permalink)  
Old 2nd June, 2008, 10:19 PM
Daniel ~'s Avatar
Chief BBS Administrator
 
Join Date: September 2001
Location: Seattle Wa.
Posts: 45,605

We might put together an email list of our members who want to be kept informed when .... if we should ever be brought down by rasberry ants again...is there an easy built in way to do that?

( I want to tell Danrok how stupid the very idea is...but I don't want to piss off the ants!!)
__________________
"Though all men live in ignorance before mystery,
they need not live in darkness...
Justice is foundation and Mercy ETERNAL
."
DKE

"All that we do is touched by Ocean
Yet we remain on the shore of what we know."
Richard Wilbur

[img]/forum/attachments/random-nonsense/16515-sigs-dan_drag.jpg[/img]
Subscribers! Ask Pitch about a Custom Sig Graphic

Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
  #15 (permalink)  
Old 3rd June, 2008, 08:03 PM
dsio's Avatar
Steve Jobs
 
Join Date: October 2002
Location: Brisbane, QLD, Australia
Posts: 8,037

They brought the bottom floor of the datacenter online with a temporary generator.

Then the generator failed.

So they isolated that it was the breaker system and tried to fix it.

But that didn't work.

So they ordered a new breaker system for the generator.

Which worked for a few minutes then failed.

So they're ordering /another/ generator. (the backup, backup, backup generator).

/sigh
__________________
Notebook: Apple Macbook Pro 13" i7 2.7Ghz (3.4Ghz max) 8GB DDR3 1333Mhz (Mac OSX 10.6.7)
Desktop: ASUS Rampage Formula X48
Intel Core 2 Quad Q9450 (Yorkfield) @ 3.60Ghz (Folding SMP Linux)
Running Fedora 15 Linux (GNOME 3)
Dual Dell 2407WFP
AOA Team fah

Drivers, Games, Demos, Mods and Overclocking Tools At AOAFiles
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
  #16 (permalink)  
Old 2nd July, 2008, 03:59 AM
booman's Avatar
AOA Staff
 
Join Date: December 2005
Location: Mesa AZ
Posts: 4,030

How many surgeries does it take to fix data servers?
Thats pretty crazy that there was an actual explosion. I hope it wasn't arsen.
I can't imagine sitting in my cubicle and the whole building shakes after a loud boom, then the whole building goes black.
__________________
Booman
Mint 17.3 64-bit
Wine 2.0
PlayOnLinux 4.2.10
Linux Guides: PC Games Linux Beginners Tips Linux Games List
Mack Truck Dungeon Of Fire Spray Booth Tutorial
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
  #17 (permalink)  
Old 2nd July, 2008, 06:13 PM
Daniel ~'s Avatar
Chief BBS Administrator
 
Join Date: September 2001
Location: Seattle Wa.
Posts: 45,605

Naw the building didn't go black...that's just the concreate and debre boacking your line of sight to the surface...see if you can move your toes...if you can move your toes it should make you feel better! ":O}
__________________
"Though all men live in ignorance before mystery,
they need not live in darkness...
Justice is foundation and Mercy ETERNAL
."
DKE

"All that we do is touched by Ocean
Yet we remain on the shore of what we know."
Richard Wilbur

[img]/forum/attachments/random-nonsense/16515-sigs-dan_drag.jpg[/img]
Subscribers! Ask Pitch about a Custom Sig Graphic

Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
Reply



Currently Active Users Viewing This Thread: 1 (0 members and 1 guests)
 
Thread Tools
Rate This Thread
Rate This Thread:

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is Off
HTML code is Off
Trackbacks are On
Pingbacks are On
Refbacks are On


Similar Threads
Thread Thread Starter Forum Replies Last Post
Help with deleted file on server!!! booman OS, Software, Firmware, and BIOS 6 9th November, 2006 11:29 PM
Network's file server XeroHouR Mobile Devices and Networking 16 10th March, 2005 08:32 PM
Ninja File Managers - Suggest a killer file organization app. DimViesel OS, Software, Firmware, and BIOS 0 6th September, 2004 09:35 AM
help with inline file server and messagimg server. r0l0e Mobile Devices and Networking 24 22nd July, 2002 01:52 AM


All times are GMT +1. The time now is 06:42 PM.


Copyright ©2001 - 2010, AOA Forums
Don't Click Here Don't Click Here Either

Search Engine Friendly URLs by vBSEO 3.3.0