Howdy, Stranger!

It looks like you're new here. If you want to get involved, click one of these buttons!

Sign In with OpenID
Advertise on LowEndTalk.com

In this Discussion

OVH Strasbourg Power Failure
New on LowEndTalk? Please read our 'Community Rules' by clicking on it in the right menu!

OVH Strasbourg Power Failure

exception0x876exception0x876 Member, Provider

In case anyone wonders why his server is down - http://travaux.ovh.net/?do=details&id=28240

8GB RAM 200GB HDD KVM VPS for $6.99/mo, 1.8TB storage for $8.99/mo (paid quarterly) - wishosting.com

Affiliate program

Tagged:
«134567

Comments

  • You beat me to it :)

  • MikeAMikeA Member, Provider
    edited November 9

    I'm glad all of my servers are in GRA.

    ExtraVM - DDoS Protected VPS - US, CA, FR, SNG

  • ClouviderClouvider Member, Provider

    How you can loose power to the entire Datacentre ? They have one feed only ? If so, then wow.

    Clouvider Leading UK Cloud Hosting solution provider || UK Dedicated Servers Sale || Tasty KVM Slices || Latest LET Offer

    Web hosting in Cloud | SSD & SAS True Cloud VPS on OnApp | Private Cloud | Dedicated Servers | Colocation | Managed Services

  • randvegetarandvegeta Member, Provider

    @Clouvider said: How you can loose power to the entire Datacentre ? They have one feed only ? If so, then wow.

    1 feed and no generator apparently.

  • Vova1234Vova1234 Member, Provider
    edited November 9

    Yes. This is the first time such a thing has been noticed.

    In SBG a large number of gaming servers i7-6700k, i7-7700k, i7-4790k.

    Now a huge number of game servers went offline.

    My Hosting: ABCVG.net

  • xaocxaoc Member

    No point in guessing at this point. The RFO should clear stuff up if there will be any.

    So Say We All

  • MikeAMikeA Member, Provider
    edited November 9

    @xaoc said: No point in guessing at this point. The RFO should clear stuff up if there will be any.

    It will likely be next month, still waiting for SLA (+RFO) e-mail from last months outage in different DC.

    ExtraVM - DDoS Protected VPS - US, CA, FR, SNG

  • ClouviderClouvider Member, Provider

    @MikeA said:

    @xaoc said: No point in guessing at this point. The RFO should clear stuff up if there will be any.

    It will likely be next month, still waiting for SLA (+RFO) e-mail from last months outage in different DC.

    Wow. In contrast I receive my RFOs in relation to any Equinix or Virtus incidents in less then a week. I don’t even need to ask for it.

    Clouvider Leading UK Cloud Hosting solution provider || UK Dedicated Servers Sale || Tasty KVM Slices || Latest LET Offer

    Web hosting in Cloud | SSD & SAS True Cloud VPS on OnApp | Private Cloud | Dedicated Servers | Colocation | Managed Services

  • rm_rm_ Member

    Somehow they managed to fuck it up so hard, RBX just went down as well.

  • ClouviderClouvider Member, Provider

    @randvegeta said:

    @Clouvider said: How you can loose power to the entire Datacentre ? They have one feed only ? If so, then wow.

    1 feed and no generator apparently.

    Any source in their website for this ?
    I’d love to point this to the next person who argues prices on OVH comparable services

    Clouvider Leading UK Cloud Hosting solution provider || UK Dedicated Servers Sale || Tasty KVM Slices || Latest LET Offer

    Web hosting in Cloud | SSD & SAS True Cloud VPS on OnApp | Private Cloud | Dedicated Servers | Colocation | Managed Services

  • exception0x876exception0x876 Member, Provider

    @rm_ said: Somehow they managed to fuck it up so hard, RBX just went down as well.

    Yes, RBX went dark for me too.

    8GB RAM 200GB HDD KVM VPS for $6.99/mo, 1.8TB storage for $8.99/mo (paid quarterly) - wishosting.com

    Affiliate program

  • ProfforgProfforg Member
    edited November 9

    Does someone see issues in GRA and RBX as well? I have most server down in all locations except Canada. So all in France. Do they have power issues on three geo-locations in France? Probably something with whole France?

    Freelance System Administrator, available for hire. Experienced in: PHP, MySQL, WordPress, Nginx, DDoS-protection, high-performance solutions.

  • MikeAMikeA Member, Provider

    @Clouvider said:

    @MikeA said:

    @xaoc said: No point in guessing at this point. The RFO should clear stuff up if there will be any.

    It will likely be next month, still waiting for SLA (+RFO) e-mail from last months outage in different DC.

    Wow. In contrast I receive my RFOs in relation to any Equinix or Virtus incidents in less then a week. I don’t even need to ask for it.

    Yeah. Others I've used in the past were always within a few days, nowhere as large as OVH, but nothing small. It is a bit upsetting, maybe I should buy stocks from a DDoS appliance vendor..

    ExtraVM - DDoS Protected VPS - US, CA, FR, SNG

  • rm_rm_ Member

    randvegeta said: 1 feed and no generator apparently.

    Their website said, I quote: "generators did not start". The incident website is mostly down now as well, so can't provide the exact link.

  • @Profforg said: Does someone see issues in GRA and RBX as well? I have most server down in all locations except Canada. So all in France. Do they have power issues on three geo-location in France? Probably something with whole France?

    Just got issues in RBX, judging from twitter it appears GRA and RBX is down now too.

  • MikeAMikeA Member, Provider

    @Makenai said:

    @Profforg said: Does someone see issues in GRA and RBX as well? I have most server down in all locations except Canada. So all in France. Do they have power issues on three geo-location in France? Probably something with whole France?

    Just got issues in RBX, judging from twitter it appears GRA and RBX is down now too.

    Nothing of mine in Gravelines is down, doubt it'll be affected, it usually isn't when there's big problems in SBG/RBX in the past.

    ExtraVM - DDoS Protected VPS - US, CA, FR, SNG

  • @rm_ said: Somehow they managed to fuck it up so hard, RBX just went down as well.

    I read this thread while eating and said " I don't care". Then I got email saying my servers are down.

    Sorry for my bad English

  • ClouviderClouvider Member, Provider
    edited November 9

    @rm_ said:

    randvegeta said: 1 feed and no generator apparently.

    Their website said, I quote: "generators did not start". The incident website is mostly down now as well, so can't provide the exact link.

    How can generators not start ?
    Industry standard is at lest N+1 on the control system, N+1 in the actual generators and N+1 on the actual UPS system. On top of that majority of DCs offer you feed from at least 2 different UPS systems and have at least 2 as diverse as possible feeds out of public network. Besides they should be keeping enough juice in the UPS systems to be able to go there and run them manually in case of such an event. For example, Virtus currently keeps between 30-50 minutes depending on the system.

    I can find nothing about dual feed there, so it’s probably safe to assume there’s one feed, powered by a set of generators that apparently got screwed up at some point of either design or maintenance.

    Cost cutting exercise must have backfired.

    All this while increasing prices.

    Clouvider Leading UK Cloud Hosting solution provider || UK Dedicated Servers Sale || Tasty KVM Slices || Latest LET Offer

    Web hosting in Cloud | SSD & SAS True Cloud VPS on OnApp | Private Cloud | Dedicated Servers | Colocation | Managed Services

    Thanked by 1Kabeldamagement
  • RhysRhys Member
    edited November 9

    Forgot to steal money from the banks to pay the energy bill.

    I recommend hosting at anyNode and IonSwitch

  • ClouviderClouvider Member, Provider
    edited November 9

    @hammad said:

    When was the latest generators run then ? They don’t test it ? Seems unlikely.

    Clouvider Leading UK Cloud Hosting solution provider || UK Dedicated Servers Sale || Tasty KVM Slices || Latest LET Offer

    Web hosting in Cloud | SSD & SAS True Cloud VPS on OnApp | Private Cloud | Dedicated Servers | Colocation | Managed Services

  • mlimli Member

    @hammad said:

    Google translate:

    We have a problem feeding SBG1 / SBG4. The 2 electric EDF arrivals are down (!!) and the 2 generator sets have failed (!!!). The set of 4 arrivals elec no longer feed the routing room. We are all on the problem.

  • KuJoeKuJoe Member, Provider

    I got an alert for my Kimsufi server in RBX and thought my payment didn't go through. I logged into their control panel and it says I don't have service with them but it shows all of my invoices paid. What kind of system half works during an outage? I would have felt better if the whole thing was offline instead of appearing to work and telling me all of my services are gone. Glad everybody here is on top of things because their status page isn't loading for me. :)

    -Joe @ SecureDragon - LEB's Powered by Wyvern in FL, CO, CA, IL, NJ, GA, OR, TX, and AZ
    Need free hosting? Get AFreeCloud
  • hammadhammad Member
    edited November 9

    shit got real , all 8 servers with them are down.

  • rm_ said: Their website said, I quote: "generators did not start"

    Sounds like something you would write on a tombstone :)

    Clouvider said: How can generators not start ?

    My friend once had a power outage in the lab he's managing, the power generator cough fire while starting. So I guess it's possible.

    Thanked by 1Aidan
  • datanoisedatanoise Member
    edited November 9

    Clouvider said: Cost cutting exercise must have backfired.

    All this while increasing prices.

    Fuck yeah, this is impressive. It might hurt them pretty deeply. Except if well, you know, people don't care as long as it cheap.

    I guess it will depends how long it takes for them to fix the downtime.

    That's weird: why did the second location got down too? edit: routing issue on TH2. wow

  • jackbjackb Member, Provider

    @Clouvider said:

    @rm_ said:

    randvegeta said: 1 feed and no generator apparently.

    Their website said, I quote: "generators did not start". The incident website is mostly down now as well, so can't provide the exact link.

    How can generators not start ?
    Industry standard is at lest N+1 on the control system, N+1 in the actual generators and N+1 on the actual UPS system. On top of that majority of DCs offer you feed from at least 2 different UPS systems and have at least 2 as diverse as possible feeds out of public network. Besides they should be keeping enough juice in the UPS systems to be able to go there and run them manually in case of such an event. For example, Virtus currently keeps between 30-50 minutes depending on the system.

    I can find nothing about dual feed there, so it’s probably safe to assume there’s one feed, powered by a set of generators that apparently got screwed up at some point of either design or maintenance.

    Cost cutting exercise must have backfired.

    All this while increasing prices.

    I don't think OVH do dual feed servers, so they probably didn't bother with the rest of the infrastructure (except Colo sections perhaps - if they do Colo)

    Afterburst - Awesome OpenVZ&KVM VPS in US+EU

  • It's great to have multiple locations if a power outage in one affects the others as well

    Thanked by 1southy
  • randvegetarandvegeta Member, Provider

    @Clouvider said:

    @randvegeta said:

    @Clouvider said: How you can loose power to the entire Datacentre ? They have one feed only ? If so, then wow.

    1 feed and no generator apparently.

    Any source in their website for this ?
    I’d love to point this to the next person who argues prices on OVH comparable services

    Having generators without fuel, or that don't work is the same as not having a generator. The fact they are down means they do not have this contingency in place.

    Jesus, even our tiny datacentres in HK and LT both have dual feeds, 1hr UPS and backup generators. No wonder OVH can do rock bottom pricing. They basically just have a ton with normal power and an internet connection. That's not hard!

    Thanked by 2Clouvider joeri
  • KuJoeKuJoe Member, Provider

    randvegeta said: Having generators without fuel, or that don't work is the same as not having a generator.

    If you have a generator, it is not the same as not having a generator. :)

    -Joe @ SecureDragon - LEB's Powered by Wyvern in FL, CO, CA, IL, NJ, GA, OR, TX, and AZ
    Need free hosting? Get AFreeCloud
  • ClouviderClouvider Member, Provider
    edited November 9

    @atheros said:

    rm_ said: Their website said, I quote: "generators did not start"

    Sounds like something you would write on a tombstone :)

    Clouvider said: How can generators not start ?

    My friend once had a power outage in the lab he's managing, the power generator cough fire while starting. So I guess it's possible.

    If One generator took fire, that would be +1, he should still have his ‘N’ to keep the load.

    There’s nothing about fire at OVH so it’s completely irrelevant. As per Oles we’re talking simple ‘aaaarrrggg my both feeds from public are down’ Scenario, for which your generators are for.

    Clouvider Leading UK Cloud Hosting solution provider || UK Dedicated Servers Sale || Tasty KVM Slices || Latest LET Offer

    Web hosting in Cloud | SSD & SAS True Cloud VPS on OnApp | Private Cloud | Dedicated Servers | Colocation | Managed Services

  • dahartigandahartigan Member without signature

    @exception0x876 said: In case anyone wonders why his server is down - http://travaux.ovh.net/?do=details&id=28240

    You just saved me opening a ticket :P

    Thanked by 1exception0x876
  • Even there status page is down. Would be nice if it was hosted at another ISP.

  • my server in RBX2 & RBX4 down too

    available-available aja kid zaman now!

  • mowsmows Member

    2 servers in RBX down here

  • Clouvider said: How you can loose power to the entire Datacentre ? They have one feed only ? If so, then wow.

    Clouvider said: How can generators not start ?

    @Clouvider said: When was the latest generators run then ? They don’t test it ? Seems unlikely.

    You seem to be more outraged than the actual users of the service. Found another opportunity to take potshots at others :P ?

  • Lol a bunch of my stuff in RBX is down too, what the fuck.

    Will shill for Pop-Tarts(must be strawberry flavour).

  • PremiumFast_NetPremiumFast_Net Member, Provider

    RBX down here..

  • Setsura said: what the fuck.

    Seems like problem on their fiber network. They are going to have a great day. And customers leaving. (But I guess you get what you pay for)

    @Clouvider any refugee offer? ;-)

  • SetsuraSetsura Member
    edited November 9

    @datanoise said: (But I guess you get what you pay for)

    I give them well over 500EUR in total, couple of the servers are 100EUR+ models I think I'm at least a little entitled to complain. Then again, they're generally fine, not like I'm gonna go and cry for a refund now.

    Will shill for Pop-Tarts(must be strawberry flavour).

  • HostBasticHostBastic Member, Provider

    At first it was only our Game servers that got affected in Strasbourg, now all of our servers in Strasbourg are offline.

    HostBastic Ltd - Fast Webhosting | VPS | Reseller | Game Servers
    cPanel | CloudLinux | LiteSpeed | 100% SSD | OpenVZ & KVM | FREE SSL | DDoS Protection

  • From oles'twitter:

    SBG: ERDF is trying to find out the default. 2 separated 20kV lines are down. We are trying to restart 2 generators A+B for SBG1/SG4. 2 others generators A+B work in SBG2. 1 routing room is in SBG1, the second in SBG2. Both are down.

  • FalzoFalzo Member

    Setsura said: I give them well over 500EUR in total, couple of the servers are 100EUR+ models I think I'm at least a little entitled to complain.

    depends on the SLA you signed with them...

    public cloud in GRA and dedis in RBX up (for now), though can't login and therefore don't know/remember which DC exactly. SYS in SBG all down.

    Netcup DE KVM: 1vC 1GB - 18,88€ or 2 Core 3GB 240GB - 49,88€ yearly /w 5€ off: 36nc15110099285 - 36nc15110099288
    UltraVPS.eu KVM in US/NL/DE, 1BLACK FRIDAY: 1GB 20€ or 2GB 40€ yearly or cheap 750G / 2TB storage offers

  • Setsura said: I think I'm at least a little entitled to complain

    Agreed on that no problem. And shit happens it's possible that they just had bad luck. But there seem to be many angry customers. Time for them to learn how to set up redundancy / automated failover for important stuff I guess.

  • ClouviderClouvider Member, Provider

    @datanoise said:

    Setsura said: what the fuck.

    Seems like problem on their fiber network. They are going to have a great day. And customers leaving. (But I guess you get what you pay for)

    @Clouvider any refugee offer? ;-)

    I’m assuming they lost some connectivity that was operated from affected DCs.

    Nothing as of yet, we’re always happy do to square deals no matter if OVH is down or not.

    Clouvider Leading UK Cloud Hosting solution provider || UK Dedicated Servers Sale || Tasty KVM Slices || Latest LET Offer

    Web hosting in Cloud | SSD & SAS True Cloud VPS on OnApp | Private Cloud | Dedicated Servers | Colocation | Managed Services

    Thanked by 1datanoise
  • ClouviderClouvider Member, Provider

    @dynamo said:

    Clouvider said: How you can loose power to the entire Datacentre ? They have one feed only ? If so, then wow.

    Clouvider said: How can generators not start ?

    @Clouvider said: When was the latest generators run then ? They don’t test it ? Seems unlikely.

    You seem to be more outraged than the actual users of the service. Found another opportunity to take potshots at others :P ?

    Yeah, I don’t tolerate fuck ups. They wind me up. Plan for the worst, hope for the best.

    Clouvider Leading UK Cloud Hosting solution provider || UK Dedicated Servers Sale || Tasty KVM Slices || Latest LET Offer

    Web hosting in Cloud | SSD & SAS True Cloud VPS on OnApp | Private Cloud | Dedicated Servers | Colocation | Managed Services

    Thanked by 1jackhadrill
  • SetsuraSetsura Member
    edited November 9

    @Falzo said:

    Setsura said: I give them well over 500EUR in total, couple of the servers are 100EUR+ models I think I'm at least a little entitled to complain.

    depends on the SLA you signed with them...

    Guess I'll need to check mine after to see just how entitled I really am, I never needed it before.

    public cloud in GRA and dedis in RBX up (for now), though can't login and therefore don't know/remember which DC exactly. SYS in SBG all down.

    Your RBX dedis are up? Mine aren't as far as I can tell.

    @datanoise said: Agreed on that no problem. And shit happens it's possible that they just had bad luck. But there seem to be many angry customers. Time for them to learn how to set up redundancy / automated failover for important stuff I guess.

    They're usually pretty good, surprising that they let almost all their stuff go down like this.

    Will shill for Pop-Tarts(must be strawberry flavour).

    Thanked by 1Clouvider
  • mlimli Member
    edited November 9

    Octave tweets:

    We have a general optical issue on all our optical network in Europe: all chassis in all POP shutdown all the links 100G simultaneous (!!). RBX SBG GRA LIM ERI are down. P19 WAW BHS are UP.

  • ClouviderClouvider Member, Provider

    For what is worth, the burden of this screw up will fall on OVH engineers this weekend. I don’t envy them.

    Clouvider Leading UK Cloud Hosting solution provider || UK Dedicated Servers Sale || Tasty KVM Slices || Latest LET Offer

    Web hosting in Cloud | SSD & SAS True Cloud VPS on OnApp | Private Cloud | Dedicated Servers | Colocation | Managed Services

    Thanked by 1Maounique
  • FalzoFalzo Member

    @Setsura said:

    @Falzo said:

    Setsura said: I give them well over 500EUR in total, couple of the servers are 100EUR+ models I think I'm at least a little entitled to complain.

    depends on the SLA you signed with them...

    Guess I'll need to check mine after to see just how entitled I really am, I never needed it before.

    remember even if you have 99.9% average it'll result in 8h downtime (per year) to be no issue ;-)

    public cloud in GRA and dedis in RBX up (for now), though can't login and therefore don't know/remember which DC exactly. SYS in SBG all down.

    Your RBX dedis are up? Mine aren't as far as I can tell.

    maybe I memorised the location wrong and they are in Gravelines too...

    @datanoise said: Agreed on that no problem. And shit happens it's possible that they just had bad luck. But there seem to be many angry customers. Time for them to learn how to set up redundancy / automated failover for important stuff I guess.

    They're usually pretty good, surprising that they let almost all their stuff go down like this.

    I agree, Delimiter OVH probably thought of being prepared enough for power outages so that they went for running a lot of routing also for other locations through SBG with no ways around...

    Netcup DE KVM: 1vC 1GB - 18,88€ or 2 Core 3GB 240GB - 49,88€ yearly /w 5€ off: 36nc15110099285 - 36nc15110099288
    UltraVPS.eu KVM in US/NL/DE, 1BLACK FRIDAY: 1GB 20€ or 2GB 40€ yearly or cheap 750G / 2TB storage offers

Sign In or Register to comment.