Website Outage this Morning & How We Recovered

Sites Outage this Morning & How We Recovered

Today was a shockingly challenging day. We woke to discover that websites were down. We thought it was just one website, but we soon found that multiple websites were effected; possibly all of them!

This website design video is what went wrong, how we responded, and what we’re doing to prevent the same thing happening in the future!

Website Outage crisis averted! Thanks, Picard!

Website Outage Crisis Averted! - Thanks! - Lakeland Website Design -

What Went Wrong

We use a hosting provider who manages each website install. One of our web design clients is in a legal dispute over trademark. The site hosting provider was supposed to “take down” just one website, but instead accidentally took down the entire block of websites.

How We Responded

When we discovered that multiple websites were down as of 7:45 a.m., we checked multiple websites and found that there were more than a few that were “hard down”; not able to pull up on any device.

We immediately got our hosting service on the phone, as well as their infrastructure company. (There are multiple layers of website infrastructure, and you usually have to dive deep into each layer to find what went wrong.)

We then rolled through each of our normal redundancies:

  1. Upload and activate one of our 24 hour website backups of each website. (No success.)
  2. Upload and install the backup on another hosting service, such as moving from BlueHost to GoDaddy (No success.)
  3. Purchase an additional “block” of websites and one by one install and re-launch them. (No success.)
  4. Manually install and connect the SQL databases, which is time-consuming, but a last-ditch effort. (No success.)
  5. MEANWHILE, we were still working with the Support Reps with our main hosting service.

Finally, after several hours of these attempts, a plucky Support Rep got to the root of the problem; a trademark infringement lawsuit with one particular website. He appealed to an underlying infrastructure vendor to re-activate the “block” of websites while the lawsuit was still being settled.

It turns out, it was not a technical failure in the least! It was one of those 1% probability situations where a legal issue created a technical issue.

The block of websites were instantly re-activated and we notified the affected site owners.

What We’ll Do to Prevent Future Website Outage

In the immediately future, the Spark Sites team is doing the following MULTIPLE redundancies:

  1. Installing our own WordPress Backup plugin on every website to have access to our own backups (not wonky vendor backups.)
  2. Install our own monitoring plugin to notify us the moment a website is down.
  3. Create an internal policy to partition any website that is known to have legal issues (even if that website client is in a settlement, to be sure other websites are safe.) We will not shut down the website of concern. We will instead move it to another host, and point the domain immediately.

That is how we will ensure that LEGAL issues do not create TECHNICAL issues for your website in the future!

Thank you for your continued business and support, folks!

Spark Sites
Lakeland Website Design and WordPress Support Services

recent posts

Top Items to Include on a Gym or Fitness Website

Top Items to Include on a Gym or Fitness Website

What should be included on my new gym or fitness website? When creating a new website for a fitness studio or gym, a variety of elements need to be included. A visitor should be able to find all of the information they seek about the business from the homepage, and it...

SEO Best Practices: Always Serve Quality Content

SEO Best Practices: Always Serve Quality Content

Quality content is an important part of any great SEO campaign. In this post we discuss why search engines want you to write quality content, what are the consequences of adding low-quality content to your website, and some steps to follow when writing content for...

3 Scheduling Apps that Make Your Life Easier

3 Scheduling Apps that Make Your Life Easier

Scheduling is a crucial part of running any business. Knowing when your appointments are happening, when your delivery is coming or even when you can get more inventory are all important parts of running your day-to-day operations. We’re big believers in best practices which is why we thought we’d share with you what to look for when choosing an app that will help you manage your company’s precious time.