The Internet Report

Over a two-day period this past week, major social media platforms—Meta’s Facebook and Instagram, LinkedIn, and Discord—all experienced disruptions. In the same timeframe, Comcast was also impacted by an outage that affected access to specific services and applications.

Meta experienced issues with its log-in process, Discord navigated unexpectedly high load volumes, Comcast dealt with 100% packet loss in part of its backbone, and—the following day—LinkedIn worked its way through a backend issue.

These incidents each leave valuable reminders for NetOps teams as they seek to minimize downtime and assure exceptional digital experiences.

Tune in to the episode to learn more and also gain insight into the latest outage numbers and trends.

——— 

CHAPTERS:
00:00 Intro
00:58 Comcast Outage
05:09 Meta Outage
09:38 Discord Disruption
10:25 LinkedIn Outage
13:22 DIRECTV Service Disruption
15:25 Outage Trends: By the Numbers
17:03 Get in Touch 

———

For more insights, check out these links:

- The Internet Report: Pulse Update Blog: https://www.thousandeyes.com/blog/internet-report-pulse-update-meta-linkedin-comcast-outages?utm_source=transistor&utm_medium=referral&utm_campaign=na_fy24q3_internetreportpulse31_podcast

- Explore the outages in the ThousandEyes platform (no login required):
Comcast Outage: https://afplzaqpehynhosldcqefycfhqqcrbzh.share.thousandeyes.com
 LinkedIn Outage: https://anxjzezcpptrnpodjucgzzixdkldguzm.share.thousandeyes.com 

- Internet Outages Timeline: https://www.thousandeyes.com/resources/internet-outages-timeline?utm_source=transistor&utm_medium=referral&utm_campaign=na_fy24q3_internetreportpulse31_podcast

———

Want to get in touch?

If you have questions, feedback, or guests you would like to see featured on the show, send us a note at [email protected]. Or follow us on X: @thousandeyes

Load is a fundamental but, at times, challenging variable for networks and operations teams to handle. In the past few weeks, ThousandEyes saw various load-related problems impact organizations including Google Cloud, Front, several Australian banks, and Minnesota State University Moorhead.

Tune in to learn more about what happened during these incidents, as well as hear our commentary on the recent outage impacting AT&T. Use the timestamps below to jump to the sections that most interest you:
 
CHAPTERS:
00:00 Intro
00:59 AT&T outage impacts cellular services nationwide
04:40 Australian banks appear to lose online and app-based services for 24 hours
07:46 Google Cloud metadata store faces sudden demand spike
09:19 Front’s “large unexpected increase in web traffic”
10:23 Box experiences outage as third-party network component fails
11:23 Minnesota State University Moorhead’s case study on good visibility
12:44 Outage trends: By the numbers
15:35 Get in touch 

———

For more insights, check out these links:

- Explore the Front disruption in the ThousandEyes platform (no login required): https://aczocbxpamiipkdqnaqdedkytwhlfjtw.share.thousandeyes.com?utm_source=transistor&utm_medium=referral&utm_campaign=na_fy24q3_internetreportpulse30_podcast

- Internet Outages Timeline: https://www.thousandeyes.com/resources/internet-outages-timeline?utm_source=transistor&utm_medium=referral&utm_campaign=na_fy24q3_internetreportpulse30_podcast

———

Want to get in touch?

If you have questions, feedback, or guests you would like to see featured on the show, send us a note at [email protected]. Or follow us on X: @thousandeyes

When outages happen, it’s what you do next that matters. It’s important to have a backup plan in place that you can quickly activate to minimize the impact of an incident.

Over the past two weeks, companies initiated a range of resiliency actions, including asking customers to use alternate authentication methods (or to avoid logging out of a service), setting up a new contact center to re-establish lines of communication, and reverting to manual processes.

Tune in to learn more about what happened during these and other recent incidents.

CHAPTERS:
00:00 Intro
01:00 Square Outage Impacts “Multiple” Services
04:18 Applied Digital’s Multi-week Data Center Issue
07:14 UC Berkeley Data Center Outage
08:44 Russia .ru Domain Outage
10:05 Cyber Attack at Lurie Children's Hospital
11:36 Outage Trends: By the Numbers
15:55 Get in Touch

———

For more insights on outage trends and analysis of some of the most notable outages of 2023, check out our on-demand webinar: https://www.thousandeyes.com/resources/amer-top-outages-2023-analyses-takeaways-webinar?utm_source=transistor&utm_medium=referral&utm_campaign=na_fy24q3_internetreportpulse29_podcast

In EMEA and want to tune in live? We’re hosting one more live webinar session on Feb. 22 at 10 AM (GMT). Register now: https://www.thousandeyes.com/webinars/emea-top-outages-2023-analyses-takeaways?utm_source=transistor&utm_medium=referral&utm_campaign=na_fy24q3_internetreportpulse29_podcast

And also check out these links:

- The Internet Report: Pulse Update Blog: https://www.thousandeyes.com/blog/internet-report-pulse-update-square-outage-and-more-news?utm_source=transistor&utm_medium=referral&utm_campaign=na_fy24q3_internetreportpulse29_podcast

- Explore the .ru domain outage in the ThousandEyes platform (no login required): https://awuyqonlmzxmvizsdcgevvdhcbzervks.share.thousandeyes.com?utm_source=transistor&utm_medium=referral&utm_campaign=na_fy24q3_internetreportpulse29_podcast

- Internet Outages Timeline: https://www.thousandeyes.com/resources/internet-outages-timeline?utm_source=transistor&utm_medium=referral&utm_campaign=na_fy24q3_internetreportpulse29_podcast

———

Want to get in touch?

If you have questions, feedback, or guests you would like to see featured on the show, send us a note at [email protected]. Or follow us on X: @thousandeyes

The ThousandEyes Internet Intelligence team joins us from Cisco Live in Amsterdam, talking about a major theme from the event—security.

Tune in to hear their thoughts on how visibility can help companies in their security efforts, the sovereignty of data in flight, and why you don’t have to choose between security and performance.

———

CHAPTERS
00:00 Intro
01:09 Evolving Security Landscape
04:53 Security Excellence & Optimal Digital Experience
10:13 Sovereignty of Data in Flight
14:57 Key Takeaways
15:55 Get in Touch

———

Want to get in touch?

If you have questions, feedback, or guests you would like to see featured on the show, send us a note at [email protected]. 

And follow us on X: @thousandeyes

What happened during the recent Microsoft Teams and Azure disruptions? Go under the hood of these incidents and also explore other recent disruptions in this week’s Pulse Update.

CHAPTERS
- 01:03 Network issue leads to Microsoft Teams service disruption
- 04:09 Azure Resource Manager exhausts capacity, causing service issues
- 06:20 Oracle Cloud experiences network outage
- 09:56 Jira users encounter 503s and other errors
- 10:30 Sage outage impacts South Africa
- 11:08 Red Hat experiences four search-related incidents
- 11:45 Recent outage trends and numbers

For more insights on outage trends and analysis of some of the most notable outages of 2023, check out our on-demand webinar: https://www.thousandeyes.com/resources/amer-top-outages-2023-analyses-takeaways-webinar?utm_source=transistor&utm_medium=referral&utm_campaign=na_fy24q3_internetreportpulse28_podcast

In EMEA and want to tune in live? We’re hosting one more live webinar session on Feb. 22 at 10 AM (GMT). Register now: https://www.thousandeyes.com/webinars/emea-top-outages-2023-analyses-takeaways?utm_source=transistor&utm_medium=referral&utm_campaign=na_fy24q3_internetreportpulse28_podcast

And also check out these links:

- The Internet Report: Pulse Update Blog: https://www.thousandeyes.com/blog/internet-report-pulse-update-microsoft-teams-azure-outage?utm_source=transistor&utm_medium=referral&utm_campaign=na_fy24q3_internetreportpulse28_podcast

- Internet Outages Timeline: https://www.thousandeyes.com/resources/internet-outages-timeline?utm_source=transistor&utm_medium=referral&utm_campaign=na_fy24q3_internetreportpulse28_podcast

———

Want to get in touch?

If you have questions, feedback, or guests you would like to see featured on the show, send us a note at [email protected]. Or follow us on X: @thousandeyes

What caused recent dips in performance for OpenAI’s ChatGPT? Tune in to hear The Internet Report team unpack this and other recent disruptions, including a hack that led to an outage at the Spanish branch of the Orange mobile network, and a blip for customers of the cloud services provider DigitalOcean.

They’ll also cover the outage trends they’re seeing in 2024 so far and how extreme cold weather can cause problems for data centers.

For more insights on outage trends and analysis of some of the most notable outages of 2023, register for the upcoming Top Outages of 2023 webinar: https://www.thousandeyes.com/webinars/amer-top-outages-2023-analyses-takeaways?utm_source=transistor&utm_medium=referral&utm_campaign=na_fy24q2_internetreportpulse27_podcast

Also check out these links:

- Blog: 2023 Internet Outage Trends & the New Outage Landscape: https://www.thousandeyes.com/blog/internet-report-pulse-update-2023-internet-outage-trends?utm_source=transistor&utm_medium=referral&utm_campaign=na_fy24q2_internetreportpulse27_podcast

- Internet Outages Timeline: https://www.thousandeyes.com/resources/internet-outages-timeline?utm_source=transistor&utm_medium=referral&utm_campaign=na_fy24q2_internetreportpulse27_podcast

———

CHAPTERS
00:00 Intro
01:12 Two Consecutive Service Degradations at ChatGPT
04:43 Hack Leads to Orange Spain Outage
13:05 DigitalOcean Disruption
15:55 By the Numbers
23:26 Get in Touch

———

Want to get in touch?

If you have questions, feedback, or guests you would like to see featured on the show, send us a note at [email protected]. Or follow us on X: @thousandeyes

As they launch into 2024, organizations are facing a different outage landscape than they had at the start of 2023. The past year saw increases in cloud service provider (CSP) outages, application outages, and the percentage of U.S.-centric outages—all of which point to an evolution in the way outages happen and the need for different strategies to minimize the impact of disruptions.

In this episode, Mike Hicks (Principal Solutions Analyst at ThousandEyes) unpacks these trends and shares practical tips for mitigating disruptions and optimizing performance. Listen on YouTube or tune in on your favorite podcast platform.

And for more insights, check out these resources:

- Top Outages of 2023 Webinar: https://www.thousandeyes.com/webinars/amer-top-outages-2023-analyses-takeaways?utm_source=transistor&utm_medium=referral&utm_campaign=na_fy24q2_internetreportpulse26_podcast 

(*In APJC? Check out the APJC session: https://cisco.webex.com/webappng/sites/cisco/meeting/register/f22aa6a322284e07abf0350b255c88c8?ticket=4832534b0000000658abcedc3030906188c1af83e52ab18645645592a5962e7bdd3a5f2afdc393ae×tamp=1705102128048&RGID=r57f263db115ebc6efa4c0a05429caa6f)

- Internet Outages Timeline: https://www.thousandeyes.com/resources/internet-outages-timeline?utm_source=transistor&utm_medium=referral&utm_campaign=na_fy24q2_internetreportpulse26_podcast

———

CHAPTERS
00:00 Intro
00:38 Cloud Service Provider Outages Trending Up
02:30 Percent of U.S.-centric Outages Rises
06:55 Application Outages Up in 2023
09:55 Get in Touch

———

Want to get in touch?

If you have questions, feedback, or guests you would like to see featured on the show, send us a note at [email protected]. Or follow us on X: @thousandeyes

As 2023 comes to a close, in the spirit of Dickens’ holiday classic “A Christmas Carol,” let’s reflect on the valuable insights left by the ghosts of network operations teams past, present, and yet to come. 

Tune in to hear host Mike Hicks (Principal Solutions Analyst at ThousandEyes) discuss lessons from the NetOps teams of the past, the current state of NetOps, and what the future might hold—all with the goal of helping teams take steps to optimize performance and deliver delightful digital experiences in 2024.

And also check out Mike’s related article in TechRadar: https://www.techradar.com/pro/the-ghosts-of-network-operations-past-present-and-yet-to-come

———

CHAPTERS
00:00 Intro
01:06 NetOps Past
06:24 NetOps Present
12:14 NetOps Yet to Come
20:35 Get in Touch

———

Want to get in touch?

If you have questions, feedback, or guests you would like to see featured on the show, send us a note at [email protected]. 

And follow us on X: @thousandeyes

Recent changes appeared to trigger a series of events for two peering points internationally—with very different impacts. Tune in to learn more about these incidents, why they differed, and the lessons they leave.

Mike Hicks, Principal Solutions Analyst at ThousandEyes, will also cover the latest outage numbers and explore other recent incidents, including an Oracle Cloud outage and a duo of disruptions at Alibaba Cloud.

Interested in more outage analysis? Check out our Internet Outages Timeline, which covers several notable Internet outages and application issues from the past year, along with the lessons they leave: https://www.thousandeyes.com/resources/internet-outages-timeline?utm_source=transistor&utm_medium=referral&utm_campaign=na_fy24q2_internetreportpulse24_podcast

———

CHAPTERS
00:00 Intro
00:45 Optus Outage
02:07 AMS-IX Outage
06:50 Oracle Cloud Outage
08:39 Duo of Alibaba Cloud Incidents 
09:44 By the Numbers
13:13 Get in Touch

———

Want to get in touch?

If you have questions, feedback, or guests you would like to see featured on the show, send us a note at [email protected]. Or follow us on X: @thousandeyes

As companies gear up for Black Friday, The Internet Report team shares some best practices for delivering great customer experiences and minimizing downtime during one of the retail industry’s biggest days of the year. 

Mike Hicks, Principal Solutions Analyst at ThousandEyes, will cover some helpful case studies of Black Fridays that experienced some hiccups and what you can do to guard against similar disruptions.

To learn more, check out the link below: 

- https://www.thousandeyes.com/blog/internet-report-episode-54-black-friday-2023

———

Want to get in touch?

If you have questions, feedback, or guests you would like to see featured on the show, send us a note at [email protected]. 

And follow us on Twitter: @thousandeyes