{"id":4302,"date":"2018-08-06T16:58:11","date_gmt":"2018-08-06T23:58:11","guid":{"rendered":"https:\/\/blog.caida.org\/best_available_data\/?p=4302"},"modified":"2018-08-06T16:58:11","modified_gmt":"2018-08-06T23:58:11","slug":"ioda-is-now-on-twitter","status":"publish","type":"post","link":"https:\/\/blog.caida.org\/best_available_data\/2018\/08\/06\/ioda-is-now-on-twitter\/","title":{"rendered":"IODA is now on Twitter"},"content":{"rendered":"<p>Detecting Internet outages world-wide and in real-time is no small feat. It requires distributed measurement infrastructure, tools and processing power to analyze the resulting data, plenty of storage to save it, and a powerful user interface to visualize the data. <a href=\"https:\/\/ioda.caida.org\">IODA<\/a> (short for Internet Outage Detection and Analysis) is CAIDA&#8217;s solution to this problem.<\/p>\n<p>In an attempt to make IODA more useful, we just launched <a href=\"https:\/\/twitter.com\/caida_ioda\">@caida_ioda<\/a>, a Twitter account to bring attention to select Internet outages. We inaugurated this account by <a href=\"https:\/\/twitter.com\/caida_ioda\/status\/1020120587006382080\">revealing<\/a> an outage that took place in Morocco, on July 19, from 11:30 pm to 3:50 am local time. The visualization below illustrates this outage. The blue time series represents our active probing data. This data comes from a cluster of twenty software instances, located at <a href=\"https:\/\/www.sdsc.edu\">SDSC<\/a> in San Diego, that repeatedly ping active hosts in the IPv4 address space. Each data point of the time series captures the normalized number of \/24 network blocks in Morocco that responded to these pings. The data is normalized with respect to the maximum value observed in the inspected time interval. Starting at 10:20 pm UTC, this fraction dropped significantly (from ~19,700 \/24 network blocks to as low as ~13,400) and slowly started to recover after a few hours. The green time series exhibits a drop at the same time\u2014it represents the normalized number of \/24 network blocks that are reachable according to <a href=\"https:\/\/en.wikipedia.org\/wiki\/Border_Gateway_Protocol\">BGP<\/a>, and geolocated to Morocco. The gaps in the BGP time series are due to missing data points caused by temporary issues with our infrastructure. You can use our <a href=\"https:\/\/ioda.caida.org\/ioda\/dashboard\">interactive dashboard<\/a> to <a href=\"https:\/\/ioda.caida.org\/ioda\/dashboard#view=inspect&amp;entity=country\/MA&amp;lastView=overview&amp;from=1532022385&amp;until=1532110285\">investigate this outage yourself<\/a>.<\/p>\n<p><a href=\"https:\/\/blog.caida.org\/best_available_data\/wp-content\/uploads\/2018\/07\/morocco-outage.png\"><img loading=\"lazy\" class=\"wp-image-4310 aligncenter\" src=\"https:\/\/blog.caida.org\/best_available_data\/wp-content\/uploads\/2018\/07\/morocco-outage-300x140.png\" alt=\"\" width=\"701\" height=\"327\" srcset=\"https:\/\/blog.caida.org\/best_available_data\/wp-content\/uploads\/2018\/07\/morocco-outage-300x140.png 300w, https:\/\/blog.caida.org\/best_available_data\/wp-content\/uploads\/2018\/07\/morocco-outage-768x359.png 768w, https:\/\/blog.caida.org\/best_available_data\/wp-content\/uploads\/2018\/07\/morocco-outage-1024x479.png 1024w, https:\/\/blog.caida.org\/best_available_data\/wp-content\/uploads\/2018\/07\/morocco-outage.png 1250w\" sizes=\"(max-width: 701px) 100vw, 701px\" \/><\/a><\/p>\n<p>Internet outages do not always affect entire countries; their scope is frequently limited to <a href=\"https:\/\/timesofindia.indiatimes.com\/city\/mumbai\/maratha-quota-stir-internet-services-suspended-in-navi-mumbai\/articleshow\/65144524.cms\">regions<\/a> or <a href=\"https:\/\/money.cnn.com\/2018\/06\/29\/technology\/comcast-outage\/index.html\">autonomous systems<\/a> (ASes). IODA can detect such sub-national outages and, coming back to our example, did so for Morocco. The map below suggests that not all of the country&#8217;s regions were affected equally. Note, however, that IP address geolocation (that is, the mapping from IP address to geographical location) is <a href=\"https:\/\/www.caida.org\/publications\/papers\/2017\/look_at_router_geolocation\/look_at_router_geolocation.pdf\">far from perfect<\/a>, so take this information with a grain of salt.<\/p>\n<p><a href=\"https:\/\/blog.caida.org\/best_available_data\/wp-content\/uploads\/2018\/07\/morocco-affected-regions.png\"><img loading=\"lazy\" class=\"wp-image-4308 aligncenter\" src=\"https:\/\/blog.caida.org\/best_available_data\/wp-content\/uploads\/2018\/07\/morocco-affected-regions-300x102.png\" alt=\"\" width=\"700\" height=\"238\" srcset=\"https:\/\/blog.caida.org\/best_available_data\/wp-content\/uploads\/2018\/07\/morocco-affected-regions-300x102.png 300w, https:\/\/blog.caida.org\/best_available_data\/wp-content\/uploads\/2018\/07\/morocco-affected-regions-768x261.png 768w, https:\/\/blog.caida.org\/best_available_data\/wp-content\/uploads\/2018\/07\/morocco-affected-regions-1024x348.png 1024w, https:\/\/blog.caida.org\/best_available_data\/wp-content\/uploads\/2018\/07\/morocco-affected-regions.png 1878w\" sizes=\"(max-width: 700px) 100vw, 700px\" \/><\/a><\/p>\n<p>IODA determines an anomaly score for each outage that it detects. Our <a href=\"https:\/\/ioda.caida.org\/ioda\/help\">help page<\/a> provides more details on how we determine this score but in essence it&#8217;s a number that captures the severity of the outage. A look at IODA&#8217;s AS-level breakdown confirms that Maroc Telecom was affected the most\u2014the ISP&#8217;s overall anomaly score is more than twice that of Itissalat Al-Maghrib, the ISP that ranked second.<\/p>\n<p><a href=\"https:\/\/blog.caida.org\/best_available_data\/wp-content\/uploads\/2018\/07\/morocco-affected-ass.png\"><img loading=\"lazy\" class=\"wp-image-4306 aligncenter\" src=\"https:\/\/blog.caida.org\/best_available_data\/wp-content\/uploads\/2018\/07\/morocco-affected-ass-300x101.png\" alt=\"\" width=\"699\" height=\"235\" srcset=\"https:\/\/blog.caida.org\/best_available_data\/wp-content\/uploads\/2018\/07\/morocco-affected-ass-300x101.png 300w, https:\/\/blog.caida.org\/best_available_data\/wp-content\/uploads\/2018\/07\/morocco-affected-ass-768x258.png 768w, https:\/\/blog.caida.org\/best_available_data\/wp-content\/uploads\/2018\/07\/morocco-affected-ass-1024x344.png 1024w, https:\/\/blog.caida.org\/best_available_data\/wp-content\/uploads\/2018\/07\/morocco-affected-ass.png 1878w\" sizes=\"(max-width: 699px) 100vw, 699px\" \/><\/a><\/p>\n<p>So, what happened? IODA reveals <em>where<\/em> Internet outages happen but it cannot tell us <em>why<\/em>. Understanding an outage&#8217;s root cause still requires a human in the loop; mostly to read news reports and social media postings that mention the outage. In our example, a search of the Arabic-speaking part of the Internet for &#8220;morocco internet&#8221; led us to Maroc Telecom&#8217;s <a href=\"https:\/\/www.facebook.com\/maroctelecom\/posts\/1790425474340258\">Facebook page<\/a>, which cited a power outage as the cause:<\/p>\n<p><a href=\"https:\/\/blog.caida.org\/best_available_data\/wp-content\/uploads\/2018\/07\/morocco.png\"><img loading=\"lazy\" class=\"size-medium wp-image-4305 aligncenter\" src=\"https:\/\/blog.caida.org\/best_available_data\/wp-content\/uploads\/2018\/07\/morocco-300x188.png\" alt=\"\" width=\"300\" height=\"188\" srcset=\"https:\/\/blog.caida.org\/best_available_data\/wp-content\/uploads\/2018\/07\/morocco-300x188.png 300w, https:\/\/blog.caida.org\/best_available_data\/wp-content\/uploads\/2018\/07\/morocco.png 500w\" sizes=\"(max-width: 300px) 100vw, 300px\" \/><\/a><\/p>\n<p>The time span quoted by Maroc Telecom roughly confirms what IODA saw but our data suggests that the outage began earlier\u2014our active probers first saw a decline in connectivity at 11:30 pm\u2014about half an hour before the alleged start of the outage.<\/p>\n<p>We are supporting public access to <a href=\"https:\/\/ioda.caida.org\/ioda\/dashboard\">IODA&#8217;s dashboard<\/a> for exploration of this and other outages; please use it and send feedback to ioda-info AT caida DOT org.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Detecting Internet outages world-wide and in real-time is no small feat. It requires distributed measurement infrastructure, tools and processing power to analyze the resulting data, plenty of storage to save it, and a powerful user interface to visualize the data. IODA (short for Internet Outage Detection and Analysis) is CAIDA&#8217;s solution to this problem. In [&hellip;]<\/p>\n","protected":false},"author":30,"featured_media":0,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":[],"categories":[31,37],"tags":[],"coauthors":[54],"_links":{"self":[{"href":"https:\/\/blog.caida.org\/best_available_data\/wp-json\/wp\/v2\/posts\/4302"}],"collection":[{"href":"https:\/\/blog.caida.org\/best_available_data\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/blog.caida.org\/best_available_data\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/blog.caida.org\/best_available_data\/wp-json\/wp\/v2\/users\/30"}],"replies":[{"embeddable":true,"href":"https:\/\/blog.caida.org\/best_available_data\/wp-json\/wp\/v2\/comments?post=4302"}],"version-history":[{"count":55,"href":"https:\/\/blog.caida.org\/best_available_data\/wp-json\/wp\/v2\/posts\/4302\/revisions"}],"predecessor-version":[{"id":4369,"href":"https:\/\/blog.caida.org\/best_available_data\/wp-json\/wp\/v2\/posts\/4302\/revisions\/4369"}],"wp:attachment":[{"href":"https:\/\/blog.caida.org\/best_available_data\/wp-json\/wp\/v2\/media?parent=4302"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/blog.caida.org\/best_available_data\/wp-json\/wp\/v2\/categories?post=4302"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/blog.caida.org\/best_available_data\/wp-json\/wp\/v2\/tags?post=4302"},{"taxonomy":"author","embeddable":true,"href":"https:\/\/blog.caida.org\/best_available_data\/wp-json\/wp\/v2\/coauthors?post=4302"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}