<?xml version="1.0" encoding="UTF-8"?>
<rss version="2.0"
	xmlns:content="http://purl.org/rss/1.0/modules/content/"
	xmlns:wfw="http://wellformedweb.org/CommentAPI/"
	xmlns:dc="http://purl.org/dc/elements/1.1/"
	xmlns:atom="http://www.w3.org/2005/Atom"
	xmlns:sy="http://purl.org/rss/1.0/modules/syndication/"
	xmlns:slash="http://purl.org/rss/1.0/modules/slash/"
	>

<channel>
	<title>According to the Best Available Data</title>
	<atom:link href="http://blog.caida.org/best_available_data/feed/" rel="self" type="application/rss+xml" />
	<link>http://blog.caida.org/best_available_data</link>
	<description>A CAIDA Blog</description>
	<lastBuildDate>Thu, 12 Apr 2012 17:10:53 +0000</lastBuildDate>
	<language>en</language>
	<sy:updatePeriod>hourly</sy:updatePeriod>
	<sy:updateFrequency>1</sy:updateFrequency>
	<generator>http://wordpress.org/?v=3.2.1</generator>
		<item>
		<title>Twelve Years in the Evolution of the Internet Ecosystem</title>
		<link>http://blog.caida.org/best_available_data/2012/04/10/twelve-years-in-the-evolution-of-the-internet-ecosystem/</link>
		<comments>http://blog.caida.org/best_available_data/2012/04/10/twelve-years-in-the-evolution-of-the-internet-ecosystem/#comments</comments>
		<pubDate>Tue, 10 Apr 2012 18:50:54 +0000</pubDate>
		<dc:creator>amogh</dc:creator>
				<category><![CDATA[Commentaries]]></category>
		<category><![CDATA[Measurement]]></category>
		<category><![CDATA[Routing]]></category>

		<guid isPermaLink="false">http://blog.caida.org/best_available_data/?p=1144</guid>
		<description><![CDATA[Our recent study of the evolution of the Internet ecosystem over the last twelve years (1998-2010) appeared in the IEEE/ACM Transactions on Networking in October 2011. Why is the Internet an ecosystem? The Internet, commonly described as a network of networks, consists of thousands of Autonomous Systems (ASes) of different sizes, functions, and business objectives [...]]]></description>
			<content:encoded><![CDATA[<p>Our <a href="http://www.caida.org/publications/papers/2011/twelve_years_evolution/">recent study</a> of the evolution of the Internet ecosystem over the last twelve years (1998-2010) appeared in the IEEE/ACM Transactions on Networking in October 2011. Why is the Internet an ecosystem? The Internet, commonly described as a <em>network of networks</em>, consists of thousands of Autonomous Systems (ASes) of different sizes, functions, and business objectives that interact to provide the end-to-end connectivity that end users experience. ASes engage in transit (or customer-provider) relations, and also in settlement-free peering relations. These relations, which appear as <em>inter domain links</em> in an AS topology graph, indicate the transfer of not only traffic but also economic value between ASes. The Internet AS ecosystem is highly dynamic, experiencing growth (birth of new ASes), rewiring (changes in the connectivity of existing ASes), as well as deaths (of existing ASes). The dynamics of the AS ecosystem are determined both by external business environment factors (such as the state of the global economy or the popularity of new Internet applications) and by complex incentives and objectives of each AS.  Specifically, ASes attempt to optimize their utility or financial gains by dynamically changing, directly or indirectly, the ASes they interact with.</p>
<p>The goal of our study was to better understand this complex ecosystem, the behavior of entities that constitute it (ASes), and the nature of interactions between those entities (AS links). How has the Internet ecosystem been growing? Is growth a more significant factor than rewiring in the formation of new links? Is the population of transit providers increasing (implying diversification of the transit market) or decreasing (consolidation of the transit market)? As the Internet grows in its number of nodes and links, does the average AS-path length also increase? Which ASes engage in aggressive multihoming? Which ASes are especially active, i.e., constantly adjust their set of providers? Are there regional differences in how the Internet evolves? </p>
<p><span id="more-1144"></span><br />
To answer these questions, we analyzed AS-level topology snapshots constructed from publicly available routing tables collected at Routeviews/RIPE. We selected a series of topology snapshots spaced 3 months apart, spanning twelve years from 1998-2010. Unfortunately, the available historical datasets from RouteViews/RIPE are not sufﬁcient to study the evolution of settlement-free peering links. So we restricted the focus of this study to the evolution of AS types and of customer-provider links. We developed a method to classify ASes (with 75-80% accuracy according to our validation efforts, detailed in <a href="http://www.caida.org/publications/papers/2011/twelve_years_evolution/">our recent TON paper</a>) into a number of types depending on their business function, using observable topological properties of those ASes. The AS types we consider are large transit providers (LTP), small transit providers (STP), content/access/hosting providers (CAHP), and enterprise networks (EC).</p>
<p>Our findings highlight some important trends and evidence for how these trends may play out in the future:</p>
<ul>
<li>The IPv4 AS-level Internet has gone through two growth phases: an initial exponential phase up to mid/late-2001, followed by a slower exponential growth thereafter. Contrast this with the growth of the IPv6 AS-level graph, which has been growing exponentially since 2003.<br />
<a href="http://blog.caida.org/best_available_data/wp-content/uploads/2012/03/3m.sn_.v4v6.numNodes.png"><img src="http://blog.caida.org/best_available_data/wp-content/uploads/2012/03/3m.sn_.v4v6.numNodes-300x225.png" alt="" width="400" height="300" class="alignnone size-medium wp-image-1673" /></a><br />
(More analysis comparing growth trends in the IPv4 and IPv6 topologies coming soon!)
</li>
<li>The average path length, however, remains practically constant around 4 AS hops, meaning that <b>the network densifies</b>.</li>
<li>Currently, 81% of link births are associated with existing ASes rather than new ASes (rewiring versus growth); similarly, 86% of the link deaths are due to rewiring. <b>This implies that most of the dynamics in the network are due to births and deaths of links between existing ASes</b>.</li>
<li>We classified ASes according to economic considerations and business types. We find that most of the growth is due to Enterprise Customers (ECs) at the network edge. The average multihoming degree of ECs has remained roughly constant, but has increased significantly for other network types &#8212; transit providers (both regional and global), and Content/Access/Hosting providers. <b>The previously mentioned densification process is thus driven by transit providers and content/access/hosting providers</b>. In terms of rewiring, CAHPs appear to be the most active, while ECs are the least active.<br />
<a href="http://blog.caida.org/best_available_data/wp-content/uploads/2012/03/3m.sn_.all_.v4.perNodeProps.deg_.class4_.prov_.avg_1.png"><img src="http://blog.caida.org/best_available_data/wp-content/uploads/2012/03/3m.sn_.all_.v4.perNodeProps.deg_.class4_.prov_.avg_1-300x225.png" alt="" width="400" height="300" class="alignnone size-medium wp-image-1682" /></a></li>
<li>We introduced two provider metrics, <em>attractiveness</em> and <em>repulsiveness</em>, to quantify the ability of a provider to attract and retain customers. We found that both the attractiveness and repulsiveness of a provider are correlated to its customer degree. Also, many providers exhibit strong repulsiveness 3-9 months after exhibiting attractiveness, i.e., these providers attracted new customers but were unable to retain them. We define the set of providers that accounted for 70% of all customer gains across two consecutive topology snapshots as <em>attractors</em>, and the set of providers that accounted for 70% of all customer losses as <em>repellers</em>. We found that the set of attractors and repellers is increasing in size. This set of providers is dominated by those in North America and Europe; while the number of such providers in Europe is increasing, that number in other regions is relatively flat. This indicates that <b>the market of transit providers, at least in Europe, does not seem to be consolidating.</b></li>
<li>With respect to regional growth, we find that the Internet market, in terms of the number of enterprise, access/hosting/content and transit networks is now larger in Europe than in North America. Additionally, since 2004-2005, a larger fraction of active customers (customers that changed their set of providers between two consecutive snapshots) are in Europe than in North America. We note that these trends refer to the number of networks in various regions, and do not reflect the size of their customer base or advertised IP address space. <b>Our measurements hint at an increasing European influence on the Internet ecosystem</b>.</li>
</ul>
<p>We have made the datasets collected as part of this work <a href="http://www.caida.org/publications/papers/2011/twelve_years_evolution/supplement/">publicly available</a>. We have also developed an <a href="http://www.caida.org/cgi-bin/as_hist/as_hist.cgi">interactive interface</a> to the data that allows a user to query the historical connectivity (number of customers, providers, and peers) of a set of ASes. The user can also compare the connectivity of selected ASes with the average of different types of ASes &#8212; classfied according to their business types as Enterprise Customer, Small Transit Provider, Large Transit Provider, and Content/Access/Hosting Provider. We also allow the option of computing the degrees at the level of <i>organizations</i>. The user must enter an AS number belonging to the organization (e.g., 7018 for AT&amp;T), and if a matching organization is found for that AS number, we display the connectivity of the organization as a whole. We are in the process of expanding our AS-to-organization database, so in the future the script will incorporate a larger set of AS-organization mappings. </p>
]]></content:encoded>
			<wfw:commentRss>http://blog.caida.org/best_available_data/2012/04/10/twelve-years-in-the-evolution-of-the-internet-ecosystem/feed/</wfw:commentRss>
		<slash:comments>0</slash:comments>
		</item>
		<item>
		<title>Targeted Serendipity: the Search for Storage</title>
		<link>http://blog.caida.org/best_available_data/2012/04/04/targeted-serendipity-the-search-for-storage/</link>
		<comments>http://blog.caida.org/best_available_data/2012/04/04/targeted-serendipity-the-search-for-storage/#comments</comments>
		<pubDate>Wed, 04 Apr 2012 15:42:05 +0000</pubDate>
		<dc:creator>josh</dc:creator>
				<category><![CDATA[Commentaries]]></category>
		<category><![CDATA[Data Collection]]></category>
		<category><![CDATA[Economics]]></category>

		<guid isPermaLink="false">http://blog.caida.org/best_available_data/?p=1597</guid>
		<description><![CDATA[On the heels of our recent press release regarding fresh publications that  make use of the UCSD Network Telescope data, we would like to take a moment to thank the institutions that have helped preserve this data over the last eight years. Though we recently received an NSF award to enable  near-real-time sharing of this [...]]]></description>
			<content:encoded><![CDATA[<p>On the heels of our <a href="http://blog.caida.org/best_available_data/2012/03/28/internet-censorship-revealed-through-the-haze-of-malware-pollution/">recent press release</a> regarding fresh publications that  make use of the UCSD Network Telescope data, we would like to take a moment to thank the institutions that have helped preserve this data over the last eight years. Though we recently received an <a title="(NSF CNS-1059439) CRI-Telescope: A Real-time Lens into Dark Address Space of the Internet " href="http://www.caida.org/funding/cri-telescope/">NSF award</a> to enable  near-real-time sharing of this data as well as improved classification, the award does not cover the cost to maintain this historic archive. At current <a href="http://rci.ucsd.edu/services/storage.html">UCSD rates</a>, the 104.66 TiB would cost us approximately $40,000 per year to store. This does not take into account the metadata we have collected which adds roughly 20 TB to the original data.  As a result, we had spent the last several months indexing this data in preparation for deleting it forever.</p>
<p>Then, last month, I had the opportunity to attend the <a title="Security at the Cyberborder Workshop" href="https://scholarworks.iu.edu/dspace/handle/2022/14070">Security at the Cyberborder Workshop</a> in Indianapolis. This workshop focused on how the <a href="http://www.nsf.gov/pubs/2009/nsf09564/nsf09564.htm">NSF-funded</a> <a href="http://irnclinks.net/">IRNC networks</a> might (1) capture and articulate technical and policy cybersecurity considerations related to international research network connections, and (2) capture opportunities and challenges for the those connections to foster cybersecurity research.  I did not expect to find a new benefactor for storage of our telescope data at the workshop though, in fact, I did.</p>
<p><span id="more-1597"></span><br />
During the workshop, I mentioned to the group that  we were preparing to purge historic darknet data for lack of funds to pay for storage. Upon hearing of our plans to delete  the data, a NERSC System Administrator offered to store the data in NERSC&#8217;s tape archive. He understood the relevance of the data to cybersecurity research and the value of longitudinal analysis on this fairly rare and unique data type. In less than a month, we had accounts and began the work of moving the data.</p>
<p>CAIDA would like to thank the San Diego Supercomputer Center for archiving the UCSD Network Telescope data since 2003. The IBM HPSS  and more recently Sun SamQFS archival storage systems dutifully preserved and delivered the 100+ Terabytes of raw pcap traces we have archived over the last eight years.</p>
<p>We would also like to thank the National Energy Research Scientific Computing Center (NERSC) and ESnet for the resources that  allowed us to continue to preserve this data. On 22 March 2012, we started the transfer via ESnet shown in-flight in Figure 1  to  the NERSC HPSS facilities. The transfer completed in roughly one week&#8217;s time and sustained an average of 1.52 Gbps limited by local host disk I/O.</p>
<div id="attachment_1698" class="wp-caption aligncenter" style="width: 310px"><a href="http://blog.caida.org/best_available_data/wp-content/uploads/2012/03/120TB-transfer-March2012-SDSC-to-NERSC.png"><img class="size-medium wp-image-1698 " title="120 TB Transfer from SDSC to NERSC via ESnet" src="http://blog.caida.org/best_available_data/wp-content/uploads/2012/03/120TB-transfer-March2012-SDSC-to-NERSC-300x187.png" alt="120 TB Transfer from SDSC to NERSC via ESnet" width="300" height="187" /></a><p class="wp-caption-text">Figure 1. 100+ TB transfer of UCSD Network Telescope data from SDSC to NERSC via ESnet.</p></div>
<p>Figure 2 below presents an interesting heat map visualization of the data collection volume. Each vertical bar represents one day of data, while the horizontal bands represent the size of a compressed file (in pcap format) of captured traffic for an hour of the day. We color each data point based on its deviation from the median hourly captured traffic file size. Specifically, an hour equal to the median file size we color red. Hours with (compressed) traffic volumes at twice (or more) of the median  we color yellow, and hours with no data appear black. So, hotter colors mean more data. Data collection on the telescope is a best-effort service &#8212; outages show up as vertical black bars. This plot also reveals an increase in the amount of data stored after April 2009 due to the removal of an upstream rate limit filter on incoming packets (We removed that filter in the wake of the advent of the Conficker worm, in order to <a href="http://www.caida.org/research/security/ms08-067/conficker.xml">study it</a>.) The color changes in the heat map also show the diurnal variation in traffic volume, although since this type of traffic originates from most time zones of the world, the &#8220;busy hour&#8221; is not sharply delineated.</p>
<div id="attachment_1654" class="wp-caption aligncenter" style="width: 410px"><a href="http://blog.caida.org/best_available_data/wp-content/uploads/2012/03/2012-03-29.nersc_.telescope.pcap_archive.heatmap.png"><img class="size-medium wp-image-1654 " title="Heatmap of the UCSD Network Telescope data" src="http://blog.caida.org/best_available_data/wp-content/uploads/2012/03/2012-03-28.samqfs.telescope.pcap_archive.heatmap2-300x120.png" alt="Heatmap of the UCSD Network Telscope data" width="400" height="200" /></a><p class="wp-caption-text">Figure 2. Heatmap of the UCSD Network Telescope data.</p></div>
]]></content:encoded>
			<wfw:commentRss>http://blog.caida.org/best_available_data/2012/04/04/targeted-serendipity-the-search-for-storage/feed/</wfw:commentRss>
		<slash:comments>0</slash:comments>
		</item>
		<item>
		<title>Internet Censorship Revealed Through the Haze of Malware Pollution</title>
		<link>http://blog.caida.org/best_available_data/2012/03/28/internet-censorship-revealed-through-the-haze-of-malware-pollution/</link>
		<comments>http://blog.caida.org/best_available_data/2012/03/28/internet-censorship-revealed-through-the-haze-of-malware-pollution/#comments</comments>
		<pubDate>Wed, 28 Mar 2012 20:08:28 +0000</pubDate>
		<dc:creator>josh</dc:creator>
				<category><![CDATA[Commentaries]]></category>
		<category><![CDATA[Data Collection]]></category>
		<category><![CDATA[Measurement]]></category>

		<guid isPermaLink="false">http://blog.caida.org/best_available_data/?p=1571</guid>
		<description><![CDATA[We were happy to see the coverage of UCSD&#8217;s press release describing two papers we recently published, introducing new methods and applications for analyzing dark net data (aka &#8220;Internet background radiation&#8221; or IBR).  The first paper, &#8220;Analysis of Country-wide Internet Outages Caused by Censorship&#8221;, presented by author Alberto Dainotti last November at IMC 2011, focused [...]]]></description>
			<content:encoded><![CDATA[<p>We were happy to see the coverage of UCSD&#8217;s <a href="http://ucsdnews.ucsd.edu/pressreleases/internet_censorship_revealed_through_the_haze_of_malware_pollution/" target="_blank">press release</a> describing two papers we recently published, introducing new methods and applications for analyzing dark net data (aka &#8220;Internet background radiation&#8221; or IBR).  The first paper, <a title="Analysis of Country-wide Internet Outages Caused by Censorship" href="http://conferences.sigcomm.org/imc/2011/program.htm" target="_blank">&#8220;Analysis of Country-wide Internet Outages Caused by Censorship&#8221;</a>, presented by author Alberto Dainotti last November at IMC 2011, focused on using IBR in conjunction with other data sources to reveal previously unreported aspects of the disruptions seen during the uprisings of early 2011 in Egypt and Libya. The second paper, <a title="Extracting benefit from harm: using malware pollution to analyze the impact of political and geophysical events on the Internet" href="http://www.sigcomm.org/ccr/papers/2012/January/2096149.2096154" target="_blank">&#8220;Extracting benefit from harm: using malware pollution to analyze the impact of political and geophysical events on the Internet&#8221;</a>, published in ACM SIGCOMM CCR (January 12), used IBR data observed by UCSD&#8217;s network telescope to characterize Internet outages caused by natural disasters. In both cases the analysis of this (mostly malware-generated) background traffic contributed to our understanding of events unrelated to the malware itself. Our press release was picked up by several online publications, including <a href="http://blogs.wsj.com/tech-europe/2012/03/12/internet-background-radiation-reveals-disasters-and-censorship/" target="_blank">The Wall Street Journal Blog</a>, <a href="http://technews.acm.org/archives.cfm?fo=2012-03-mar/mar-12-2012.html#571312">ACM Technews</a>, <a href="http://cacm.acm.org/news/146966-internet-censorship-revealed-through-the-haze-of-malware-pollution/fulltext">Communications of the ACM Web site</a>, <a href="http://www.spacedaily.com/reports/Internet_Censorship_Revealed_Through_the_Haze_of_Malware_Pollution_999.html">Spacedaily</a>, <a href="http://www.physorg.com/news/2012-03-internet-censorship-revealed-haze-malware.html">Physorg</a>, <a href="http://www.tomsguide.com/us/ibr-Internet-junk-traffic-censorship,news-14416.html">Tom&#8217;s Guide</a>, <a href="http://www.pddnet.com/news-internet-censorship-revealed-through-the-haze-of-malware-pollution-030712/">Product Design &amp; Development</a>, <a href="http://www.newswise.com/articles/internet-censorship-revealed-through-the-haze-of-malware-pollution">Newswise</a>, <a href="http://www.domain-b.com/technology/20120309_malware_pollution.html">Domain-b</a>, <a href="http://www.eurekalert.org/pub_releases/2012-03/uoc--icr030712.php">EurekAlert</a>, <a href="http://www.eurasiareview.com/07032012-internet-censorship-revealed-through-haze-of-malware-pollution/">Eurasia review</a>, <a href="http://www.silobreaker.com/internet-censorship-revealed-through-the-haze-of-malware-pollution-5_2265547536569729027">SiloBreaker</a>, <a href="http://security-today.com/articles/2012/03/12/internet-censosrship-revealed-through-haze-of-malware-pollution.aspx?admgarea=ht.networkcentric">Security-today.com</a>, <a href="http://www.everythingsandiego.net/15064-web-censorship-revealed-through-malware-pollution/">Everything San Diego</a>, <a href="http://www.spacewar.com/reports/Internet_Censorship_Revealed_Through_the_Haze_of_Malware_Pollution_999.html">Spacewar Cyber War</a>.</p>
<p>The papers are also available on CAIDA&#8217;s <a href="http://www.caida.org/publications/papers/">publications page</a>.</p>
]]></content:encoded>
			<wfw:commentRss>http://blog.caida.org/best_available_data/2012/03/28/internet-censorship-revealed-through-the-haze-of-malware-pollution/feed/</wfw:commentRss>
		<slash:comments>0</slash:comments>
		</item>
		<item>
		<title>Second Workshop on Internet Economics (WIE2011)</title>
		<link>http://blog.caida.org/best_available_data/2012/03/05/second-workshop-on-internet-economics-wie2011/</link>
		<comments>http://blog.caida.org/best_available_data/2012/03/05/second-workshop-on-internet-economics-wie2011/#comments</comments>
		<pubDate>Tue, 06 Mar 2012 00:52:52 +0000</pubDate>
		<dc:creator>kc</dc:creator>
				<category><![CDATA[Commentaries]]></category>
		<category><![CDATA[Economics]]></category>
		<category><![CDATA[Policy]]></category>

		<guid isPermaLink="false">http://blog.caida.org/best_available_data/?p=1545</guid>
		<description><![CDATA[As part of our NSF-funded network research project on modeling Internet interconnection dynamics, we hosted the second Workshop on Internet Economics (WIE2011) last December 1-2. The goal of the workshop was to bring together network technology and policy researchers with providers of commercial Internet facilities and services (network operators) to further explore the common objective [...]]]></description>
			<content:encoded><![CDATA[<p>As part of our NSF-funded network research project on <a href="http://www.caida.org/projects/interconnection_econ/">modeling Internet interconnection</a> dynamics, we hosted the second Workshop on Internet Economics (WIE2011) last December 1-2.  The goal of the workshop was to bring together network technology and policy researchers with providers of commercial Internet facilities and services (network operators) to further explore the common objective of framing an agenda for the emerging but empirically stunted field of Internet infrastructure economics. The <a href="http://www.caida.org/publications/papers/2012/wie11_report/">final report</a> (<a href="http://www.caida.org/publications/papers/2012/wie11_report/">http://www.caida.org/publications/papers/2012/wie11_report/</a>) attempts to capture the content, structure, and depth of the discussions, and presents relevant open research questions identified by workshop participants. From the intro (but the <a href="http://www.caida.org/publications/papers/2012/wie11_report/wie11_report.pdf">5-page pdf</a> is worth reading):<br />
<span id="more-1545"></span></p>
<blockquote><p><i>Building on the success of our first (virtual) Workshop on Internet Economics (WIE09), we expanded the scope and depth of the second workshop in this series, inviting experts in the following topics of interest: peering strategies and conflicts; content delivery; traffic and topology dynamics of the peering ecosystem; sustainable business models and industry structure.  The workshop format was structured to promote constructive, focused engagement.   Attendees presented research results, offered updates on data sources, moderated topic discussions, served as formal respondents to other speakers, and critiqued the relevance and potential impact of the presented results An intended goal was to establish a set of open questions that can frame an Internet economics research agenda, and more specifically to improve the realism, utility, and predictive power of economic models of Internet topology and dynamics.   Even this expanded scope falls short of the recognized breadth of the emerging discipline of Internet economics; we plan to include other recurring issues and questions at the next workshop, including the economics of privacy, advertising, censorship, and intellectual property.<br />
</i></p></blockquote>
]]></content:encoded>
			<wfw:commentRss>http://blog.caida.org/best_available_data/2012/03/05/second-workshop-on-internet-economics-wie2011/feed/</wfw:commentRss>
		<slash:comments>0</slash:comments>
		</item>
		<item>
		<title>NASA&#8217;s recent DNSSEC snafu and the checklist</title>
		<link>http://blog.caida.org/best_available_data/2012/02/16/nasas-recent-dnssec-snafu-and-the-checklist/</link>
		<comments>http://blog.caida.org/best_available_data/2012/02/16/nasas-recent-dnssec-snafu-and-the-checklist/#comments</comments>
		<pubDate>Thu, 16 Feb 2012 19:01:54 +0000</pubDate>
		<dc:creator>kc</dc:creator>
				<category><![CDATA[Commentaries]]></category>
		<category><![CDATA[Domain Name System (DNS)]]></category>
		<category><![CDATA[Routing]]></category>
		<category><![CDATA[Suggestions]]></category>

		<guid isPermaLink="false">http://blog.caida.org/best_available_data/?p=1511</guid>
		<description><![CDATA[Reading about NASA&#8217;s recent DNSSEC snafu, and especially Comcast&#8217;s impressively cogent description of what went wrong (i.e., a mishap that seems way too easy to &#8216;hap&#8217;), I&#8217;m reminded of the page I found most interesting in The Checklist Manifesto: We&#8217;re obsessed in medicine with having great components &#8212; the best drugs, the best devices, the [...]]]></description>
			<content:encoded><![CDATA[<p>Reading about <a href="http://www.darkreading.com/authentication/167901072/security/application-security/232500483/dnssec-error-caused-nasa-website-to-be-blocked.html">NASA&#8217;s recent DNSSEC snafu</a>, and especially Comcast&#8217;s <a href="http://www.dnssec.comcast.net/DNSSEC_Validation_Failure_NASAGOV_20120118_FINAL.pdf">impressively cogent description of what went wrong</a> (i.e., a mishap that seems way too easy to &#8216;hap&#8217;), I&#8217;m reminded of the page I found most interesting in <a href="http://www.amazon.com/Checklist-Manifesto-How-Things-Right/dp/0805091742">The Checklist Manifesto</a>:</p>
<p><span id="more-1511"></span></p>
<blockquote><p>
We&#8217;re obsessed in medicine with having great components &#8212; the best drugs, the best devices, the best specialists &#8212; but pay little attention to how to make them fit together well. Berwick (president of the Institute for Healthcare Improvement in Boston) notes, &#8220;Anyone who understands systems will know immediately that optimizing parts is not a good route to system excellence&#8221;&#8230;  He gives the example of a famous thought experiment of trying to build the world&#8217;s greatest car by assembling the world&#8217;s greatest car parts.  We connect the engine of a Ferrari, the brakes of a Porsche, the suspension of a BMW, the body of a Volvo.  &#8220;What we get, of course, is nothing close to a great car; we get a pile of very expensive junk.&#8221;</p>
<p>Nonetheless, in medicine that&#8217;s exactly what we have done. We have a $30B/year National Institutes of Health, which has been a remarkable powerhouse of medical discoveries.  But we have no National Institute of Health Systems Innovation alongside it studying how best to incorporate these discoveries into daily practice &#8212; no NTSB equivalent swooping in to study failures the way crash investigators do, no Boeing mapping out the checklists, no agency tracking the month-to-month results.</p>
<p>The same can be said in numerous other fields. We don&#8217;t study routine failures in teaching, in law, in government programs, in the financial industry, or elsewhere.  We don&#8217;t look for the patterns of our recurrent mistakes or devise and refine potential solutions for them.</p>
<p>But we could, and that is the ultimate point.  We are all plagued by failures &#8212; by missed subtleties, overlooked knowledge, and outright errors.   For the most part, we have imagined that little can be done beyond working harder to catch the problem and clean up after them.  We are not in the habit of thinking the way army pilots did as they looked upon their shiny new Model 299 bomber &#8212; a machine so complex no one was sure human beings could fly it.  They too could have decided just to &#8220;try harder&#8221; or to dismiss a crash as the failings of a &#8220;weak&#8221; pilot.</p>
<p>Instead they chose to accept their fallibilities. They recognized the simplicity and power of using a checklist.</p>
<p>And so can we. Indeed, against the complexity of the world, we must.  There is no other choice.  When we look closely, we recognize the same balls being dropped over and over, even by those of great ability and determination.  We know the patterns.  We see the costs.  It&#8217;s time to try something else.</p>
<p>Try a checklist.</p>
<p><em>The Checklist Manifesto</em>, Atul Gawande.
</p></blockquote>
<p>More on this topic the next time it happens, which I reckon won&#8217;t be too far into the future.  (Cringe.)</p>
]]></content:encoded>
			<wfw:commentRss>http://blog.caida.org/best_available_data/2012/02/16/nasas-recent-dnssec-snafu-and-the-checklist/feed/</wfw:commentRss>
		<slash:comments>0</slash:comments>
		</item>
		<item>
		<title>The Menlo Report and its Companion bring ethical guidelines to ITC research</title>
		<link>http://blog.caida.org/best_available_data/2012/02/07/the-menlo-report-and-its-companion-bring-ethical-guidelines-to-itc-research/</link>
		<comments>http://blog.caida.org/best_available_data/2012/02/07/the-menlo-report-and-its-companion-bring-ethical-guidelines-to-itc-research/#comments</comments>
		<pubDate>Wed, 08 Feb 2012 06:22:12 +0000</pubDate>
		<dc:creator>josh</dc:creator>
				<category><![CDATA[Commentaries]]></category>
		<category><![CDATA[Policy]]></category>

		<guid isPermaLink="false">http://blog.caida.org/best_available_data/?p=1521</guid>
		<description><![CDATA[Finally, a process we started almost three years ago has reached a milestone: the first public draft of The Menlo Report: Ethical Principles Guiding Information and Communication Technology Research and its Companion Report were posted on the DHS and SRI web sites (respectively) last month. DHS&#8217;s Science and Technology Directorate, through its PREDICT program, sponsored [...]]]></description>
			<content:encoded><![CDATA[<p>Finally, a process we started <a href="http://blog.caida.org/best_available_data/2009/06/12/what%E2%80%99s-belmont-got-to-do-with-it/">almost three years ago</a> has reached a milestone: the first public draft of <a href="http://www.cyber.st.dhs.gov/wp-content/uploads/2011/12/MenloPrinciplesCORE-20110915-r560.pdf">The Menlo Report: Ethical Principles Guiding Information and Communication Technology Research</a> and its <a href="http://www.cyber.st.dhs.gov/wp-content/uploads/2012/01/MenloPrinciplesCOMPANION-20120103-r731.pdf">Companion Report</a> were posted on the DHS and SRI web sites (respectively) last month. </p>
<p>DHS&#8217;s Science and Technology Directorate, through its <a href="http://www.predict.org/">PREDICT</a> program, sponsored this report on ethics in Information and Communication Technology Research (ICTR). The culmination of a multi-year effort by network and security research stakeholders to lay out a guiding framework to identify, navigate, and resolve ethical issues in ICTR, this report is intended to be a dialogue launch point for the community of researchers, oversight entities, and policymakers to reflect on ethical issues in security and network research. Public comments are encouraged via the <a href="http://federalregister.gov/a/2011-33231">Federal Register</a> through 27 February 2012.  I&#8217;m pretty sure all comments are responded to and/or integrated into the next version of this report.  Hopefully the report will also be the topic of discussion at some conferences and workshops this year, so that the community can get out ahead of these issues before we find ourselves facing legislative overreaction to catastrophe (or even perceived catastrophe).  Please consider reading and submitting a comment.</p>
]]></content:encoded>
			<wfw:commentRss>http://blog.caida.org/best_available_data/2012/02/07/the-menlo-report-and-its-companion-bring-ethical-guidelines-to-itc-research/feed/</wfw:commentRss>
		<slash:comments>0</slash:comments>
		</item>
		<item>
		<title>The 2nd NDN Project Retreat</title>
		<link>http://blog.caida.org/best_available_data/2012/02/05/the-2nd-ndn-project-retreat/</link>
		<comments>http://blog.caida.org/best_available_data/2012/02/05/the-2nd-ndn-project-retreat/#comments</comments>
		<pubDate>Sun, 05 Feb 2012 19:02:56 +0000</pubDate>
		<dc:creator>kc</dc:creator>
				<category><![CDATA[Commentaries]]></category>
		<category><![CDATA[Future]]></category>
		<category><![CDATA[Measurement]]></category>
		<category><![CDATA[Review]]></category>

		<guid isPermaLink="false">http://blog.caida.org/best_available_data/?p=1449</guid>
		<description><![CDATA[I kicked off 2012 with a visit to Colorado State University in Fort Collins, CO to attend the principal investigators (PI) retreat for the Named Data Networking Project, one of four projects funded under NSF&#8217;s &#8220;Future Internet Architecture&#8221; (FIA) program. Impressive progress since the first FIA meeting, with substantial development and coordination of the NDN [...]]]></description>
			<content:encoded><![CDATA[<p>I kicked off 2012 with a visit to Colorado State University in Fort Collins, CO to attend the principal investigators (PI) retreat for the <a href="http://www.named-data.net/">Named Data Networking Project</a>, one of four projects funded under NSF&#8217;s <a href="http://www.nsf.gov/news/news_summ.jsp?cntn_id=117611">&#8220;Future Internet Architecture&#8221; (FIA) program</a>.  Impressive progress since <a title="my first FIA meeting" href="http://blog.caida.org/best_available_data/2011/01/05/my-first-future-internet-architecture-pi-meeting/">the first FIA meeting</a>, with substantial development and coordination of the <a title="Named Data Networking Testbed" href="http://www.named-data.net/testbed.html">NDN Testbed</a> connecting the initial <a href="http://www.named-data.org/institutions.html">participating institutions</a>, including <a href="http://cgi.cs.arizona.edu/~yifengl/tbs.cgi">network status reporting</a>, <a href="http://netlab.cs.memphis.edu/NDNtestbed-ospf/status.html"> state of (phase-one) OSPF routing</a>, and <a href="http://www.cs.arizona.edu/people/yifengl/testbed_status2.html">testbed status pages</a>. This two-day meeting packed in a wide range of collaborative discussions of architecture and implementation issues, including: topology and namespace structure and constraints; organizational structure and network management; routing and forwarding strategy; security issues such as attribution and privacy; early experiences with application development; evaluation and measurement; social and ethical values in technology design; and educational outreach (classes teaching NDN concepts). We also discussed how to dispel the misconception that NDN is simply collaborative web caching. (<em>The caching is essential but the most revolutionary piece of this new communication model is retrieving data by names.</em>)</p>
<p><span id="more-1449"></span></p>
<p>Those familiar with the new <a href="http://www.cs.ucla.edu/~lixia/WhatIsICN.html">emerging information-centric networking</a> movement in the computer science research community will recognize NDN&#8217;s fundamental theme: replace the <em>endpoint</em> (identified by an IP address) as the fundamental anchor of the communications architecture with the <em>data</em> (identified by a name). To communicate in NDN, users post named <em>interest(s)</em> that propagate toward where the data resides (now relying on conventional routing protocols for the underlying routing fabric but eventually hopefully using <a href="http://www.caida.org/funding/nets-find/">previously developed</a> <a href="http://blog.caida.org/best_available_data/2009/10/12/future_internet_thoughts/">revolutionary greedy routing mechanisms</a>) and receives, from cryptographically vetted publishers, signed object(s) matching the requests. Conceptually simple, with many collateral benefits offered by the <em>minimization of unnecessary layers</em>. The application is much closer to the network.  Mobility is inherent, since the notion of location has been removed as an architectural anchor.</p>
<p>While at least <a href="http://named-data.net/publications.html">a dozen papers have resulted</a> from this project thus far, even more tangible progress has occurred on the <a href="http://www.ccnx.org">development</a> and <a href="http://named-data.net/testbed.html">experimental deployment</a> side. A key strength of this project (<a title="my first FIA meeting" href="http://blog.caida.org/best_available_data/2011/01/05/my-first-future-internet-architecture-pi-meeting/">as mentioned previously</a>) is a deployment path via a testbed overlay on the current Internet.  Beichuan Zhang and Lan Wang have coordinated an <a href="https://github.com/NDN-Routing/OSPFN">OSPFN</a> implementation that distributes name prefixes in OSPF and ccnd, and a <a href="https://github.com/NDN-Routing/ccnx-dhcp">ccnx-dhcp</a> to help local bootstrapping, which will eventually include configuring default routes, local topology and hub discovery. Applications are already running on the NDN testbed including <a title="NDN audio, video, and chat clients" href="http://irl.cs.ucla.edu/~zhenkai/act-mac.html">audio, video, and multi-user chat</a>, which are being used by weekly project coordination calls; additional performance-related testing has been conducted using <a title="SPP" href="http://wiki.arl.wustl.edu/index.php/Internet_Scale_Overlay_Hosting" target="_blank">supercharged PlanetLab nodes</a>.</p>
<p>In parallel, different teams are pursuing the various threads of <a href="http://named-data.net/ndn-proj.pdf">research promised</a> for the NSF project. Patrick Crowley is leading the investigation of how fast we can get NDN nodes to forward packets, and building traffic generators to evaluate and inform the protocol design. The security research team will present their <a href="http://arxiv.org/abs/1112.2205">first preliminary analysis of privacy, anonymization, and signature efficiency</a> in NDN at this month&#8217;s <a href="http://www.isoc.org/isoc/conferences/ndss/12/">NDSS conference</a>. Edmund Yeh is creating a stochastic control and optimization framework to to formally (analytically) evaluate network performance, as well as coupling theoretical and experimental evaluation of joint forwarding and caching algorithms.</p>
<p>One of the next big R&amp;D challenges is effective measurement techniques, not only for network management and performance evaluation &#8212; (<em>&#8220;This node is being flooded with interests!&#8221;)</em> &#8212; but also to support new types of network routing and application development and debugging (<em>&#8220;Why is my application not getting the data?&#8221;</em>).<br />
<!--<br />
For example, currently in NDN reliable delivery requires retransmission of unsatisfied interests after an application-dependent timeout (4s by default, until we learn otherwise).<br />
LZ: not sure this example helps...<br />
--></p>
<p>We still need to study the impact of topology structure on network operations and management as we expand the set of external participants experimenting with the current platform and applications.  We also still need core management functions such as methods to identify misbehaving nodes/apps, tools for debugging, log analysis, and traffic flow, the equivalents of <a href="http://en.wikipedia.org/wiki/Chargen">chargen</a>, <a href="http://en.wikipedia.org/wiki/Traceroute">traceroute</a>, mechanisms for discovering one&#8217;s own local globally routable namespace (NDN prefix discovery) and other routing and institutional key information when joining a new network.</p>
<p>And of course, the eye of the volcano: the data namespace that NDN utlizes, including policy-relevant constraints that might determine what information should be exposed by the namespace structure. Because NDN object names may convey topological as well as content information, network elements could present treasures of performance, topology, and usage data that we can only dream about in the current architecture. But unlike today&#8217;s Internet, which convolves topological and organizational (peering) structure with the Autonomous System abstraction, the NDN architecture distinguishes these functions: signatures frame organizational/peer structure, while names frame the topological structure.  There are obvious and not-so-obvious implications for privacy and attribution of communications, and we devoted an entire session to discussing social values that guide design decisions, with attorney Paul Ohm promising to help us assess the strength and form of expected tussles should an NDN architecture gain deployment traction.</p>
<p>Colorado State (home of PIs Dan Massey and Christos Papadopoulos) did a fantastic job of hosting the meeting, including a poster session and reception the evening of the first day. Several posters described undergraduate projects in Christos&#8217; recent undergrad class on on NDN networking</a>: running a traditional (modified) IP web traffic generator over the NDN testbed; repeating (and confirming) the 2009 <a href="http://conferences.sigcomm.org/co-next/2009/papers/Jacobson.pdf">CoNEXT paper</a> experiment on PlanetLab); and a content caching study at CSU&#8217;s border router (estimating how much content is static (about half by requests) vs dynamic, and redundant request patterns). The second day included lots of discussion of what applications and supporting tools we should pursue next: including a graphical name space browser; graphical PIT viewer; a serverless Twitter-like application with scope control over message distribution; and a distributed, topic-based discussion board application to facilitate collaboration.</p>
<p>Toward the end of the meeting we discussed NSF&#8217;s request for thoughts about next steps after the <a>FIA program</a> currently funding this work (now half-way through its three-year budget). There are tremendous opportunities for synergy with other NSF-funded information science communities such as the <a href="http://www.nsf.gov/funding/pgm_summ.jsp?pims_id=503286"> Cyber-Physical Systems</a> or the <a href="http://www.nsf.gov/funding/pgm_summ.jsp?pims_id=503141">DataNets</a> programs, to experimental deployment in production science settings such as the <a href="http://www.opensciencegrid.org/">Open Science Grid</a> (OSG), a national distributed computing grid for data-intensive research. Perhaps most exciting is the potential opportunity that Kevin Thompson (of NSF&#8217;s <a href="http://www.nsf.gov/dir/index.jsp?org=OCI">Office of Cyberinfrastructure</a>) <a href="http://www.internet2.edu/presentations/jt2012winter/20120124-Thompson-NSF.pdf">described</a> at Internet2&#8242;s last <a href="http://events.internet2.edu/2012/jt-loni/">Joint Techs meeting</a>: in response to recently commissioned <a href="http://www.nsf.gov/od/oci/taskforces/TaskForceReport_CampusBridging.pdf">strategic advice</a>, NSF wants to leverage successful R&#038;D investments by transitioning them into campus environments on a broad scale, i.e., with a dedicated program.  Since the NDN architecture was designed to solve many of the problems now being faced by campus networks (as well as the rest of the world), I&#8217;m optimistic that we could someday see an NDN-<a href="http://www.nsfnet-legacy.org/about.php">NSFNET</a>. Lots of known unknowns and unknown unknowns along that path, but what an exciting path!</p>
<p><em>[Thanks to our lead PI <a href="http://www.cs.ucla.edu/~lixia/">Lixia Zhang</a> of UCLA for help with this entry.]</em></p>
]]></content:encoded>
			<wfw:commentRss>http://blog.caida.org/best_available_data/2012/02/05/the-2nd-ndn-project-retreat/feed/</wfw:commentRss>
		<slash:comments>0</slash:comments>
		</item>
		<item>
		<title>Shutting the phone network off while you&#8217;re running out of internet protocol numbers</title>
		<link>http://blog.caida.org/best_available_data/2012/01/20/shutting-the-phone-network-off-while-youre-running-out-of-internet-protocol-numbers/</link>
		<comments>http://blog.caida.org/best_available_data/2012/01/20/shutting-the-phone-network-off-while-youre-running-out-of-internet-protocol-numbers/#comments</comments>
		<pubDate>Fri, 20 Jan 2012 08:32:44 +0000</pubDate>
		<dc:creator>kc</dc:creator>
				<category><![CDATA[Commentaries]]></category>
		<category><![CDATA[Policy]]></category>
		<category><![CDATA[Topology]]></category>

		<guid isPermaLink="false">http://blog.caida.org/best_available_data/?p=1482</guid>
		<description><![CDATA[I ended 2011 with a short (20 December) visit to a pleasantly warm Washington, D.C. for my 5th FCC Technical Advisory Council meeting. Some of the discussions from the third meeting were extended, others cut off for lack of time. We spent over an hour on the suggestion made by the Legacy Transition working group [...]]]></description>
			<content:encoded><![CDATA[<p>I ended 2011 with a short (20 December) visit to a pleasantly warm Washington, D.C. for my <a href="http://www.fcc.gov/events/technological-advisory-council-meeting-16">5th FCC Technical Advisory Council meeting</a>.  Some of the discussions from the third meeting were extended, others cut off for lack of time.  We spent over an hour on the suggestion made by the Legacy Transition working group <a href="http://blog.caida.org/best_available_data/2011/07/25/my-third-fcc-tac-meeting-the-most-exciting-yet/">two meetings ago</a> to advise the FCC to move forward in sunsetting (although we shunned that term at this meeting &#8212; &#8220;It&#8217;s a new beginning, not an end!&#8221;) the public-switched telephone network (PSTN).  Many questions have arisen repeatedly in the discussions over the course of the last two meetings (and <a href="http://connectedplanetonline.com/independent/news/PSTN-phase-out-workshop-endeavors-to-separate-the-baby-from-the-bath-water-1215/">two FCC workshops in between</a>), notably, &#8220;What happens to the telephony numbering system?&#8221; The initial strategy was imprecise, &#8220;The numbering plan will continue to exist but governance and allocation process needs to be considered.&#8221;   Another repeated question has been <a href="http://www.jsicapitaladvisors.com/the-ilec-advisor/2011/12/15/the-pstn-is-already-in-transition-what-is-the-pstn-anyway.html">&#8220;What exactly do we mean by PSTN?&#8221;</a></p>
<p><span id="more-1482"></span></p>
<p>Interestingly, at this meeting the FCC staff themselves presented some thoughts on the way forward for the PSTN, before the working group got to present, thus some redundancy ensued.   Still no resolution on numbering, or its post-PSTN replacement &#8220;identification&#8221;.   Several TAC members including Vint Cerf and Dan Reed emphasized the importance of naming conventions for an expansive set of services now displacing what we used to call voice. Furthermore, since most people still use mobile phones in the same small set of locations, the permanent connectivity or attachment of the phone number to the individual is even more fundamental to the architecture than constant mobility.  </p>
<p>As the working group emphasized back in July, the PSTN transition is neither a TAC nor an FCC initiative &#8212; consumers are driving it, i.e., dropping their landlines with alacrity. There was rough consensus on the need to consider several technical and policy issues, including: promoting competition; universality and carrier of last resort (including USF and reciprocal compensation); transitioning services that depend on the PSTN; reliability, continuity, accessibiity, 911; homeland security/CALEA; and privacy/personal security.  Open questions include those as mechanical as &#8220;What replaces RJ11?&#8221; and as economic as &#8220;What/Where are the most efficient points of interconnection?&#8221; (Well, both questions bear mechanical and economic considerations.) The industry still lack IP-based technical standards to ensure quality and reliability of voice, and the FCC&#8217;s regulatory posture carries an embedded assumption &#8212; understandable given its century of commissioned responsibility &#8212; that voice is something to specifically protect rather than treat as another bucket of data being transported across the network.  </p>
<p>
<a href="http://blog.tomevslin.com/>Tom Evslin</a> explained why picking a date matters &#8212; because the architectural and technology decisions made for a 2018 &#8220;transition&#8221; date are different from those made for a 2029 date.  Kevin Kahn of Intel stepped back to observe that the language being used seemed to be distracting, and what the U.S. policy community really needs to clarify is the service definition, and associated expectations, used for the communication of its citizenry.  <a href="http://www.mobilemusings.net/">Tom Wheeler</a> captured a less surprising industry opinion that unencumbering industry from the body of laws and court precedents based on the PSTN would facilitate the advance of market forces.  Marvin Sirbu was worried we might be overestimating the speed at which citizens are really moving to VOIP.  While there was disagreement over details, there was broad consensus that IP was going to be the mechanism for most end-to-end carriage.</p>
<p></P>
<p> Less time, about 15 minutes, was spent discussing the IPv6 working group&#8217;s results (a &#8220;benchmarking document&#8221;) and recommendations, mostly punting the problems to next year starting with a joint workshop with NTIA in February.  There was only time for one comment, from Vint, before the FCC chairman spoke, after which we went on to the next topic.  Vint had four rapid-fire points: (1) IPv6 is <em>NOT</em> a transition, but rather introduction of an additional capability; (2) there is a very real threat of a cascading NAT environment; (3) NIST should be involved in IPv6 measurement; (4) OMB should be involved in government procurement guidelines for IPv6 network services.    I disagree with his first point, but the lack of government coordination and consistency is painfully clear.  OMB already has an IPv6-related mandate, but there are no IPv6 support conditions on the broadband stimulus money or other sources of USG funding (IPv6 conditions on USF funding are being discussed).  My bigger concern with benchmarking is that current IPv6 measurement activities send mixed signals to industry &#8212; customers are not planning since the best available data implies that carriers are not planning to deploy it in the next 18 months.</p>
<p>The best suggestion I have heard so far (from Geoff Huston) is for the FCC to ask of its own constituency to publish their 24-month IPv6 deployment objectives so that current and potential customers of their services are aware of their plans, and then in 18 months ask the same set of to folks publish their actual IPv6 deployment achievements and what their objectives are for the ensuing 24 months.   This recommendation would be consistent with the FCC&#8217;s &#8220;transparency and disclosure&#8221; approach to other issues.  But there was no time to discuss IPv6 at this meeting, maybe next time.  Hopefully I will have some results to report from CAIDA&#8217;s IPv6 growth scenario computational modeling study.</p>
<p>We agreed to narrow the set of TAC study topics for 2012 to three: IPv6; the PSTN transition; and receiver standards to support sharing.  Next meeting in March 2012.</p>
]]></content:encoded>
			<wfw:commentRss>http://blog.caida.org/best_available_data/2012/01/20/shutting-the-phone-network-off-while-youre-running-out-of-internet-protocol-numbers/feed/</wfw:commentRss>
		<slash:comments>0</slash:comments>
		</item>
		<item>
		<title>att/t-mobile and icann share economic consultants</title>
		<link>http://blog.caida.org/best_available_data/2011/08/30/attt-mobile-and-icann-share-economic-consultants/</link>
		<comments>http://blog.caida.org/best_available_data/2011/08/30/attt-mobile-and-icann-share-economic-consultants/#comments</comments>
		<pubDate>Wed, 31 Aug 2011 01:04:40 +0000</pubDate>
		<dc:creator>kc</dc:creator>
				<category><![CDATA[Commentaries]]></category>
		<category><![CDATA[Economics]]></category>

		<guid isPermaLink="false">http://blog.caida.org/best_available_data/?p=1209</guid>
		<description><![CDATA[The last line of this FCC announcement is ominous enough: On July 13, 2011, a workshop of economists was convened at the Federal Communications Commission to discuss certain economic issues of AT&#038;T&#8217;s proposed acquisition of T-Mobile. The workshop was divided into two panels. The first, on Market Definition and Unilateral and Coordinated Effects, included the [...]]]></description>
			<content:encoded><![CDATA[<p>The last line of this FCC announcement is ominous enough:</p>
<p><span id="more-1209"></span></p>
<blockquote><p><em>On July 13, 2011, a workshop of economists was convened at the Federal Communications Commission to discuss certain economic issues of AT&#038;T&#8217;s proposed acquisition of T-Mobile. The workshop was divided into two panels. The first, on Market Definition and Unilateral and Coordinated Effects, included the following panelists: representing the Applicants from Compass Lexecon, Dennis Carlton, Robert Willig, and Mark Israel.  Representing Sprint from Charles River Associates were Steven Salop, Serge Moresi, and Craig Romaine.
</p>
<p>
Participating in the second panel, which discussed Efficiencies, the But-For World, and Exclusionary Effects/Raising Rivals&#8217; Costs, were the following panelists: representing the Applicants from Compass Lexecon, Dennis Carlton, Robert Willig, and Mark Israel. Representing Sprint from Charles River Associates were Steven Salop, Stanley Besen, and John Woodbury.
</p>
<p>
When it is available, the transcript of the workshop will be provided for review by individuals with access to highly confidential and confidential information.
</p>
<p></em></p>
<p><a href="http://fjallfoss.fcc.gov/ecfs/document/view?id=7021692592">http://fjallfoss.fcc.gov/ecfs/document/view?id=7021692592</a>
</p></blockquote>
<p>But equally eye-opening is the economic consulting firm AT&#038;T is using &#8212; the same one ICANN used to <a href="http://blog.caida.org/best_available_data/2011/01/19/thoughts-on-icanns-plans-to-expand-the-dns-root-zone-by-orders-of-magnitude/">&#8220;study&#8221; whether gTLD expansion would benefit consumers</a>.  Unlike this transcript, that study I was actually allowed to read, so I and <a href="http://forum.icann.org/lists/5gtld-guide/threads.html">many others</a> learned <a href="http://forum.icann.org/lists/5gtld-guide/msg00015.html">how dishonest</a> it was.  It is not clear who will learn about &#8220;certain economic issues of AT&#038;T&#8217;s proposed acquisition of T-Mobile&#8221;&#8230;
</p>
<p>
It  strangely reminds me of CCIED&#8217;s <a href="http://cseweb.ucsd.edu/~savage/papers/Oakland11.pdf">spam value chain study</a> which revealed &#8220;the first strong evidence of payment bottlenecks in the spam value chain;  95% of spam-advertised pharmaceutical, replica and software products are monetized using merchant services from just a handful of banks.&#8221;   This shared-economist coincidence might be evidence of similar bottlenecks in economic policy development, due to too few neutral economists capable of generating sensible policy recommendations.  Like most &#8220;independent&#8221; pharmaceutical researchers, most economists seem to be on the receiving end of funding from organizations who stand to gain financially from their research generating a certain result. </p>
]]></content:encoded>
			<wfw:commentRss>http://blog.caida.org/best_available_data/2011/08/30/attt-mobile-and-icann-share-economic-consultants/feed/</wfw:commentRss>
		<slash:comments>0</slash:comments>
		</item>
		<item>
		<title>network neutrality: the meme, its cost, its future.</title>
		<link>http://blog.caida.org/best_available_data/2011/08/26/network-neutrality-the-meme-its-cost-its-future/</link>
		<comments>http://blog.caida.org/best_available_data/2011/08/26/network-neutrality-the-meme-its-cost-its-future/#comments</comments>
		<pubDate>Fri, 26 Aug 2011 07:04:13 +0000</pubDate>
		<dc:creator>kc</dc:creator>
				<category><![CDATA[Commentaries]]></category>
		<category><![CDATA[Economics]]></category>
		<category><![CDATA[Policy]]></category>

		<guid isPermaLink="false">http://blog.caida.org/best_available_data/?p=779</guid>
		<description><![CDATA[Policy making has become predominated by sponsored research, politics, campaign contributions and rhetoric. In light of an apparent disinterest for the facts it comes as no surprise that the network neutrality debate highlights opposing perceptions about the impact from changes in the next generation Internet. Regrettably no unbiased fact finding appears readily available, because politicization [...]]]></description>
			<content:encoded><![CDATA[<blockquote><p> <em> Policy making has become predominated by sponsored research, politics, campaign contributions and rhetoric. In light of an apparent disinterest for the facts it comes as no surprise that the network neutrality debate highlights opposing perceptions about the impact from changes in the next generation Internet. Regrettably no unbiased fact finding appears readily available, because politicization at the FCC prevents fair minded assessment by the Democratic and Republican Commissioners and heretofore the conflict has not generated a question of law or fact reviewable by a court.        <br />   &#8212; Rob Frieden: <a href="http://papers.ssrn.com/sol3/papers.cfm?abstract_id=962181"> Internet 3.0: Identifying Problems and Solutions to the Network Neutrality Debate, 2007</em></a>.</p></blockquote>
<p> in June I participated on a panel on network neutrality hosted at the June cybersecurity meeting of the <a href="http://www.cyber.st.dhs.gov/ittc.html">DHS/SRI Infosec Technology Transition Council</a> (ITTC), where &#8220;experts and leaders from the government, private, financial, IT, venture capitalist, and academia and science sectors come together to address the problem of identity theft and related criminal activity on the Internet.&#8221; Here is a belated recap of my thoughts on that panel, including what network neutrality has to do with cybersecurity.  </P></p>
<p><span id="more-779"></span></p>
<p> Many academics have gotten a lot of mileage (publications, funding, tenure) out of spreading the <a href="http://en.wikipedia.org/wiki/Network_neutrality">&#8220;network neutrality&#8221;</a> <a href="http://en.wikipedia.org/wiki/Meme">meme</a> since law professor Timothy Wu <a href="http://papers.ssrn.com/sol3/papers.cfm?abstract_id=388863">introduced the term</a> in a 2003 paper in the University of Colorado&#8217;s <a href="http://www.colorado.edu/Law/jthtl/">law journal</a>. I find the meme and its surrounding literature represent a weak substitute for public policy research based on real data from real networks. (An allegation that could equally be directed at other sub-disciplines of Internet science, and for the same reasons.)</p>
<p> The success of the meme is also symptomatic of a <a href="http://blog.caida.org/best_available_data/2008/05/10/top-ten-things-lawyers-should-know-about-internet-research-8/">post-traumatic stress response</A> to the <a href="http://www.columbia.edu/dlc/wp/citi/citinoam11.html">death of a similar meme</a> with far higher stature and longevity &#8212; common carriage, the demise of which <a href="http://www.citi.columbia.edu/elinoam/">Eli Noam</a> predicted way back in 1994.  His paper accurately predicted that the success and ubiquity of networks and the increasing convergence of communications and computing &#8212; and competition &#8212; would (did) lead to the death of common carriage in the industry.</p>
<p>There is plenty of blame to spread around. You can blame the government for improper oversight. You can blame the private sector for lobbying/bribing the government not to do proper oversight.  You can blame failure of consumers to understand the issues.  (Sound like the sub-prime mortgage crisis yet?) With enough money, you can, and many did, weight disproportionate attention to blaming various factors that are not you.  But what is under the (generally proprietary) hood of all network neutrality controversy is simple: the economics of building and operating sustainable packet-switched networks in the 21st century.  Not coincidentally, economic considerations are also at the root of most of our cybersecurity problems, or more precisely of our failures to make progress on them.</p>
<p>One point on which I disagreed with other panelists (and others who <a href="http://freedomofthought.org/blog/?p=12">fondly recall</a> when we had 3,000+ DSL providers</a> in the early 90&#8242;s)  was about whether network neutrality was merely about the lack of competition for broadband access.  The history of common carriage, analyzed in detail by academic scholars <a href="http://www.bepress.com/cgi/viewcontent.cgi?article=1169&#038;context=rne">Andrew Odlyzko</a> and <a href="http://papers.ssrn.com/sol3/papers.cfm?abstract_id=1254983">Susan Crawford</a>, reveals that vertically integrated industries (i.e, a single company owns the infrastructure carries services on top of it) have <a href="http://arstechnica.com/tech-policy/news/2011/05/telco-missteps-overreach-lead-to-dutch-net-neutrality.ars">tremendous incentives to discriminate</a>, even when competition exists.  For the Internet, the implication is that while re-establishing competitive access  to fiber (layer one) is necessary, it is not sufficient &#8212; society still needs a mechanism (not just policy) to guarantee non-discriminatory access. </p>
<p> It used to be that non-discriminatory access to (what were termed) <i>essential facilities</i> was a universal good of any network intended for public use, not just communication networks: railroads, canals, roads &#8212; it goes way back. It was also a fundamental tenet of the <a href="http://transition.fcc.gov/telecom.html">1996 Telecommunications Act</a>, which although entertaining the notion that layer one (fiber, conduit, &#8220;tubes&#8221;, &#8220;facilities&#8221;) might not always be a natural monopoly, at least temporarily required non-discriminatory access to facilities, while <a href="http://transition.fcc.gov/Reports/tcom1996.txt">facilities-based competition</a> was (ostensibly expected) to develop.  And indeed, for while in the early 90s <a href="http://corp.sonic.net/ceo/2011/03/05/why-us-broadband-is-so-slow/">we had (not facilities-based) competition</a>. </p>
<p> But the 1996 Telecom Act was so poorly written that its only reliable ramification was <a href="http://www.isen.com/blog/2007/05/making-network-neutrality-sustainable.html">wealth transfers to lawyers and lobbyists</a>, as industry and government spent several years <a href="http://www.amazon.com/Telecommunications-Internet-Morgan-Kaufmann-Networking/dp/1558605460/ref=sr_1_1?ie=UTF8&#038;qid=1314249426&#038;sr=8-1">suing each other over its interpretation</a>, and industry lobbyists spent many millions of dollars convincing receptive courts and the FCC to remove these obligations to provide non-discriminatory access.  Although considered by many to be an inflection point, the <a href="http://www.law.cornell.edu/supct/html/04-277.ZS.html">Brand-X</a>  <a href="http://en.wikipedia.org/wiki/National_Cable_%26_Telecommunications_Association_v._Brand_X_Internet_Services">decision</a> was more of an evolutionary step in the long trajectory away from <a href="http://www.cybertelecom.org/ci/openaccess.htm">open access</a> to such essential facilities in the United States.<br />
<em><br />
<blockquote>        In essence, the [Federal Communications] Commission has shifted from the notion that non-discriminatory access to general-purpose communications networks is always necessary because of their public-ness and the spillover effects they create (non-discrimination presumption) to the idea that non-discriminatory requirements are only necessary where firms have monopoly power (discrimination presumption).  It is on this &#8220;monopoly&#8221; rationale, and on the basis of its belief that the market for high-speed Internet access is competitive, that the Commission has gradually lifted non-discrimination obligations from providers of high-speed Internet access.<br />
        &#8212; Susan Crawford, <a href="http://papers.ssrn.com/sol3/papers.cfm?abstr<br />
act_id=1254983"> <em>Transporting Communications</em></a>, 2009
</p></blockquote>
<p></em></p>
<p> So the FCC, and the surrounding regulatory apparatus, came to believe that non-discriminatory access was no longer a universal requirement, but only an issue in need of oversight in situations lacking competition.   But it was exactly the non-discriminatory access requirement that enabled the competition in broadband access in the first place (and also enabled the Internet), and when the non-discriminatory access requirement went away, so did the competition.  Unfortunately for consumers, for the rest of the decade the FCC also continued to embrace the belief that we had competition. Although they have recently recognized the need for a reality check on both of these beliefs, they have not yet outwardly admitted that they are simply not true.  Instead their strategy seems to be to <a href="http://telefrieden.blogspot.com/2011/03/new-publication-legislative-and.html">back themselves into a corner</a> while struggling to <a href="http://telefrieden.blogspot.com/2011/01/summary-of-fccs-net-neutrality-report.html">operationalize this fundamentally broken network neutrality meme</a>. </p>
<p>As in the financial (and many other IT-related sectors, which is most sectors by now) it is not too hard to convince congressmen that technology is moving so fast that the government could not possibly understand enough to design, implement and execute enlightened regulation of it.  Ironically, the underlying network and routing protocols under the hood of the Internet have not fundamentally changed in decades. </p>
<p>My three concluding recommendations related to network neutrality were <a href="http://blog.caida.org/best_available_data/2009/04/13/top-ten-72b-broadband-stimulus-ideal-conditions/">not original</a>, and both also apply to persistently unsolvable cybersecurity problems, since what network neutrality and cybersecurity have most in common is the lack of available empirical data on operational networks driving policy discourse. First, as S&#038;T Division Director Doug Maughan has long and tirelessly argued, we must <a href="http://www.caida.org/publications/papers/2008/lawyers_top_ten/">educate the lawyers</a>. (Former FCC chairman Michael Powell has also suggested restructuring the FCC to have a much smaller fraction of them..)
</p>
<p> Second, as fellow panelist Rob Frieden has long argued, the FCC should <a href="http://telefrieden.blogspot.com/2010/08/improving-fccs-data-collection-and.html">require more meaningful disclosure</a> related to network management practices, performance characteristics, and terms and conditions of their broadband services.   The gaping and unavoidable loophole of the <a href="http://telefrieden.blogspot.com/2011/01/summary-of-fccs-net-neutrality-report.html">FCC&#8217;s proposed network neutrality framework</a> is that differential treatment of traffic based on content must only be allowed for &#8220;reasonable network management&#8221;, which includes anything related to security, a blithely moving and necessarily subjective target. </p>
<p>But it is precisely because the government is in no position to define and enforce &#8220;reasonable network management&#8221;, that the endgame must be that carriers do not have financial interest in the content of what they&#8217;re carrying &#8212; the same conditions that made the Internet possible.  So my third recommendation is also a prediction &#8212; we must replace <a href="http://en.wikipedia.org/wiki/Network_neutrality">this broken unit of policy discourse</a> with a more demonstrably productive one.  The network neutrality meme is in the process of costing us another decade of empirically grounded debate, and it will ultimately fail to accomplish its own objective: non-discriminatory access to the infrastructure.  The real solution, as history repeatedly has taught us with other critical infrastructures, is to  structure (architect, regulate) the industry to <a href="http://papers.ssrn.com/sol3/papers.cfm?abstract_id=1254983">financially separate</a> the pipe owner from the providers delivering services over it.  Pipe owners must not be able to monetize the semantics of the bits <a href="http://www.isen.com/blog/2007/05/making-network-neutrality-sustainable.html">by design</a> As the other panelists and other realists would assure you, structural separation is unlikey to happen in this country in the foreseeable future.  Even non-discriminatory (&#8220;open&#8221;) access requirements will be hard to recover, despite the fact that in all countries with much higher penetration or much higher bandwidth to the home, <a href="http://www.fcc.gov/stage/pdf/Berkman_Center_Broadband_Study_13Oct09.pdf">such open access requirements exist</a>.  The structural separation meme has not yet really begun to spread, but history suggests it is merely a matter of time. </p>
]]></content:encoded>
			<wfw:commentRss>http://blog.caida.org/best_available_data/2011/08/26/network-neutrality-the-meme-its-cost-its-future/feed/</wfw:commentRss>
		<slash:comments>1</slash:comments>
		</item>
	</channel>
</rss>

