A hop away from everywhere — long-haul links in today’s Internet

By on 29 Jan 2024

Category: Tech matters

Tags: , , ,

Blog home

Intercontinental Internet communications lie on top of a complex network of submarine cables forming its global communication backbone. As part of ongoing work focused on the criticality of the submarine cable network, fellow researchers from Northwestern University and the University of Wisconsin-Madison and I mapped traceroute measurements to submarine cables as a first step towards understanding its potential vulnerabilities. 

We initially set out to follow an approach first introduced in a position paper, building on the assumption that given a traceroute, one could identify the hop or link with the largest latency and if the associated routers were found near submarine landings, that this link could be mapped to one or a handful of cables. Unfortunately, a preliminary analysis of traceroute datasets changed this assumption.

While we found traceroutes matching these expectations, we also found many others in which the routers associated with a submarine-traversing link were far inland from the closest landing points, some as far as 700kms. Further analysis revealed many of these long-haul links covering distances larger than 10,000kms and connecting every economy worldwide.

Figure 1 — A long-haul link connecting Seattle, US with Singapore. Long-haul links can be a concatenation of several submarine cable segments such as PC-1, JIH and ASE in this case.
Figure 1 — A long-haul link connecting Seattle, US with Singapore. Long-haul links can be a concatenation of several submarine cable segments such as PC-1, JIH and ASE in this case.

Motivated by these early observations, we conducted a longitudinal study of intercontinental long-haul links and their preferred destinations. In a paper to appear at SIGMETRICS 2024, we report on the first-ever study of this long-haul infrastructure using a large corpus of traceroute data collected at the network’s edge and spanning over seven years. 

Our study revealed a vast network with links spanning thousands of kilometres and central nodes connecting as many as 45 economies.

While long-haul links can be thought of as the network-layer manifestation of critical transoceanic cables, we find that long-haul links are substantially longer than any intercontinental submarine cable segment, with a median Round-Trip Time (RTT) of 130ms – nearly 84% larger than the median RTT of submarine cable segments (70.76ms). 

Figure 2 — The cumulative distributions of latency (in milliseconds) for both long-haul links and the computed latency of submarine cable segments. The latency equivalent for submarine cable segments presents a smoother distribution than that of long-haul links, with a median RTT of 70.76ms, compared with the median RTT of 130ms for long-haul links.
Figure 2 — The cumulative distributions of latency (in milliseconds) for both long-haul links and the computed latency of submarine cable segments. The latency equivalent for submarine cable segments presents a smoother distribution than that of long-haul links, with a median RTT of 70.76ms, compared with the median RTT of 130ms for long-haul links.

The termination points of these links are located quite far from the nearest, on-route, landing points. Specifically, 64% of them are at a distance of 500kms from the nearest landing point, and in 10% of the cases, that distance exceeds 3,513kms. Chicago, a popular ‘destination’ is more than 1,000kms away from the nearest landing point and yet connects over 60 economies within one hop.

Figure 3 — Chicago is one hop away from 60 economies.
Figure 3 — Chicago is one hop away from 60 economies.

Our study contributes to the community effort to create consistent maps across layers of the Internet, from AS-level to logical and physical connectivity, critical to a range of important analyses from performance and robustness to security.

This new perspective opens a wide range of promising directions for future research, from alternative views of the long-haul infrastructure to exploring that infrastructure’s key properties and temporal stability.

To learn more about our study read our paper ‘A hop away from everywhere: A view of the intercontinental long-haul infrastructure,’ which we will present at the 2024 ACM SIGMETRICS Conference.

Rate this article

The views expressed by the authors of this blog are their own and do not necessarily reflect the views of APNIC. Please note a Code of Conduct applies to this blog.

Leave a Reply

Your email address will not be published. Required fields are marked *

Top