research-article

The Next Generation of BGP Data Collection Platforms

Authors:

Thomas Holterbach,

Cristel PelsserAuthors Info & Claims

ACM SIGCOMM '24: Proceedings of the ACM SIGCOMM 2024 Conference

Pages 794 - 812

https://doi.org/10.1145/3651890.3672251

Published: 04 August 2024 Publication History

Abstract

BGP data collection platforms as currently architected face fundamental challenges that threaten their long-term sustainability. Inspired by recent work, we analyze, prototype, and evaluate a new optimization paradigm for BGP collection. Our system scales data collection with two components: analyzing redundancy between BGP updates and using it to optimize sampling of the incoming streams of BGP data. An appropriate definition of redundancy across updates depends on the analysis objective. Our contributions include: a survey, measurements, and simulations to demonstrate the limitations of current systems; a general framework and algorithms to assess and remove redundancy in BGP observations; and quantitative analysis of the benefit of our approach in terms of accuracy and coverage for several canonical BGP routing analyses such as hijack detection and topology mapping. Finally, we implement and deploy a new BGP peering collection system that automates peering expansion using our redundancy analytics, which provides a path forward for more thorough evaluation of this approach.

References

[1]

Emile Aben. 2020. Route Collection at the RIPE NCC - Where are we and where should we go? https://labs.ripe.net/author/emileaben/.

[2]

Emile Aben. 2023. Two Years of Selective Peering with RIS. https://labs.ripe.net/author/emileaben/two-years-of-selective-peering-with-ris/.

[3]

Rodrigo Aldecoa, Chiara Orsini, and Dmitri Krioukov. 2015. Hyperbolic graph generator. In Computer Physics Communications.

[4]

Thomas Alfroy, Thomas Holterbach, Thomas Krenc, KC Claffy, and Cristel Pelsser. 2023. Internet Science Moonshot: Expanding BGP Data Horizons. In HotNets '23. ACM.

Digital Library

[5]

Lorenzo Ariemma, Mariano Scazzariello, and Tommaso Caiazzi. 2021. MRT#: a Fast Multi-Threaded MRT Parser. In IFIP/IEEE IM '21.

[6]

BGPKIT. 2022. BGPKIT. https://blog.bgpkit.com/.

[7]

BGPWatch. 2023. BGPWatch: BGP Routing Analysis and Diagnostic Platform. https://bgpwatch.cgtf.net/.

[8]

Larry Blunk, Craig Labovitz, and Manish Karir. 2011. Multi-Threaded Routing Toolkit (MRT) Routing Information Export Format. In RFC 6396.

[9]

Paolo Boldi and Sebastiano Vigna. 2013. Axioms for Centrality.

[10]

Timm Böttger, Félix Cuadrado, and Steve Uhlig. 2018. Looking for hypergiants in PeeringDB. In SIGCOMM CCR.

[11]

CAIDA. 2023. AS Rank. https://asrank.caida.org/.

[12]

Nikolaos Chatzis and al. 2013. On the benefits of using a large IXP as an internet vantage point. In IMC. ACM.

[13]

Shuanglong Chen, Yongkang Zhang, Haibo Wang, and Zhenbin Li. 2021. BGP Over QUIC. Technical Report draft-chen-idr-bgp-over-quic-00.

[14]

CIDR. 2023. CIDR REPORT. https://www.cidr-report.org/as2.0/.

[15]

CitizenLab. 2012. A Case Study of the China Telecom Incident. https://citizenlab.ca/2012/12/.

[16]

Luca Cittadini, Stefano Vissicchio, and Benoit Donnet. 2014. On the quality of BGP route collectors for iBGP policy inference. In IFIP '14.

[17]

Ben Cox. 2023. BGP tools. https://bgp.tools/.

[18]

David Clark and Cecilia Testart and Matthew Luckie3 and kc claffy. 2024. A path forward: Improving Internet routing security by enabling zones of trust. Journal of Cybersecurity (2024).

[19]

University San Diego. 2022. The CAIDA AS Relationships Dataset, 2022. https://www.caida.org/catalog/datasets/as-relationships/.

[20]

Benoit Donnet and Olivier Bonaventure. 2008. On BGP Communities. In SIGCOMM CCR.

[21]

Anja Feldmann, Olaf Maennel, Z. Morley Mao, Arthur Berger, and Bruce Maggs. 2004. Locating Internet Routing Instabilities. ACM SIGCOMM (2004), 205--218.

[22]

Linton C. Freeman. 1978. Centrality in social networks conceptual clarification. Social Networks (1978).

[23]

Lixin Gao and Jennifer Rexford. 2000. Stable Internet Routing without Global Coordination. In SIGMETRICS '00.

Digital Library

[24]

Enrico Gregori, Alessandro Improta, Luciano Lenzini, Lorenzo Rossi, and Luca Sani. 2012. On the Incompleteness of the AS-Level Graph: A Novel Methodology for BGP Route Collector Placement. In IMC '12.

Digital Library

[25]

Thomas Holterbach, Thomas Alfroy, Amreesh Phokeer, Alberto Dainotti, and Cristel Pelsser. 2023. A System to Detect Forged-Origin BGP Hijacks. In NSDI'24.

[26]

Thomas Holterbach, Stefano Vissicchio, Alberto Dainotti, and Laurent Vanbever. 2017. SWIFT: Predictive Fast Reroute. In ACM SIGCOMM.

[27]

Alessandro Improta. 2023. Isolano project: The real-time Internet routing observatory. https://content.cooperate.com/post/internet_history/.

[28]

Robert Kisteleki. 2023. RIPE NCC Measurement Data Retention Principles. https://labs.ripe.net/author/kistel/ripe-ncc-measurement-data-retention-principles/.

[29]

Thomas Krenc, Robert Beverly, and Georgios Smaragdakis. 2020. Keep Your Communities Clean: Exploring the Routing Message Impact of BGP Communities. In CoNEXT '20.

Digital Library

[30]

Craig Labovitz, Abha Ahuja, Abhijit Bose, and Farnam Jahanian. 2000. Delayed Internet Routing Convergence. In SIGCOMM CCR.

[31]

Matthew Luckie, Bradley Huffaker, Amogh Dhamdhere, Vasileios Giotsas, and kc claffy. 2013. AS Relationships, Customer Cones, and Validation. In IMC '13.

[32]

MANRS. 2021. Mutually Agreed Norms for Routing Security. https://manrs.org/.

[33]

Z. Morley Mao, Lili Qiu, Jia Wang, and Yin Zhang. 2005. On AS-Level Path Inference. In SIGMETRICS '05.

[34]

Alexandros Milolidakis, Tobias Bühler, Kunyu Wang, Marco Chiesa, Laurent Vanbever, and Stefano Vissicchio. 2023. On the Effectiveness of BGP Hijackers That Evade Public Route Collectors. In IEEE Access.

[35]

Murtaza Motiwala, Megan Elmore, Nick Feamster, and Santosh Vempala. 2008. Path splicing. In SIGCOMM '08. ACM.

Digital Library

[36]

Wolfgang Mühlbauer, Anja Feldmann, Olaf Maennel, Matthew Roughan, and Steve Uhlig. 2006. Building an AS-Topology Model That Captures Route Diversity. In SIGCOMM CCR. ACM.

[37]

University of Oregon. 2023. Route Views Peers list. http://www.routeviews.org/peers/peering-status.html.

[38]

Ricardo Oliveira and al. 2006. Placing BGP monitors in the Internet. In Technical No. UCLA, TR.

[39]

Ricardo Oliveira, Beichuan Zhang, Dan Pei, Rafit Izhak-Ratzin, and Lixia Zhang. 2006. Quantifying Path Exploration in the Internet. In ACM IMC'06.

[40]

Chiara Orsini, Alistair King, Danilo Giordano, Vasileios Giotsas, and Alberto Dainotti. 2016. BGPStream: A Software Framework for Live and Historical BGP Data Analysis. In IMC '16.

Digital Library

[41]

PacketVis. 2024. BGP and RPKI real-time monitoring. https://https://packetvis.com/.

[42]

PCH. 2010. Packet Clearing House. https://www.pch.net/.

[43]

PeeringDB. 2023. The Interconnection Database. https://www.peeringdb.com/.

[44]

Lars Prehn and Anja Feldmann. 2021. How Biased is Our Validation (Data) for AS Relationships?. In IMC '21.

Digital Library

[45]

FRRouting Project. 2023. A fully featured, high performance, free software IP routing suite. https://frrouting.org/.

[46]

Lancheng Qin, Dan Li, Ruifeng Li, and Kang Wang. 2022. Themis: Accelerating the Detection of Route Origin Hijacking by Distinguishing Legitimate and Illegitimate MOAS. In USENIX Security.

[47]

B. Quoitin and S. Uhlig. 2005. Modeling the routing of an autonomous system with C-BGP. IEEE Network (2005).

[48]

RIPE. 1. RIPE RIS Live. https://ris-live.ripe.net/.

[49]

RIPE. 1. RIPE RIS Raw Data. https://www.ripe.net/data-tools/stats/ris/.

[50]

RIPE. 1. The RIPE Atlas measurement platform. https://atlas.ripe.net/.

[51]

RIPE. 2018. YouTube Hijacking: A RIPE NCC RIS case study. http://www.ripe.net/internet-coordination/news/industry-developments/.

[52]

RIPE. 2023. RIPE RIS Peers list. https://www.ris.ripe.net/peerlist/.

[53]

Matthew Roughan, Simon Jonathan Tuke, and Olaf Maennel. 2008. Bigfoot, Sasquatch, the Yeti and other missing links: what we don't know about the AS graph. In IMC '08.

Digital Library

[54]

Jari Saramäki, Mikko Kivelä, Jukka-Pekka Onnela, Kimmo Kaski, and János Kertész. 2007. Generalizations of the clustering coefficient to weighted complex networks. Phys. Rev. E (2007).

[55]

Sciencealert. 2018. Less Than 1% of Large Hadron Collider Data Ever Gets Looked at. https://www.sciencealert.com/over-99-percent-of-large-hadron-collider-particle-collision-data-is-lost.

[56]

Pavlos Sermpezis and al. 2018. ARTEMIS: Neutralizing BGP hijacking within a minute. In ToN.

[57]

Pavlos Sermpezis, Lars Prehn, Sofia Kostoglou, Marcel Flores, Athena Vakali, and Emile Aben. 2023. Bias in Internet Measurement Platforms. In TMA'23.

[58]

Mattia Tantardini, Francesca Ieva, Lucia Tajoli, and Carlo Piccardi. 2019. Comparing methods for comparing networks. In Nature.

[59]

Ars Technica. 2017. Russian-controlled telecom hijacks financial services' Internet traffic. https://arstechnica.com/security/2017/04/.

[60]

Krenc Thomas, Luckie Matthew, Marder Alexander, and kc Claffy. 2023. Coarsegrained Inference of BGP Community Intent. In IMC'23.

[61]

Oregon Univ. 2021. Route Views Project. www.routeviews.org/.

[62]

U.S. Federal Communications Commission. 2022. NOTICE OF INQUIRY. PS Docket No. 22-90. In the Matter of Secure Internet Routing.

[63]

U.S. Federal Communications Commission. 2024. NOTICE OF PROPOSED RULE-MAKING, In the Matter of Reporting on Border Gateway Protocol Risk Mitigation Progress and Secure Internet Routing. (2024). https://docs.fcc.gov/public/attachments/DOC-402609A1.pdf.

[64]

Thomas Wirtgen, Nicolas Rybowski, Cristel Pelsser, and Olivier Bonaventure. 2023. Routing over QUIC: Bringing transport innovations to routing protocols.

[65]

Ying Zhang, Zheng Zhang, Z. Morley Mao, Y. Charlie Hu, and Bruce M. Maggs. 2007. On the impact of route monitor selection. In IMC '07.

[66]

Xiaoliang Zhao, Dan Pei, Lan Wang, Dan Massey, Allison Mankin, S. Felix Wu, and Lixia Zhang. 2001. An Analysis of BGP Multiple Origin AS (MOAS) Conflicts. In IMW '01.

Cited By

Kirci ETorsiello VVanbever L(2024)What is the next hop to more granular routing models?Proceedings of the 23rd ACM Workshop on Hot Topics in Networks10.1145/3696348.3696859(343-351)Online publication date: 18-Nov-2024
https://dl.acm.org/doi/10.1145/3696348.3696859
Du BFontugne RTestart CSnoeren Aclaffy kVallina-Rodríguez NSuarez-Tángil GLevin DPelsser C(2024)Sublet Your Subnet: Inferring IP Leasing in the WildProceedings of the 2024 ACM on Internet Measurement Conference10.1145/3646547.3689010(328-336)Online publication date: 4-Nov-2024
https://dl.acm.org/doi/10.1145/3646547.3689010
Liu YWu TWang JWang JZhuang SVallina-Rodríguez NSuarez-Tángil GLevin DPelsser C(2024)Collecting Self-reported Semantics of BGP Communities and Investigating Their Consistency with Real-world UsageProceedings of the 2024 ACM on Internet Measurement Conference10.1145/3646547.3688414(314-327)Online publication date: 4-Nov-2024
https://dl.acm.org/doi/10.1145/3646547.3688414

Index Terms

The Next Generation of BGP Data Collection Platforms
1. Networks
  1. Network performance evaluation
    1. Network measurement

Recommendations

Neighbor-specific BGP: more flexible routing policies while improving global stability
SIGMETRICS '09

The Border Gateway Protocol (BGP) offers network administrators considerable flexibility in controlling how traffic flows through their networks. However, the interaction between routing policies in different Autonomous Systems (ASes) can lead to ...
Improving the reliability of inter-AS economic inferences through a hygiene phase on BGP data

Over the last few years researchers have tried to shed light on the economic features that drive the inter-domain routing of the Internet, by inferring economic inter-AS relationships from raw BGP data collected by research projects such as BGPmon, PCH, ...
Quantifying the BGP routes diversity inside a tier-1 network
NETWORKING'06: Proceedings of the 5th international IFIP-TC6 conference on Networking Technologies, Services, and Protocols; Performance of Computer and Communication Networks; Mobile and Wireless Communications Systems

Many large ISP networks today rely on route-reflection [1] to allow their iBGP to scale. Route-reflection was officially introduced to limit the number of iBGP sessions, compared to the $\frac{n\times(n-1)}{2}$ sessions required by an iBGP full-mesh. ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

ACM SIGCOMM '24: Proceedings of the ACM SIGCOMM 2024 Conference

August 2024

1033 pages

ISBN:9798400706141

DOI:10.1145/3651890

Co-chairs:
Aruna Seneviratne,
Darryl Veitch,
Program Co-chairs:
Vyas Sekar,
Minlan Yu

Copyright © 2024 Copyright is held by the owner/author(s). Publication rights licensed to ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

SIGCOMM: ACM Special Interest Group on Data Communication

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 04 August 2024

Check for updates

Badges

Best Paper

Author Tags

Qualifiers

Research-article

Funding Sources

ANR-20-THIA-0006-01
RIPE Community Fund Project
Silicon Valley Founda- tion for Cisco
NSF CNS-2120399
NSF OAC-2131987
Région Grand Est
Inria Nancy-Grand Est
IHU of Strasbourg
University of Strasbourg

Conference

ACM SIGCOMM '24

Sponsor:

SIGCOMM

ACM SIGCOMM '24: ACM SIGCOMM 2024 Conference

August 4 - 8, 2024

NSW, Sydney, Australia

Acceptance Rates

Overall Acceptance Rate 462 of 3,389 submissions, 14%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

3
Total Citations
View Citations
635
Total Downloads

Downloads (Last 12 months)635
Downloads (Last 6 weeks)192

Reflects downloads up to 14 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Kirci ETorsiello VVanbever L(2024)What is the next hop to more granular routing models?Proceedings of the 23rd ACM Workshop on Hot Topics in Networks10.1145/3696348.3696859(343-351)Online publication date: 18-Nov-2024
https://dl.acm.org/doi/10.1145/3696348.3696859
Du BFontugne RTestart CSnoeren Aclaffy kVallina-Rodríguez NSuarez-Tángil GLevin DPelsser C(2024)Sublet Your Subnet: Inferring IP Leasing in the WildProceedings of the 2024 ACM on Internet Measurement Conference10.1145/3646547.3689010(328-336)Online publication date: 4-Nov-2024
https://dl.acm.org/doi/10.1145/3646547.3689010
Liu YWu TWang JWang JZhuang SVallina-Rodríguez NSuarez-Tángil GLevin DPelsser C(2024)Collecting Self-reported Semantics of BGP Communities and Investigating Their Consistency with Real-world UsageProceedings of the 2024 ACM on Internet Measurement Conference10.1145/3646547.3688414(314-327)Online publication date: 4-Nov-2024
https://dl.acm.org/doi/10.1145/3646547.3688414

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents