Nothing Special   »   [go: up one dir, main page]

skip to main content
article

Longest prefix matching using bloom filters

Published: 01 April 2006 Publication History

Abstract

We introduce the first algorithm that we are aware of to employ Bloom filters for longest prefix matching (LPM). The algorithm performs parallel queries on Bloom filters, an efficient data structure for membership queries, in order to determine address prefix membership in sets of prefixes sorted by prefix length. We show that use of this algorithm for Internet Protocol (IP) routing lookups results in a search engine providing better performance and scalability than TCAM-based approaches. The key feature of our technique is that the performance, as determined by the number of dependent memory accesses per lookup, can be held constant for longer address lengths or additional unique address prefix lengths in the forwarding table given that memory resources scale linearly with the number of prefixes in the forwarding table. Our approach is equally attractive for Internet Protocol Version 6 (IPv6) which uses 128-bit destination addresses, four times longer than IPv4. We present a basic version of our approach along with optimizations leveraging previous advances in LPM algorithms. We also report results of performance simulations of our system using snapshots of IPv4 BGP tables and extend the results to IPv6. Using less than 2 Mb of embedded RAM and a commodity SRAM device, our technique achieves average performance of one hash probe per lookup and a worst case of two hash probes and one array access per lookup.

References

[1]
{1} BGP Table Data. Feb. 2003 {Online}. Available: http://bgp.potaroo.net/]]
[2]
{2} IPv6 Operational Report. Feb. 2003 {Online}. Available: http://net-stats.ipv6.tilab.com/bgp/bgp-table-snapshot.txt/]]
[3]
{3} B. H. Bloom, "Space/time trade-offs in hash coding with allowable errors," Commun. ACM, vol. 13, no. 7, pp. 422-426, Jul. 1970.]]
[4]
{4} A. Broder and M. Mitzenmacher, "Network applications of Bloom filters: a survey," in Proc. 40th Annu. Allerton Conf., Oct. 2002.]]
[5]
{5} M. Degermark, A. Brodnik, S. Carlsson, and S. Pink, "Small forwarding tables for fast routing lookups," in Proc. ACM SIGCOMM, 1997, pp. 3-14.]]
[6]
{6} B. Dipert, "Special purpose SRAMs smooth the ride," EDN, pp. 93-104, Jun. 1999.]]
[7]
{7} W. N. Eatherton, "Hardware-based Internet Protocol prefix lookups," M.S. thesis, Electr. Eng. Dept., Washington Univ., St. Louis, MO, 1998. {Online}. Available: http://www.arl.wustl.edu/]]
[8]
{8} L. Fan, P. Cao, J. Almeida, and A. Z. Broder, "Summary cache: a scalable wide-area web cache sharing protocol," IEEE/ACM Trans. Netw., vol. 8, no. 3, pp. 281-293, Jun. 2000.]]
[9]
{9} S. Fuller, T. Li, J. Yu, and K. Varadhan, Classless inter-domain routing (CIDR): an address assignment and aggregation strategy. RFC 1519, Sep. 1993.]]
[10]
{10} P. Gupta, S. Lin, and N. McKeown, "Routing Lookups in Hardware at Memory Access Speeds," in Proc. IEEE INFOCOM, 1998, pp. 1240-1247.]]
[11]
{11} R. Hinden and S. Deering, Internet Version 6 (IPv6) addressing architecture. RFC 3513, Apr. 2003.]]
[12]
{12} IANA, IPv6 Address Allocation and Assignment Policy, Jun. 2002. {Online}. Available: http://www.iana.org/ipaddress/ipv6-allocation-policy-26jun02]]
[13]
{13} B. Lampson, V. Srinivasan, and G. Varghese, "IP lookups using multiway and multicolumn search," IEEE/ACM Trans. Netw., vol. 7, no. 3, pp. 324-334, Jun. 1999.]]
[14]
{14} A. J. McAulay and P. Francis, "Fast routing table lookup using CAMs," in Proc. IEEE INFOCOM, 1993, pp. 1382-1391.]]
[15]
{15} Micron Technology Inc., 36 Mb DDR SIO SRAM 2-Word Burst. Datasheet, Dec. 2002.]]
[16]
{16} Micron Technology Inc., Harmony TCAM 1Mb and 2Mb. Datasheet, Jan. 2003.]]
[17]
{17} R. K. Montoye, "Apparatus for storing "Don't Care" in a content addressable memory cell," U.S. Patent 5,319,590, Jun. 7, 1994.]]
[18]
{18} SiberCore Technologies Inc., SiberCAM Ultra-18M SCT1842. Product Brief, 2002.]]
[19]
{19} K. Sklower, A tree-based routing table for Berkeley Unix Univ. California, Berkeley, 1993, Technical report.]]
[20]
{20} V. Srinivasan and G. Varghese, "Faster IP lookups using controlled prefix expansion," in Proc. ACM SIGMETRICS, 1998, pp. 1-10.]]
[21]
{21} M. Waldvogel, G. Varghese, J. Turner, and B. Plattner, "Scalable high speed IP routing table lookups," in Proc. ACM SIGCOMM, Sep. 1997, pp. 25-36.]]

Cited By

View all
  • (2024)RT-CBCH: Real-Time VPN Traffic Service Identification Based on Sampled Data in High-Speed NetworksIEEE Transactions on Network and Service Management10.1109/TNSM.2023.328644621:1(88-107)Online publication date: 1-Feb-2024
  • (2024)On the Security of Quotient Filters: Attacks and Potential CountermeasuresIEEE Transactions on Computers10.1109/TC.2024.337179373:9(2165-2177)Online publication date: 1-Sep-2024
  • (2024)BIVXDB: A Bottom Information Invert Index to Speed up the Query Performance of LSM-TreeWeb and Big Data10.1007/978-981-97-7241-4_2(19-34)Online publication date: 31-Aug-2024
  • Show More Cited By

Recommendations

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image IEEE/ACM Transactions on Networking
IEEE/ACM Transactions on Networking  Volume 14, Issue 2
April 2006
217 pages

Publisher

IEEE Press

Publication History

Published: 01 April 2006
Published in TON Volume 14, Issue 2

Author Tags

  1. Bloom filter
  2. IP lookup
  3. computer networking
  4. longest prefix Matching

Qualifiers

  • Article

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)4
  • Downloads (Last 6 weeks)1
Reflects downloads up to 14 Nov 2024

Other Metrics

Citations

Cited By

View all
  • (2024)RT-CBCH: Real-Time VPN Traffic Service Identification Based on Sampled Data in High-Speed NetworksIEEE Transactions on Network and Service Management10.1109/TNSM.2023.328644621:1(88-107)Online publication date: 1-Feb-2024
  • (2024)On the Security of Quotient Filters: Attacks and Potential CountermeasuresIEEE Transactions on Computers10.1109/TC.2024.337179373:9(2165-2177)Online publication date: 1-Sep-2024
  • (2024)BIVXDB: A Bottom Information Invert Index to Speed up the Query Performance of LSM-TreeWeb and Big Data10.1007/978-981-97-7241-4_2(19-34)Online publication date: 31-Aug-2024
  • (2023)NeuroLPM - Scaling Longest Prefix Match Hardware with Neural NetworksProceedings of the 56th Annual IEEE/ACM International Symposium on Microarchitecture10.1145/3613424.3623769(886-899)Online publication date: 28-Oct-2023
  • (2023)Seesaw Counting Filter: A Dynamic Filtering Framework for Vulnerable Negative KeysIEEE Transactions on Knowledge and Data Engineering10.1109/TKDE.2023.327370935:12(12987-13001)Online publication date: 1-Dec-2023
  • (2023)On the Privacy of Counting Bloom FiltersIEEE Transactions on Dependable and Secure Computing10.1109/TDSC.2022.315846920:2(1488-1499)Online publication date: 1-Mar-2023
  • (2023)Search mechanism for data contents based on bloom filter and tree hybrid structure in system wide information managementIET Communications10.1049/cmu2.1262117:11(1262-1273)Online publication date: 11-May-2023
  • (2022)Proteus: A Self-Designing Range FilterProceedings of the 2022 International Conference on Management of Data10.1145/3514221.3526167(1670-1684)Online publication date: 10-Jun-2022
  • (2022)DH-SVRF: A Reconfigurable Unicast/Multicast Forwarding for High-Performance Packet Forwarding EnginesIEEE Transactions on Parallel and Distributed Systems10.1109/TPDS.2021.310889933:5(1262-1275)Online publication date: 1-May-2022
  • (2021)An Efficient Addressing Scheme for Flexible IP AddressProceedings of the 2021 2nd International Conference on Control, Robotics and Intelligent System10.1145/3483845.3483865(111-116)Online publication date: 20-Aug-2021
  • Show More Cited By

View Options

Get Access

Login options

Full Access

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media