Nothing Special   »   [go: up one dir, main page]

skip to main content
article

Web100: extended TCP instrumentation for research, education and diagnosis

Published: 01 July 2003 Publication History

Abstract

TCP has become the dominant protocol for all network data transport because it presents a simple uniform data delivery service which is sufficient for most applications over all types of lower network layers. By its very nature, TCP's adaption and retransmission strategies hide all of the details of the lower layers from the application. For example the only symptom of spurious packet loss (or nearly any other network problem) is longer elapsed time and lower performance.This information hiding is fundamentally important to the growth of the Internet because it decouples the evolution of applications from the evolution of link layers. However it also hides valuable information from researchers, educators, network administrators, and other people who would benefit from insight into the inner workings of TCP and the lower layers.In this paper, we present an architecture and infrastructure that provides for per-connection TCP instrumentation to expose otherwise hidden protocol events. We show examples how the infrastructure can be used in support of research, education and advanced network diagnostic tools.Our work was motivated by the observation that since about 1985 network data rates for typical novice network users have fallen by about three orders of magnitude behind expert users (who have kept up with Moore's Law). We use the term "Wizard Gap" to describe this phenomenon. The Web100 and Net100 projects were formed as one step in closing the Wizard Gap.

References

[1]
M. Allman, V. Paxson, and W. Stevens. Tcp congestion control, RFC2581, April 1999.]]
[2]
ANINEAR. Advanced networking infrastructure needs in the atmospheric and related sciences (aninars) workshop report. http://www.scd.ucar.edu/nets/projects/completed/1999.complete.projects/nlanr/ final.report.htm.]]
[3]
L. S. Brakmo, S. W. O'Malley, and L. L. Peterson. TCP vegas: New techniques for congestion detection and avoidance. In ACM SIGCOMM, pages 24--35, 1994.]]
[4]
CAIDA. Internet tools taxonomy, 2003. http://www.caida.org/tools/taxonomy/.]]
[5]
R. Carlson. Developing the Web100 based network diagnostic tool (NDT). PAM, April 2003.]]
[6]
D. D. Clark. Window and acknowledgement strategy in TCP, RFC813, July 1982.]]
[7]
T. Dunigan. Floyd's TCP slow-start and AIMD mods, 2003. http://www.csm.ornl.gov/~dunigan/netperf/floyd.html.]]
[8]
T. Dunigan. Kelly's scalable TCP AIMD mods, 2003. http://www.csm.ornl.gov/~dunigan/netperf/kelly.html.]]
[9]
T. Dunigan. ORNL TCP Web100 bandwidth tester, 2003. http://firebird.ccs.ornl.gov:7123/.]]
[10]
T. Dunigan, M. Mathis, and B. Tierney. A TCP Tuning Daemon. Supercomputing 2002, November 2002.]]
[11]
W. Feng, M. Fisk, M. Gardner, and E. Weigle. Dynamic Right-Sizing: An Automated, Lightweight, and Scalable Technique for Enchancing Grid Performance. 7th PfHSN, page 16, April 2002.]]
[12]
S. Floyd. HighSpeed TCP for Large Congestion Windows. Work-in- Progress: IETF Internet-Draft, August 2003. http://www.ietf.org/internetdrafts/draft-ietf-tsvwg-highspeed-01.txt.]]
[13]
S. Floyd. Limited Slow-Start for TCP with Large Congestion Windows. Work in progress: IETF Internet-Draft, July 2003. http://www.ietf.org/internet-drafts/draft-ietf-tsvwg-slowstart-00.txt.]]
[14]
S. Floyd and V. Paxson. Diffculties in simulating the internet. IEEE/ACM Transactions on Networking, 9(4):392--403, August 2001.]]
[15]
M. Handley, J. Padhye, and S. Floyd. TCP congestion window validation, RFC2861, June 2000.]]
[16]
J. Heffner. High bandwidth TCP queuing, July 2002. http://www.psc.edu/~jheffner/papers/senior_thesis.ps.]]
[17]
V. Jacobson. Modified TCP congestion avoidance algorithm. Message to end2end-interest list, April 1990. ftp://ftp.ee.lbl.gov/email/vanj.90apr30.txt.]]
[18]
V. Jacobson, R. Braden, and D. Borman. TCP extensions for high performance, RFC1323, May 1992.]]
[19]
C. Jin et al. FAST kernel: Background theory and experimental results. In First International Workshop on Protocols for Fast Long-Distance Networks, February 2003.]]
[20]
T. Kelly. Scalable TCP: Improving performance in highspeed wide area networks. In First International Workshop on Protocols for Fast Long-Distance Networks, February 2003.]]
[21]
LBNL. Network tools analysis framework (ntaf), 2003. http://www-didc.lbl.gov/NTAF/.]]
[22]
J. Lee, M. Stoufer, and B. Tierney. Monitoring data archives for Grid environments. Supercomputing 2002, November 2002.]]
[23]
M. Mathis. Pushing up performance for everyone, December 1999. Presentation to Joint Techs workshop (first use of wizard gap).]]
[24]
M. Mathis, J. Heffner, R. Reddy, and J. Saperia. TCP Extended Statistics MIB. Work in progress: IETF Internet-Draft, November 2002. Status page: http://www.web100.org/mib.]]
[25]
M. Mathis, J. Mahdavi, S. Floyd, and A. Romanow. TCP selective acknowledgement options, RFC2018, October 1996.]]
[26]
M. Mathis and R. Reddy. Enabling High Performance Data Transfers, 2002. http://www.psc.edu/networking/perf_tune.html.]]
[27]
M. Mathis and R. Reddy. Pathprobe: Network Path Diagnostic Tools, 2002. http://www.psc.edu/~web100/pathprobe/.]]
[28]
M. Mathis, J. Semke, and J. Mahdavi. The macroscopic behavior of the TCP congestion avoidance algorithm. Computer Communications Review, 27(3), 1997.]]
[29]
J. Mogul and S. Deering. Path MTU discovery, RFC1191, November 1990.]]
[30]
J. Nagle. Congestion control in IP/TCP internetworks, RFC896, January 1984.]]
[31]
Net100. Home page, 2003. http://www.net100.org/.]]
[32]
NLANR. Iperf---the TCP/UDP bandwidth measurement tool, 2002. http://dast.nlanr.net/Projects/Iperf/.]]
[33]
S. Ostermann. TCPtrace, 2003. http://www.tcptrace.org/.]]
[34]
V. Paxson and M. Allman. Computing TCP's retransmission timer, RFC2988, November 2000.]]
[35]
V. Paxson and S. Floyd. Why we don't know how to simulate the internet. In Winter Simulation Conference, pages 1037--1044, 1997.]]
[36]
K. Ramakrishnan, S. Floyd, and D. Black. A proposal to add explicit congestion notification (ECN) to IP, RFC3168, September 2001.]]
[37]
R. Reddy. SYN option check server, 2003. http://syntest.psc.edu:7961/.]]
[38]
J. Semke, J. Mahdavi, and M. Mathis. Automatic TCP Buffer Tuning. In ACM SIGCOMM, pages 315--323, 1998.]]
[39]
B. Tierney. Using NetLogger and Web100 for TCP analysis. Protocols for High Speed Networks. http://www-didc.lbl.gov/papers/PFDL.tierney.pdf.]]
[40]
A. Tirumala, L. Cottrell, and T. Dunigan. Measuring end-toend bandwidth with Iperf using Web100. PAM, April 2003.]]
[41]
G. Turner. tcpestats: A Net-SNMP AgentX agent implementing the Web100 Project's TCP Extended Statistics MIB, 2002. http://www.aarnet.edu.au/network/software/web100/.]]
[42]
C. Villamizar and C. Song. High performance TCP in ANSNET. Computer Communications Review, 24(5), 1995.]]
[43]
Web100. Kernel Instrument Set, 2002. http://www.web100.org/download/kernel/alpha2.0/tcp-kis.txt.]]
[44]
G. Wood. 12--NEWS: Internet2 Land Speed Winners Set New Transcontinental Internet Performance Records, 2002. http://mail.internet2.edu:8080/guest/archives/i2-news/log200003/msg00011.html.]]

Cited By

View all
  • (2022)Exploring the Measurement Lab Open Dataset for Internet Performance Evaluation: The German Internet LandscapeElectronics10.3390/electronics1101016211:1(162)Online publication date: 5-Jan-2022
  • (2021)Verification of a new metric for data flow continuity and sustainability optimizationInternational Journal of Communication Systems10.1002/dac.489034:12Online publication date: 4-Jun-2021
  • (2020)Measuring TCP Round-Trip Time in the Data PlaneProceedings of the Workshop on Secure Programmable Network Infrastructure10.1145/3405669.3405823(35-41)Online publication date: 10-Aug-2020
  • Show More Cited By
  1. Web100: extended TCP instrumentation for research, education and diagnosis

    Recommendations

    Comments

    Please enable JavaScript to view thecomments powered by Disqus.

    Information & Contributors

    Information

    Published In

    cover image ACM SIGCOMM Computer Communication Review
    ACM SIGCOMM Computer Communication Review  Volume 33, Issue 3
    July 2003
    141 pages
    ISSN:0146-4833
    DOI:10.1145/956993
    Issue’s Table of Contents

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 01 July 2003
    Published in SIGCOMM-CCR Volume 33, Issue 3

    Check for updates

    Author Tags

    1. Net100
    2. TCP Performance
    3. Web100
    4. instrumentation

    Qualifiers

    • Article

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)13
    • Downloads (Last 6 weeks)3
    Reflects downloads up to 10 Nov 2024

    Other Metrics

    Citations

    Cited By

    View all
    • (2022)Exploring the Measurement Lab Open Dataset for Internet Performance Evaluation: The German Internet LandscapeElectronics10.3390/electronics1101016211:1(162)Online publication date: 5-Jan-2022
    • (2021)Verification of a new metric for data flow continuity and sustainability optimizationInternational Journal of Communication Systems10.1002/dac.489034:12Online publication date: 4-Jun-2021
    • (2020)Measuring TCP Round-Trip Time in the Data PlaneProceedings of the Workshop on Secure Programmable Network Infrastructure10.1145/3405669.3405823(35-41)Online publication date: 10-Aug-2020
    • (2019)Pluginizing QUICProceedings of the ACM Special Interest Group on Data Communication10.1145/3341302.3342078(59-74)Online publication date: 19-Aug-2019
    • (2016)Tranalyzer: Versatile high performance network traffic analyser2016 IEEE Symposium Series on Computational Intelligence (SSCI)10.1109/SSCI.2016.7849909(1-8)Online publication date: Dec-2016
    • (2016)Analysis of impartial quality measurements on Indian broadband connections2016 Twenty Second National Conference on Communication (NCC)10.1109/NCC.2016.7561135(1-6)Online publication date: Mar-2016
    • (2015)Value State Flow GraphACM Transactions on Reconfigurable Technology and Systems10.1145/28077029:2(1-22)Online publication date: 4-Dec-2015
    • (2015)A Causal Approach to the Study of TCP PerformanceACM Transactions on Intelligent Systems and Technology10.1145/27708787:2(1-25)Online publication date: 14-Dec-2015
    • (2015)An Educational Networking Framework for Full Layer Implementation and TestingProceedings of the 46th ACM Technical Symposium on Computer Science Education10.1145/2676723.2677304(663-668)Online publication date: 24-Feb-2015
    • (2015)NFShunt: A Linux firewall with OpenFlow-enabled hardware bypass2015 IEEE Conference on Network Function Virtualization and Software Defined Network (NFV-SDN)10.1109/NFV-SDN.2015.7387413(100-106)Online publication date: Nov-2015
    • Show More Cited By

    View Options

    Get Access

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Media

    Figures

    Other

    Tables

    Share

    Share

    Share this Publication link

    Share on social media