Article

Smartsockets: solving the connectivity problems in grid computing

Authors:

Henri E. BalAuthors Info & Claims

HPDC '07: Proceedings of the 16th international symposium on High performance distributed computing

Pages 1 - 10

https://doi.org/10.1145/1272366.1272368

Published: 25 June 2007 Publication History

Abstract

Tightly coupled parallel applications are increasingly run in Grid environments. Unfortunately, on many Grid sites the ability of machines to create or accept network connections is severely limited by ?rewalls, network address translation (NAT)or non-routed networks. Multi homing further complicates connection setup and machine identi?cation. Although ad-hoc solutions exist for some of these problems, it is usually up to the application's user to discover the cause of the connectivity problems and ?nd a solution. In this paper we describe SmartSockets¹ a communication library that lifts this burden by automatically discovering the connectivity problems and solving them with as little support from the user as possible.

References

[1]

Netfilter. http://www.netfilter.org.

[2]

SUN Java 5.0. http://java.sun.com.

[3]

The Grid5000 system. http://www.grid5000.fr.

[4]

The InfiniBand Trade Alliance architecture. http://www.infinibandta.org.

[5]

Universal Plug and Play (UPnP). http://www.upnp.org.

[6]

A. Biggadike, D. Ferullo, G. Wilson, and A. Perrig. NATBlaster: Establishing TCP connections between hosts behind NATs. In In Proc. of ACM SIGCOMM Asia Workshop, April 2005.

[7]

N. Boden, D. Cohen, R. Felderman, A. K. and C. L. Seitz, J. Seizovic, and W. Su. Myrinet: A Gigabit-per-second Local Area Network. IEEE Micro, 15(1):29--36, Jan. 1995.

Digital Library

[8]

D. Caromel, C. Delbe, A. di Costanzo, and M. Leyton. ProActive: an Integrated Platform for Programming and Running Applications on Grids and P2P systems. Computational Methods in Science and Technology, 12, 2006.

[9]

M. den Burger and T. Kielmann. "MOB: Zero-configuration High-throughput Multicasting for Grid Applications". In Proc. of the 16th International Symposium on High-Performance Distributed Computing (HPDC-16), Monterey, California, USA, June 2007. Accepted for publication.

Digital Library

[10]

A. Denis, O. Aumage, R. F. H. Hofman, K. Verstoep, T. Kielmann, and H. E. Bal. Wide-area Communication for Grids: An Integrated Solution to Connectivity, Performance and Security Problems. In Proc. of the 13th International Symposium on High-Performance Distributed Computing (HPDC-13), pages 97--106, Honolulu, Hawaii, USA, June 2004.

Digital Library

[11]

N. Drost, E. Ogston, R. V. van Nieuwpoort, and H. E. Bal. "ARRG: Real-world Gossiping". In Proc. of the 16th International Symposium on High-Performance Distributed Computing (HPDC-16), Monterey, California, USA, June 2007. Accepted for publication.

Digital Library

[12]

K. Egevang and P. Francis. The IP Network Address Translator (NAT). RFC 1631, May 1994. Obsoleted by RFC 3022.

[13]

B. Ford, D. Kegel, and P. Srisuresh. Peer-to-peer Communication Across Network Address Translators. In Proceedings of the 2005 USENIX Technical Conference, 2005.

Digital Library

[14]

P. Francis. Is The Internet Going Nutss? IEEE Internet Computing, 7(6):94--96, 2003.

Digital Library

[15]

N. Freed. Behavior of and Requirements for Internet Firewalls. RFC 2979, Oct. 2000.

Digital Library

[16]

E. Gamma, R. Helm, R. Johnson, and J. Vlissides. Design Patterns: Elements of Reusable Object-Oriented Software. Addison Wesley, Reading (MA), USA, 1995.

Digital Library

[17]

A. Ganguly, A. Agrawal, P. O. Boykin, and R. Figueiredo. IP over P2P: Enabling Self-configuring Virtual IP Networks for Grid Computing. In Proc. of 20th International Parallel and Distributed Processing Symposium (IPDPS-2006), April 2006.

Digital Library

[18]

A. Ganguly, A. Agrawal, P. O. Boykin, and R. Figueiredo. WOW: Self-organizing Wide Area Overlay Networks of Virtual Workstations. In Proc. of the 15th International Symposium on High-Performance Distributed Computing (HPDC-15), Paris, France, June 19-23 2006.

[19]

S. Guha and P. Francis. Characterization and Measurement of TCP traversal Through NATs and Firewalls. In In Proc. of Internet Measurement Conference (IMC), 2005.

Digital Library

[20]

S. Guha, Y. Takeda, and P. Francis. Nutss: a SIP-based Approach to UDP and TCP Network Connectivity. In FDNA '04: Proceedings of the ACM SIGCOMM workshop on Future directions in network architecture, pages 43--48, New York, NY, USA, 2004. ACM Press.

Digital Library

[21]

T. Hain. Architectural Implications of NAT. RFC 2993, Nov. 2000.

Digital Library

[22]

X. JIANG and D. XU. VIOLIN: Virtual Internetworking on Overlay Infrastructure. In Proc. of the 2th International Symposium on Parallel and Distributed Processing and Applications., December 2004.

Digital Library

[23]

P. Leach, M. Mealling, and R. Salz. A Universally Unique IDentifier (UUID) URN Namespace. RFC 4122, July 2005.

[24]

M. Leech, M. Ganis, Y. Lee, R. Kuris, D. Koblas, and L. Jones. SOCKS Protocol Version 5. RFC 1928, Mar. 1996.

Digital Library

[25]

Z. Pan, X. Ren, R. Eigenmann, and D. Xu. Executing MPI Programs on Virtual Machines in an Internet Sharing System. In Proc. of 20th International Parallel and Distributed Processing Symposium (IPDPS-2006), April 2006.

Digital Library

[26]

Y. Rekhter, B. Moskowitz, D. Karrenberg, G. J. de Groot, and E. Lear. Address Allocation for Private Internets. RFC 1918, Feb. 1996.

Digital Library

[27]

J. Rosenberg, J. Weinberger, C. Huitema, and R. Mahy. STUN - Simple Traversal of User Datagram Protocol (UDP) Through Network Address Translators (NATs). RFC 3489, Mar. 2003.

Digital Library

[28]

S. Son and M. Livny. Recovering Internet Symmetry in Distributed Computing. In In Proceedings of the 3rd International Symposium on Cluster Computing and the Grid, May 2003.

Digital Library

[29]

P. Srisuresh and K. Egevang. Traditional IP Network Address Translator (Traditional NAT). RFC 3022, Jan. 2001.

Digital Library

[30]

P. Srisuresh, J. Kuthan, J. Rosenberg, A. Molitor, and A. Rayhan. Middlebox Communication Architecture and Framework. RFC 3303, Aug. 2002.

Digital Library

[31]

J. Sugerman, G. Venkitachalam, and B. Lim. Virtualizing I/O Devices on VMware Workstation's Hosted Virtual Machine Monitor. In Proc. of the USENIX Annual Technical Conference, June 2001.

Digital Library

[32]

A. SUNDARARAJ and P. DINDA. Towards Virtual Networks for Virtual Machine Grid Computing. In Proc.of the3rd USENIX Virtual Machine Research And Technology Symposium (VM 2004)., 2004.

Digital Library

[33]

M. Tsugawa and J. A. Fortes. A Virtual Network (ViNe) Architecture for Grid Computing. In Proc. of 20th International Parallel and Distributed Processing Symposium (IPDPS-2006), April 2006.

Digital Library

[34]

R. V. van Nieuwpoort, J. Maassen, A. Agapi, A.M. Oprescu, and T. Kielmann. Experiences Deploying Parallel Applications on a Large-scale Grid. In Proc. of EXPGRID - Experimental Grid Testbeds for the Assessment of Large-scale Distributed Applications and Tools. Workshop in conjunction with (HPDC-15), Paris, France, June 2006.

Cited By

Subratie KAditya SFigueiredo R(2023)EdgeVPNFuture Generation Computer Systems10.1016/j.future.2022.10.007140:C(104-116)Online publication date: 8-Feb-2023
https://dl.acm.org/doi/10.1016/j.future.2022.10.007
van Werkhoven BMaassen JKliphuis MDijkstra HBrunnabend Svan Meersbergen MSeinstra FBal H(2014)A distributed computing approach to improve the performance of the Parallel Ocean Program (v2.1)Geoscientific Model Development10.5194/gmd-7-267-20147:1(267-281)Online publication date: 7-Feb-2014
https://doi.org/10.5194/gmd-7-267-2014
Malik SHuet FCaromel D(2014)Latency based group discovery algorithm for network aware cloud schedulingFuture Generation Computer Systems10.1016/j.future.2013.09.00431(28-39)Online publication date: 1-Feb-2014
https://dl.acm.org/doi/10.1016/j.future.2013.09.004
Show More Cited By

Index Terms

Smartsockets: solving the connectivity problems in grid computing
1. Software and its engineering
  1. Software organization and properties
    1. Software system structures
      1. Distributed systems organizing principles
        Organizing principles for web applications

Recommendations

Performance modeling of parallel applications for grid scheduling

Grids consist of both dedicated and non-dedicated clusters. For effective mapping of parallel applications on grid resources, a grid metascheduler has to evaluate different sets of resources in terms of predicted execution times for the applications ...
Interoperability of BOINC and EGEE

Today basically two types of grid systems are in use: service grids and desktop grids. Service grids offer an infrastructure for grid users, thus require notable management to keep the service running. On the other hand, desktop grids aim to utilize ...
The HPC Testbed of the Italian Grid Infrastructure
PDP '13: Proceedings of the 2013 21st Euromicro International Conference on Parallel, Distributed, and Network-Based Processing

Even though the Italian Grid Infrastructure (IGI) is a general purpose distributed platform, in the past it has been used mainly for serial computations. Parallel applications have been typically executed on supercomputer facilities or, in case of ``not ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

HPDC '07: Proceedings of the 16th international symposium on High performance distributed computing

June 2007

256 pages

ISBN:9781595936738

DOI:10.1145/1272366

General Chair:
Carl Kesselman
USC/ISI
,
Program Chairs:
Jack Dongarra
University of Tennessee
,
David Walker
University of Cardiff

Copyright © 2007 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 25 June 2007

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Article

Conference

HPDC07

Sponsor:

HPDC07: International Symposium on High Performance Distributed Computing

June 25 - 29, 2007

California, Monterey, USA

Acceptance Rates

Overall Acceptance Rate 166 of 966 submissions, 17%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

44
Total Citations
View Citations
590
Total Downloads

Downloads (Last 12 months)2
Downloads (Last 6 weeks)2

Reflects downloads up to 12 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

Subratie KAditya SFigueiredo R(2023)EdgeVPNFuture Generation Computer Systems10.1016/j.future.2022.10.007140:C(104-116)Online publication date: 8-Feb-2023
https://dl.acm.org/doi/10.1016/j.future.2022.10.007
van Werkhoven BMaassen JKliphuis MDijkstra HBrunnabend Svan Meersbergen MSeinstra FBal H(2014)A distributed computing approach to improve the performance of the Parallel Ocean Program (v2.1)Geoscientific Model Development10.5194/gmd-7-267-20147:1(267-281)Online publication date: 7-Feb-2014
https://doi.org/10.5194/gmd-7-267-2014
Malik SHuet FCaromel D(2014)Latency based group discovery algorithm for network aware cloud schedulingFuture Generation Computer Systems10.1016/j.future.2013.09.00431(28-39)Online publication date: 1-Feb-2014
https://dl.acm.org/doi/10.1016/j.future.2013.09.004
van Kessel TDrost NMaassen JE. Bal HJ. Seinstra FJ. Plaza AJeannot EŽilinskas J(2014)Toward a High‐Performance Distributed CBIR System for Hyperspectral Remote Sensing Data: A Case Study in Jungle ComputingHigh‐Performance Computing on Complex Environments10.1002/9781118711897.ch21(401-428)Online publication date: 18-Apr-2014
https://doi.org/10.1002/9781118711897.ch21
van Werkhoven BMaassen JKliphuis MDijkstra HBrunnabend Svan Meersbergen MSeinstra FBal H(2013)A distributed computing approach to improve the performance of the Parallel Ocean Program (v2.1)Geoscientific Model Development Discussions10.5194/gmdd-6-4705-20136:3(4705-4744)Online publication date: 12-Sep-2013
https://doi.org/10.5194/gmdd-6-4705-2013
Drost NMaassen Jvan Meersbergen MBal HPelupessy FZwart SKliphuis MDijkstra HSeinstra F(2012)High-Performance Distributed Multi-Model / Multi-Kernel SimulationsProceedings of the 2012 IEEE 26th International Parallel and Distributed Processing Symposium Workshops & PhD Forum10.1109/IPDPSW.2012.14(150-162)Online publication date: 21-May-2012
https://dl.acm.org/doi/10.1109/IPDPSW.2012.14
Malik SHuet FCaromel D(2012)Cooperative cloud computing in research and academic environment using Virtual Cloud2012 International Conference on Emerging Technologies10.1109/ICET.2012.6375445(1-7)Online publication date: Oct-2012
https://doi.org/10.1109/ICET.2012.6375445
Borgdorff JBona-Casas CMamonski MKurowski KPiontek TBosak BRycerz KCiepiela EGubala THarezlak DBubak MLorenz EHoekstra A(2012)A Distributed Multiscale Computation of a Tightly Coupled Model Using the Multiscale Modeling LanguageProcedia Computer Science10.1016/j.procs.2012.04.0649(596-605)Online publication date: 2012
https://doi.org/10.1016/j.procs.2012.04.064
Kemp RPalmer NKielmann TBal H(2012)Energy Efficient Information Monitoring Applications on Smartphones through Communication OffloadingMobile Computing, Applications, and Services10.1007/978-3-642-32320-1_5(60-79)Online publication date: 2012
https://doi.org/10.1007/978-3-642-32320-1_5
Manias EBaude F(2012)A component-based middleware for hybrid grid/cloud computing platformsConcurrency and Computation: Practice & Experience10.1002/cpe.282224:13(1461-1477)Online publication date: 1-Sep-2012
https://dl.acm.org/doi/10.1002/cpe.2822
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten