Systematic evaluation of peer-to-peer systems using PeerfactSim.KOM
Pages 1655 - 1677
Abstract
Comparative evaluations of peer-to-peer protocols through simulations are a viable approach to judge the performance and costs of the individual protocols in large-scale networks. In order to support this work, we present the peer-to-peer system simulator PeerfactSim.KOM, which we extended over the last years. PeerfactSim.KOM comes with an extensive layer model to support various facets and protocols of peer-to-peer networking. In this article, we describe PeerfactSim.KOM and show how it can be used for detailed measurements of large-scale peer-to-peer networks. We enhanced PeerfactSim.KOM with a fine-grained analyzer concept, with exhaustive automated measurements and gnuplot generators as well as a coordination control to evaluate sets of experiment setups in parallel. Thus, by configuring all experiments and protocols only once and starting the simulator, all desired measurements are performed, analyzed, evaluated, and combined, resulting in a holistic environment for the comparative evaluation of peer-to-peer systems. An immediate comparison of different configurations and overlays under different aspects is possible directly after the execution without any manual post-processing. Copyright © 2015 John Wiley & Sons, Ltd.
References
[1]
Skype. Skype - Peer-to-peer internet telephony, 2004. Available from: "http://www.skype.com" {Accessed on 1 December 2015}.
[2]
Cutillo LA, Molva R, Strufe T. Safebook: Feasibility of transitive cooperation for privacy on a decentralized social network. In IEEE WOWMOM '09: Proceedings of the IEEE International Symposium on a World of Wireless, Mobile and Multimedia Networks, Kos Island, Greece, 2009; pp.1-6.
[3]
Graffi K, Groβ C, Mukherjee P, Kovacevic A, Steinmetz R. LifeSocial.KOM: A P2P-based platform for secure online social networks. In IEEE P2P '10: Proceedings of the International Conference on Peer-to-peer Computing: Delft, The Netherlands 2010; pp.1-2.
[4]
Graffi K, Groβ C, Stingl D, Hartung D, Kovacevic A, Steinmetz R. LifeSocial.KOM: a secure and P2P-based solution for online social networks. In IEEE CCNC '11: Proceedings of the IEEE Consumer Communications and Networking Conference: Las Vegas, NV, USA 2011; pp.554-558.
[5]
Graffi K, Mukherjee P, Menges B, Hartung D, Kovacevic A, Steinmetz R. Practical security in P2P-based social networks. In IEEE LCN '09: Proceedings of the Annual Conference on Local Computer Networks, 2009.
[6]
Graffi K, Podrajanski S, Mukherjee P, Kovacevic A, Steinmetz R. A distributed platform for multimedia communities. In IEEE ISM '08: Proceedings of the International Symposium on Multimedia, 2008.
[7]
Kovacevic A, Kaune S, Heckel H, Mink A, Graffi K, Heckmann O, Steinmetz R. PeerfactSim.KOM - a simulator for large-scale peer-to-peer networks. Technical Report Tr-2006-06, Technische Universität, Darmstadt, Germany, 2006.
[8]
Montresor A, Jelasity M. PeerSim: A scalable P2P simulator. In IEEE P2P'09: Proceedings of the International Conference on Peer-to-peer Computing: Seattle, Washington, USA 2009; pp.99-100.
[9]
Baumgart I, Heep B, Krause S. OverSim: A scalable and flexible overlay framework for simulation and real network applications. In IEEE P2P '09: Proceedings of the International Conference on Peer-to-peer Computing: Seattle, Washington, USA 2009; pp.87-88.
[10]
Graffi K. PeerfactSim.KOM: A P2P System simulator - experiences and lessons learned. In IEEE P2P '11: Proceedings of the International Conference on Peer-to-peer Computing: Kyoto, Japan, 2011; pp.154-155.
[11]
Kovacevic A, Kaune S, Mukherjee P, Liebau N, Steinmetz R. Benchmarking platform for peer-to-peer systems. IT - Information Technology. 2007; Volume 49 Issue 5: pp.312-319.
[12]
Stingl D, Groβ C, Rückert J, Nobach L, Kovacevic A, Steinmetz R. PeerfactSim.KOM: A simulation framework for peer-to-peer systems. In IEEE HPCS'11: Proceedings of the International Conference on High Performance Computing and Simulation: Istanbul, Turkey, 2011; pp.577-584.
[13]
Feldotto M, Graffi K. In IEEE HPCS'13: Proceedings of the International Conference on High Performance Computing and Simulation. IEEE: Los Alamitos, CA, USA 2013; pp.99-106.
[14]
Williams T, Kelley C. gnuplot 4.6: An Interactive Plotting Program, 2012. Available from: "http://www.gnuplot.info" {Accessed on 1 December 2015}.
[15]
Stoica I, Morris R, Karger D, Kaashoek MF, Balakrishnan H. Chord: A scalable peer-to-peer lookup service for internet applications. In SIGCOMM '01: Proceedings of the International Conference on Applications, Technologies, Architectures, and Protocols for Computer Communications. ACM: New York, NY, USA 2001; pp.149-160. {Accessed on 1 December 2015}.
[16]
PlanetLab. An Open Platform for Developing, Deploying, and Accessing Planetary-Scale Services, Princeton, NJ, USA. Available from: "https://www.planet-lab.org". {Accessed on 1 December 2015}.
[17]
UC Berkeley and LBL and USC/ISI, and Xerox PARC. The Network Simulator - ns-2. Los Angeles, CA, USA, 2014. Available from: "http://www.isi.edu/nsnam/ns/" {Accessed on 1 December 2015}.
[18]
Renard K, Peri C, Clarke J. A performance and scalability evaluation of the ns-3 distributed scheduler. In Proceedings on the Simutools. ACM: Brussels, Belgium 2012; pp.378-382.
[19]
Varga A, Hornig R. An overview of the OMNeT++ simulation environment. In ICST Simutools'08: Proceedings of the International Conference on Simulation Tools and Techniques for Communications. ICST: Brussels, Belgium 2008; pp.60.
[20]
Naicken S, Livingston B, Basu A, Rodhetbhai S, Wakeman I, Chalmers D. The state of peer-to-peer simulators and simulations. Computer Communication Review. 2007; Volume 37 Issue 2: pp.95-98.
[21]
Amoretti M, Agosti M, Zanichelli F. DEUS: A discrete event universal simulator. In Simutools'09: Proceedings of the 2nd International Conference on Simulation Tools and Techniques for Communications, Networks and Systems: Rome, Italy 2009; pp.58.
[22]
Shudo K, Tanaka Y, Sekiguchi S. Overlay weaver: an overlay construction toolkit. Computer Communications. 2008; Volume 31 Issue 2: pp.402-412.
[23]
Galuba W, Aberer K, Despotovic Z, Kellerer W. ProtoPeer: From simulation to live deployment in one step. In IEEE P2P'08: Proceedings of the International Conference on Peer-to-peer Computing: Aachen, Germany 2008; pp.191-192.
[24]
Galuba W, Aberer K, Despotovic Z, Kellerer W. Protopeer: a P2P toolkit bridging the gap between simulation and live deployment. In Simutools'09: Proceedings of the International Conference on Simulation Tools and Techniques for Communications, Networks and Systems. ICST: Brussels, Belgium 2009; pp.60.
[25]
Gil TM, Kaashoek F, Li J, Morris R, Stribling J. P2Psim: A Simulator for Peer-to-peer Protocols, 2005. Available from: "http://pdos.csail.mit.edu/p2psim/" {Accessed on 1 December 2015}.
[26]
López PG, Pairot C, Mondéjar R, Ahulló JP, Tejedor H, Rallo R. PlanetSim: a new overlay network simulation framework. In Sem'04: Proceedings of the International Workshop on Software Engineering and Middleware. Springer: Berlin, Germany 2004; pp.123-136.
[27]
He Q, Ammar MH, Riley GF, Raj H, Fujimoto R. Mapping peer behavior to packet-level details: a framework for packet-level simulation of peer-to-peer systems. In IEEE MASCOTS'03: Proceedings of the International Workshop on Modeling, Analysis, and Simulation of Computer and Telecommunication Systems. IEEE: Los Alamitos, CA, USA 2003; pp.71-78.
[28]
Yang W, Abu-Ghazaleh NB. GPS: a general peer-to-peer simulator and its use for modeling BitTorrent. In IEEE MASCOTS'05: Proceedings of the International Symposium on Modeling, Analysis, and Simulation of Computer and Telecommunication Systems. IEEE: Los Alamitos, CA, USA 2005; pp.425-434.
[29]
Schlosser M, Condie T, Kamvar S. Simulating a file-sharing P2P network. Technical Report, Stanford InfoLab, Stanford, CA, USA.
[30]
Steiner M, En-Najjary T, Biersack E. Long term study of peer behavior in the KAD DHT. IEEE/ACM Transactions on Networking. 2009; Volume 17: pp.1371-1384.
[31]
Maymounkov P, Mazières D. Kademlia: A peer-to-peer information system based on the XOR metric. In IPTPS '02: Proceedings of the International Workshop on Peer-to-peer Systems, vol.¿2429, <bookSeriesTitle>LNCS</bookSeriesTitle>. Springer: Berlin, Germany, 2002.
[32]
Weibull W. Wide applicability. Journal of Applied Mechanics. 1951; Volume 103: pp.293-297.
[33]
Gross C, Lehn M, Münker C, Buchmann AP, Steinmetz R. Towards a comparative performance evaluation of overlays for networked virtual environments. In Ieee p2p'11: Proceedings of the International Conference on Peer-to-peer Computing: Kyoto, Japan 2011; pp.34-43.
[34]
Dabek F, Zhao BY, Druschel P, Kubiatowicz J, Stoica I. Towards a common API for structured peer-to-peer overlays. In Iptps '03: Proceedings of the International Workshop on Peer-to-peer Systems, vol.¿2735 <bookSeriesTitle>LNCS</bookSeriesTitle>, Springer: Berlin, Germany 2003; pp.33-44.
[35]
Rowstron AIT, Druschel P. Pastry: scalable, decentralized object location, and routing for large-scale peer-to-peer systems. In IFIP/ACM Middleware '01: Proceedings of the International Conference on Distributed Systems Platforms, vol.¿2218, <bookSeriesTitle>LNCS</bookSeriesTitle>. Springer: Berlin, Germany 2001; pp.329-350.
[36]
Ratnasamy S, Francis P, Handley M, Karp R, Schenker S. A scalable content-addressable network. In Proceedings of the 2001 conference on Applications, technologies, architectures, and protocols for computer communications, Vol.¿31. ACM: New York, NY, USA 2001; pp.161-172.
[37]
Clip2 - the gnutella developer forum. Gnutella, 2002. Available from: "http://rfc-gnutella.sourceforge.net/developer/stable/index.html" {Accessed on 1 December 2015}.
[38]
Klingberg T, Manfredi R. Gnutella 0.6, 2002. Available from: "http://rfc-gnutella.sourceforge.net/src/rfc-0\_6-draft.html" {Accessed on 1 December 2015}.
[39]
Chawathe Y, Ratnasamy S, Breslau L, Lanham N, Shenker S. Making gnutella-like P2P systems scalable. In Sigcomm '03: Proceedings of the Conference on Applications, Technologies, Architectures, and Protocols for Computer Communications. ACM: New York, NY, USA 2003; pp.407-418.
[40]
Leong B, Liskov B, Demaine ED. EpiChord: parallelizing the chord lookup algorithm with reactive routing state management. Computer Communications. 2006; Volume 29 Issue 9: pp.1243-1259.
[41]
Kniesburges S, Koutsopoulos A, Scheideler C. Re-chord: a self-stabilizing chord overlay network. In ACM SPAA '11: Proceedings of the ACM Symposium on Parallelism in Algorithms and Architectures: San Jose, CA, USA 2011; pp.235-244.
[42]
Benter M, Divband M, Kniesburges S, Koutsopoulos A, Graffi K. Ca-Re-Chord: A churn resistant self-stabilizing chord overlay network. In NetSys'13: Proceedings of the Networked Systems Annual Technical Conference: Stuttgart, Germany 2013; pp.27-34.
[43]
Wette P, Graffi K. Adding capacity-aware storage indirection to homogeneous distributed hash tables. In Netsys'13: Proceedings of the Conference on Networked Systems Annual Technical Conference: Stuttgart, Germany, 2013; pp.35-42.
[44]
Hu S-Y, Chen J-F, Chen T-H. VON: a scalable peer-to-peer network for virtual environments. IEEE Network. 2006; Volume 20 Issue 4: pp.22-31.
[45]
Schmieg A, Stieler M, Jeckel S, Kabus P, Kemme B, Buchmann A. pSense - maintaining a dynamic localized peer-to-peer structure for position based multicast in games. In IEEE P2P '08: Proceedings of the International Conference on Peer-to-peer Computing: Aachen, Germany 2008; pp.247-256.
[46]
Bharambe AR, Agrawal M, Seshan S. Mercury: supporting scalable multi-attribute range queries. ACM SIGCOMM Computer Communication Review. 2004; Volume 34 Issue 4: pp.353-366.
[47]
Zipf GK. Human behaviour and the principle of least effort: an introduction to human ecology. Addison-Wesley: Oxford, England, 1949.
[48]
Groβ C, Lehn M, Stingl D, Kovacevic A, Buchmann A, Steinmetz R. Towards a common interface for overlay network simulators. In IEEE ICPADS '10: Proceedings of IEEE International Conference on Parallel and Distributed Systems: Shanghai, China 2010; pp.59-66.
[49]
Baumgart I, Heep B. Fast but economical: a simulative comparison of structured peer-to-peer systems. In NGI' 12: Proceedings on the IEEE EURO-NF Conference on Next Generation Internet: Karlskrona, Sweden 2012; pp.87-94.
[50]
Graffi K, Stingl D, Rueckert J, Kovacevic A, Steinmetz R. Monitoring and management of structured peer-to-peer systems. In IEEE P2P '09: Proceedings of the International Conference on Peer-to-peer Computing: Seattle, Washington, USA 2009; pp.311-320.
[51]
Graffi K, Pussep K, Kaune S, Kovacevic A, Liebau N, Steinmetz R. Overlay bandwidth management: scheduling and active queue management of overlay flows. In IEEE LCN '07: Proceedings of the Annual Conference on Local Computer Networks, 2007.
- Systematic evaluation of peer-to-peer systems using PeerfactSim.KOM
Recommendations
An Efficient Hybrid Peer-to-Peer System for Distributed Data Sharing
Peer-to-peer overlay networks are widely used in distributed systems. Based on whether a regular topology is maintained among peers, peer-to-peer networks can be divided into two categories: structured peer-to-peer networks in which peers are connected ...
Modelling and Simulation of Peer-to-Peer Overlay Network Protocols using OverSim
UKSIM '13: Proceedings of the 2013 UKSim 15th International Conference on Computer Modelling and SimulationDue to the large scale and decentralized nature of peer-to-peer (P2P) networks, it is prohibitively expensive to test a P2P algorithm by deploying it on real-world networks and obtaining data on its performance. To be able to conduct research on ...
Trustworthiness of acquaintances in Peer-to-Peer overlay networks
Various types of applications manipulate objects distributed in Peer-to-Peer overlay networks. An acquaintance peer of a peer p is a peer whose service the peer p knows and with which the peer p can directly communicate. We discuss types of acquaintance ...
Comments
Please enable JavaScript to view thecomments powered by Disqus.Information & Contributors
Information
Published In
Publisher
John Wiley and Sons Ltd.
United Kingdom
Publication History
Published: 10 April 2016
Author Tags
Qualifiers
- Article
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 0Total Downloads
- Downloads (Last 12 months)0
- Downloads (Last 6 weeks)0
Reflects downloads up to 14 Nov 2024
Other Metrics
Citations
View Options
View options
Get Access
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in