Abstract
Recent research in Cloud Computing and Peer-to-Peer systems for Video-on-Demand (VoD) has focused on multimedia information retrieval, using cloud nodes as video streaming servers and peers as a way to distribute and share the video segments. A key challenge faced by these systems is providing an efficient way to retrieve the information segments descriptor, composed of its metadata and video segments, distributed among the cloud nodes and the Peer-to-Peer (P2P) network. In this paper, we propose a novel Cloud Computing and P2P hybrid architecture for multimedia information retrieval on VoD services that supports random seeking while providing scalability and efficiency. The architecture comprises Cloud and P2P layers. The Cloud layer is responsible for video segment metadata retrieval, using ontologies to improve the relevance of the retrieved information, and for distributing the metadata structures among cloud nodes. The P2P layer is responsible for finding peers that have the physical location of a segment. In this layer, we use trackers, which manage and collect the segments shared among other peers. We also use two Distributed Hash Tables, one to find these trackers and the other to store the information collected in case the tracker leaves the network and another peer needs to replace it. Unlike previous work, our architecture separates cloud nodes and peers responsibilities to manage the video metadata and its segments, respectively. Also, we show via simulations, the possibility of converting any peer to act as a tracker, while maintaining system scalability and performance, avoiding using centralized and powerful servers.
Similar content being viewed by others
Explore related subjects
Discover the latest articles, news and stories from top researchers in related subjects.Notes
While the structure performs its stabilization process [33].
The request implies to download the segment, so, the requesting node will be part of the IntraCSI.
References
Amazon Cloudfront (2013). http://aws.amazon.com/cloudfront
Andreasen T, Nilsson J, Thomsen H (2000) Ontology-based querying. In: Proceedings of the international conference on flexible query-answering systems, pp 15–26
Aslam J, Frost M (2003) An information-theoretic measure for document similarity. In: Proceedings of the international ACM SIGIR conference, pp 449–450
Bhattacharya A et al (2010) Temporal-DHT and its application in P2P-VoD systems. In: Proceedings of the IEEE ISM, pp 81–88
Bianchi S et al (2006) Adaptive load balancing for DHT lookups. In: Proceedings of the international conference on computer communications and networks, pp 411–418
Br.ispell (2013). http://www.ime.usp.br/~ueda/br.ispell/
Buyya R et al (eds) (2008) Content delivery networks. Springer Gmbh, New York
Chang F et al (2008) Bigtable: a distributed storage system for structured data. ACM Trans Comput Syst 26(2):4:1–4:26. doi:10.1145/1365815.1365816
Choi H et al (2011) TDM: time-driven mesh overlay network for peer-to-peer video-on-demand services. In: Proceedings of CYBERC, pp 100–106
da Silva AB (2011) THOR: a P2P distribution video system based on D1HT technique (in portuguese). Master’s thesis, Universidade Federal do Rio de Janeiro
EDX (2013). http://www.edx.org
Guarino N, Masolo C, Vetere G (1999) Ontoseek: content-based access to the web. IEEE Intell Syst 14(3):70–80
Gummadi K et al (2003) The impact of DHT routing geometry on resilience and proximity. In: Proceeding of the ACM SIGCOMM conference, pp 381–394
Gummadi KP, Saroiu S, Gribble SD (2002) King: estimating latency between arbitrary internet end hosts. In: Proceedings of the ACM SIGCOMM workshop on internet measurment, pp 5–18
Hareesh KDM (2013) Quality of service in peer to peer video on demand system using V chaining mechanism. J Comput Inf Technol 2(1)
He Y, Guan L (2010) Peer-to-peer streaming systems. In: Intelligent multimedia communication, pp 195–215
He Y, Shen G, Xiong Y, Guan L (2009) Optimal prefetching scheme in p2p vod applications with guided seeks. IEEE Trans Multimedia 11(1):138–151
Jimenez R, Osmani F, Knutsson B (2011) Sub-second lookups on a large-scale Kademlia-based overlay. In: 11th IEEE conference on peer-to-peer computing
Jing Y, Croft WB (1994) An association thesaurus for information retrieval. In: RIAO 94 conference proceedings, pp 146–160
Leuf B (2002) Peer to peer. Addison-Wesley, Reading
Lin D (1998) An information-theoretic definition of similarity. In: Proceedings of the fifteenth international conference on machine learning, pp 296–304
Liu F et al (2011) Novasky: cinematic-quality vod in a p2p storage cloud. In: INFOCOM. IEEE, pp 936–944
Liu J, Zhou M (2006) Tree-assisted gossiping for overlay video distribution. Multimedia Tools Appl 29(3):211–232. doi:10.1007/s11042-006-0013-7
Matkin GW (2013) Open educational resources in the post mooc era. eLearn 2013(4)
Mell P, Grance T (2011) The NIST definition of cloud computing. Tech. Rep. 800-145, National Institute of Standards and Technology (NIST). http://csrc.nist.gov/publications/nistpubs/800-145/SP800-145.pdf
Noh J, Deshpande S (2008) Pseudo-DHT: distributed search algorithm for P2P video streaming. In: Proceedings of the IEEE ISM, pp 348–355. doi:10.1109/ISM.2008.57
Payberah A et al (2012) Clive: cloud-assisted p2p live streaming. In: IEEE 12th international conference on P2P, pp 79–90. doi:10.1109/P2P.2012.6335820
Paz-Trillo C, Braga P, Wassermann R (2005) An information retrieval application using ontologies. J Br Comput Soc 11(2):17–31
Plank JS (1997) A tutorial on reed-solomon coding for fault-tolerance in raid-like systems. Softw Pract Exper 27(9):995–1012
Rowstron A, Druschel P (2001) Pastry: scalable, decentralized object location, and routing for large-scale peer-to-peer systems. In: Proceedings of middleware, pp 329–350
Salton G, Wong A, Yang CS (1975) A vector space model for automatic indexing. Commun ACM 18(11):613–620. doi:10.1145/361219.361220
Shen Z, Luo J, Zimmermann R, Vasilakos AV (2011) Peer-to-peer media streaming: insights and new developments. Proc IEEE 99(12):2089–2109
Stoica I et al (2001) Chord: a scalable peer-to-peer lookup service for internet applications. SIGCOMM Comput Commun Rev 31(4):149–160
Talaei S, Abhari A (2010) Adding multimedia streaming to BitTorrent. In: Proceedings of the 2010 spring simulation multiconference, pp 235:1–235:6
TomP2P Configurations (2013). http://tomp2p.net/doc/advanced/
Trajkovska I, Salvachua Rodriguez J, Mozo Velasco A (2010) A novel P2P and cloud computing hybrid architecture for multimedia streaming with QoS cost functions. In: Proceedings of the international conference on multimedia, pp 1227–1230
Traversat B, Abdelaziz M, Pouyoul E (2003) Project JXTA: a loosely-consistent DHT rendezvous walker. http://www.jxta.org/docs/jxta-dht.pdf
Tuning Cassandra (2013). http://www.datastax.com/docs/1.0/operations/tuning
Udacity (2013). http://www.udacity.com
van Rijsbergen CJ (1979) Information retrieval, 2nd edn. Butterworths
Voorhees EM (1994) Query expansion using lexical-semantic relations. In: Proceedings of the 17th annual international ACM SIGIR conference, pp 61–69
Vratonjić N, et al (2007) Enabling DVD-like features in P2P video-on-demand systems. In: Proceedings of the workshop on peer-to-peer streaming and IP-TV. ACM, pp 329–334
Wolchok S, Halderman JA (2010) Crawling BitTorrent DHTs for fun and profit. In: Proceedings of the 4th USENIX conference on offensive technologies, pp 1–8
Wowza Media Server (2013). http://www.wowza.com/media-server
Wu Y et al (2011) Cloudmedia: when cloud on demand meets video on demand. In: Proceedings of the international conference on distributed computing systems, pp 268–277
Xu T et al (2010) APEX: a personalization framework to improve quality of experience for DVD-like functions in P2P VoD applications. In: IWQoS, pp 1–9
Yiu WP, Jin X, Chan SH (2007) VMesh: distributed segment storage for peer-to-peer interactive video streaming. IEEE J Sel A Commun 25(9):1717–1731
Youtube (2013). http://www.youtube.com
Youtube Statistics (2013). http://www.youtube.com/yt/press/statistics.html
Zheng C, Shen G, Li S (2005) Distributed prefetching scheme for random seek support in p2p streaming applications. In: Proceedings of ACM P2PMMS workshop, pp 29–38
Acknowledgments
This research is part of FAPESP project OnAIR grant number 2010/19111-9.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Rocha, V., Kon, F., Cobe, R. et al. A hybrid cloud-P2P architecture for multimedia information retrieval on VoD services. Computing 98, 73–92 (2016). https://doi.org/10.1007/s00607-014-0428-3
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00607-014-0428-3