research-article

Thunder crystal: a novel crowdsourcing-based content distribution platform

Authors:

Richard T. B. MaAuthors Info & Claims

NOSSDAV '15: Proceedings of the 25th ACM Workshop on Network and Operating Systems Support for Digital Audio and Video

Pages 43 - 48

https://doi.org/10.1145/2736084.2736085

Published: 18 March 2015 Publication History

Abstract

Content distribution, especially the distribution of video content, unavoidably consumes bandwidth resource heavily. Internet content providers (ICP) spend lots of money to buy content distribution network (CDN) service. By deploying thousands of edge servers close to end users, CDN companies are able to distribute content efficiently. In lieu of traditional CDN systems, we implement a crowdsourcing-based content distribution system, Thunder Crystal, which utilizes agents' upload bandwidth to amplify the content distribution capacity. Agents are well motivated to contribute storage and upload bandwidth to the system by rebated cash. As far as we know, this is a novel system that has not been studied before. In this work, we will present its design principles first. Then, we study agent behavior and methods to evaluate system efficiency and user efficiency. We evaluate the system by simulations, and observe that agents are well motivated to keep online most of the time and amplify the content distribution capacity by 10~20 times.

References

[1]

Xiaomi mi wifi wireless ap router. http://www.xiaomishop.com/128-original-xiaomi-mi-wifi-wireless-router.html.

[2]

Xunlei shuijing. http://shuijing.xunlei.com/.

[3]

A. Balachandran, V. Sekar, A. Akella, and S. Seshan. Analyzing the potential benefits of cdn augmentation strategies for internet video workloads. In Proceedings of the 2013 conference on Internet measurement conference, pages 43--56. ACM, 2013.

Digital Library

[4]

L. Chen, Y. Zhou, and D. M. Chiu. A lifetime model of online video popularity. In Computer Communication and Networks (ICCCN), 2014 23rd International Conference on, pages 1--8. IEEE, 2014.

[5]

C. Huang, A. Wang, J. Li, and K. W. Ross. Measuring and evaluating large-scale cdns. In ACM IMC, volume 8, 2008.

[6]

Y. Huang, T. Z. Fu, D.-M. Chiu, J. Lui, and C. Huang. Challenges, design and analysis of a large-scale p2p-vod system. In ACM SIGCOMM computer communication review, volume 38, pages 375--388. ACM, 2008.

Digital Library

[7]

R. Krishnan, H. V. Madhyastha, S. Srinivasan, S. Jain, A. Krishnamurthy, T. Anderson, and J. Gao. Moving beyond end-to-end path information to optimize cdn performance. In Proceedings of the 9th ACM SIGCOMM IMC, pages 190--201. ACM, 2009.

Digital Library

[8]

Z. Liu, C. Wu, B. Li, and S. Zhao. Uusee: large-scale operational on-demand streaming with random network coding. In INFOCOM, 2010 Proceedings IEEE, pages 1--9. IEEE, 2010.

Digital Library

[9]

A. Passarella. A survey on content-centric technologies for the current internet: Cdn and p2p solutions. Computer Communications, 35(1): 1--32, 2012.

Digital Library

[10]

B. Tan and L. Massoulié. Optimal content placement for peer-to-peer video-on-demand systems. IEEE/ACM Transactions on Networking (TON), 21(2): 566--579, 2013.

Digital Library

[11]

S. Traverso, M. Ahmed, M. Garetto, P. Giaccone, E. Leonardi, and S. Niccolini. Temporal locality in today's content caching: why it matters and how to model it. ACM SIGCOMM CCR, 43(5): 5--12, 2013.

Digital Library

[12]

W. Wu, R. T. Ma, and J. C. Lui. Distributed caching via rewarding: An incentive scheme design in p2p-vod systems. Parallel and Distributed Systems, IEEE Transactions on, 25(3): 612--621, 2014.

Digital Library

[13]

L. Yang and W. Lou. Pricing, competition and innovation: a profitable business model to resolve the tussle involved in peer-to-peer streaming applications. In Proceedings of the 2012 IEEE 20th International Workshop on Quality of Service, page 33. IEEE Press, 2012.

Digital Library

[14]

H. Yin, X. Liu, T. Zhan, V. Sekar, F. Qiu, C. Lin, H. Zhang, and B. Li. Design and deployment of a hybrid cdn-p2p system for live video streaming: experiences with livesky. In Proceedings of the 17th ACM international conference on Multimedia, pages 25--34. ACM, 2009.

Digital Library

[15]

B. Q. Zhao, J. C. Lui, and D.-M. Chiu. A mathematical framework for analyzing adaptive incentive protocols in p2p networks. Networking, IEEE/ACM Transactions on, 20(2): 367--380, 2012.

Digital Library

[16]

Y. Zhou, T. Z. J. Fu, and D. M. Chiu. Statistical modeling and analysis of p2p replication to support vod service. In Proceedings of IEEE INFOCOM, pages 945--953, 2011.

Cited By

Zhu RZhang X(2022)Efficient incentive mechanism for video distribution on the home Internet of Things devicesFrontiers in Computing and Intelligent Systems10.54097/fcis.v1i2.17041:2(44-49)Online publication date: 25-Sep-2022
https://doi.org/10.54097/fcis.v1i2.1704
Shi ZZhou YWu DWang C(2022)PPVC: Online Learning Toward Optimized Video Content CachingIEEE/ACM Transactions on Networking10.1109/TNET.2021.313203830:3(1029-1044)Online publication date: Jun-2022
https://doi.org/10.1109/TNET.2021.3132038
Zhou YChen JYe GWu DWang JChen M(2021)Collaboratively Replicating Encoded Content on RSUs to Enhance Video Services for VehiclesIEEE Transactions on Mobile Computing10.1109/TMC.2019.296002220:3(877-892)Online publication date: 1-Mar-2021
https://doi.org/10.1109/TMC.2019.2960022
Show More Cited By

Index Terms

Thunder crystal: a novel crowdsourcing-based content distribution platform
1. Networks
  1. Network services
    1. Network management
    2. Network monitoring
2. Software and its engineering
  1. Software organization and properties
    1. Software system structures
      1. Distributed systems organizing principles
        Organizing principles for web applications

Recommendations

Design, Implementation, and Measurement of a Crowdsourcing-Based Content Distribution Platform
Special Section on Multimedia Big Data: Networking and Special Section on Best Papers From ACM MMSYS/NOSSDAV 2015

Content distribution, especially the distribution of video content, unavoidably consumes bandwidth resources heavily. Internet content providers invest heavily in purchasing content distribution network (CDN) services. By deploying tens of thousands of ...
Tag Thunder: Towards Non-Visual Web Page Skimming
ASSETS '16: Proceedings of the 18th International ACM SIGACCESS Conference on Computers and Accessibility

Tag thunder is an audio version of a visual tag cloud content representation. Tag thunders aim to bring quick reading strategies, such as skimming, to blind people. Tag thunders vocalize the key terms of a page using concurrent speech paradigm coupled ...
Crowdsourced semantics with semantic tagging: "Don't just tag it, LexiTag it!"
CrowdSem'13: Proceedings of the 1st International Conference on Crowdsourcing the Semantic Web - Volume 1030

Free form tagging was one of the most useful contributions of "Web2.0" toward the problem of content management and discovery on the web. Semantic tagging is a more recent but much less successful innovation borne of frustration at the limitations of ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

NOSSDAV '15: Proceedings of the 25th ACM Workshop on Network and Operating Systems Support for Digital Audio and Video

March 2015

83 pages

ISBN:9781450333528

DOI:10.1145/2736084

Program Chairs:
Wu-chi Feng
Portland State University
,
Michael Zink
University of Massachusetts, Amherst

Copyright © 2015 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

In-Cooperation

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 18 March 2015

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

Science Technology Planning Project of Shenzhen
NSFC
Natural Science Foundation of SZU

Conference

MMSys '15

Sponsor:

MMSys '15: Multimedia Systems Conference 2015

March 18 - 20, 2015

Oregon, Portland

Acceptance Rates

NOSSDAV '15 Paper Acceptance Rate 12 of 43 submissions, 28%;

Overall Acceptance Rate 118 of 363 submissions, 33%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

30
Total Citations
View Citations
325
Total Downloads

Downloads (Last 12 months)5
Downloads (Last 6 weeks)3

Reflects downloads up to 02 Oct 2024

Other Metrics

View Author Metrics

Citations

Cited By

Zhu RZhang X(2022)Efficient incentive mechanism for video distribution on the home Internet of Things devicesFrontiers in Computing and Intelligent Systems10.54097/fcis.v1i2.17041:2(44-49)Online publication date: 25-Sep-2022
https://doi.org/10.54097/fcis.v1i2.1704
Shi ZZhou YWu DWang C(2022)PPVC: Online Learning Toward Optimized Video Content CachingIEEE/ACM Transactions on Networking10.1109/TNET.2021.313203830:3(1029-1044)Online publication date: Jun-2022
https://doi.org/10.1109/TNET.2021.3132038
Zhou YChen JYe GWu DWang JChen M(2021)Collaboratively Replicating Encoded Content on RSUs to Enhance Video Services for VehiclesIEEE Transactions on Mobile Computing10.1109/TMC.2019.296002220:3(877-892)Online publication date: 1-Mar-2021
https://doi.org/10.1109/TMC.2019.2960022
Santos DSilva RCorujo DAguiar RParreira B(2021)Follow the User: A Framework for Dynamically Placing Content Using 5G-EnablersIEEE Access10.1109/ACCESS.2021.30515709(14688-14709)Online publication date: 2021
https://doi.org/10.1109/ACCESS.2021.3051570
Zhang CPang HGao LDing QYang YSun L(2020)Incentivizing Mobile Video Users With Data Sponsoring and Edge CachingIEEE Access10.1109/ACCESS.2019.29636238(9640-9654)Online publication date: 2020
https://doi.org/10.1109/ACCESS.2019.2963623
XUE HYOU JWANG J(2019)An Intelligent and Decentralized Content Diffusion System in Smart-Router NetworksIEICE Transactions on Communications10.1587/transcom.2018EBP3264E102.B:8(1595-1606)Online publication date: 1-Aug-2019
https://doi.org/10.1587/transcom.2018EBP3264
Pang HWang ZYan CDing QYi KLiu JSun L(2019)Content Harvest Network: Optimizing First Mile for Crowdsourced Live StreamingIEEE Transactions on Circuits and Systems for Video Technology10.1109/TCSVT.2018.286261929:7(2112-2125)Online publication date: Jul-2019
https://doi.org/10.1109/TCSVT.2018.2862619
Ma GWang ZYe JZhu WShorey RMurty RChen YJamieson K(2018)Wireless Caching in Large-Scale Edge Access PointsProceedings of the 24th Annual International Conference on Mobile Computing and Networking10.1145/3241539.3267741(726-728)Online publication date: 15-Oct-2018
https://dl.acm.org/doi/10.1145/3241539.3267741
Ma MZhang LLiu JWang ZPang HSun LLi WHou GChu K(2018)Characterizing User Behaviors in Mobile Personal LivecastACM Transactions on Multimedia Computing, Communications, and Applications10.1145/321975114:3s(1-24)Online publication date: 31-Jul-2018
https://dl.acm.org/doi/10.1145/3219751
Pang HGao LDing QLiu JSun LMayer-Patel KWu CSarhan N(2018)Competitive Analysis of Data Sponsoring and Edge Caching for Mobile Video StreamingProceedings of the 28th ACM SIGMM Workshop on Network and Operating Systems Support for Digital Audio and Video10.1145/3210445.3210451(37-42)Online publication date: 12-Jun-2018
https://dl.acm.org/doi/10.1145/3210445.3210451
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents