research-article

My cloudy time machine: a scalable microservice-based platform for data processing in cloud-edge systems: a proof of concept for the ROBIN-cloud project

Authors:

Darius-Florentin Neatu,

Radu-Dumitru Stochitoiu,

Andrei-Vlad Postoaca,

Ion-Dorinel Filip,

Florin PopAuthors Info & Claims

SAC '19: Proceedings of the 34th ACM/SIGAPP Symposium on Applied Computing

Pages 1451 - 1458

https://doi.org/10.1145/3297280.3297427

Published: 08 April 2019 Publication History

Abstract

As Cloud computing is a very well developed domain, many companies tend to move their entire activity in Cloud. At the same time, there is a tendency to move some of the data processing from Cloud to Edge as close as possible to the end devices. One main advantage of this approach is minimizing the latency in communication between the end devices and Cloud. Better usage of on premise devices is also a good achievement of the Edge offload. In this paper, we propose an architecture for applications that are connected to ROBIN-Cloud or to a general Cloud. We present how we have encapsulated Python-based microservices in Docker containers. We provide an implementation for the My Cloudy Time Machine application - GIGEL (Guided Intelligent GEared Legend), a nearby autonomous assistive robot. We use this prototype to evaluate the scalability of the proposed architecture. We also present results that show how to gain high performance by tuning a container-based embedded system.

References

[1]

Shadi Al-Sarawi, Mohammed Anbar, Kamal Alieyan, and Mahmood Alzubaidi. 2017. Internet of Things (IoT) communication protocols. In Information Technology (ICIT), 2017 8th International Conference on. IEEE, 685--690.

[2]

Paolo Bellavista and Alessandro Zanni. 2017. Feasibility of fog computing deployment based on docker containerization over raspberrypi. In Proceedings of the 18th int. conf. on distributed computing and networking. ACM, 16.

Digital Library

[3]

David Bernstein. 2014. Containers and cloud: From lxc to docker to kubernetes. IEEE Cloud Computing 1.3, pages 81--84 (2014).

[4]

A. Carbone, Asterios Katsifodimos, Stephan Ewen, Volker Markl, Seif Haridi, and Kostas Tzoumas. 2016. Apache Flink TM : Stream and Batch Processing in a Single Engine Paris. (2016).

[5]

J Han et al. 2011. Survey on nosql database. Pervasive computing and applications. ICPCA (2011).

[6]

M. Waibel et al. 2011. Roboearth - A World Wide Web for Robots. Robotics and Automation Mag., vol. 18, no. 2, June 2011, pp. 69--82. (2011).

[7]

Vinod Kumar Vavilapalli et al. 2013. Apache hadoop yarn: Yet another resource negotiator. Proceedings of the 4th annual Symposium on Cloud Computing (2013).

Digital Library

[8]

Bogdan Ghit, Florin Pop, and Valentin Cristea. 2010. Epidemic-style global load monitoring in large-scale overlay networks. In 2010 International Conference on P2P, Parallel, Grid, Cloud and Internet Computing. IEEE, 393--398.

Digital Library

[9]

Benjamin Hindman, Andy Konwinski, Matei Zaharia, Ali Ghodsi, Anthony D. Joseph, Randy Katz, Scott Shenker, and Ion Stoica. 2011. Mesos: A Platform for Fine-grained Resource Sharing in the Data Center. (2011), 295--308. http://dl.acm.org/citation.cfm?id=1972457.1972488

Digital Library

[10]

G. Hu, W. P. Tay, and Y. Wen. 2012. Cloud robotics: architecture, challenges and applications. IEEE Network 26, 3 (2012), 21--28.

[11]

D. Hunziker, M. Gajamohan, M. Waibel, and R. D'Andrea. 2013. Rapyuta: The RoboEarth Cloud Engine. (2013), 438--444.

[12]

George V Iordache, Marcela S Boboila, Florin Pop, Corina Stratan, and Valentin Cristea. 2006. A decentralized strategy for genetic scheduling in heterogeneous environments. In OTM Confederated International Conferences" On the Move to Meaningful Internet Systems". Springer, 1234--1251.

Digital Library

[13]

Muhammad Hussain Iqbal and Tariq Rahim Soomro. 2015. Big Data Analysis: Apache Storm Perspective. International Journal of Computer Trends and Technology (IJCTT) - Volume 19 Number 1 - Jan (2015).

[14]

K. Kaur, T. Dhand, N. Kumar, and S. Zeadally. 2017. Container-as-a-Service at the Edge: Trade-off between Energy Efficiency and Service Availability at Fog Nano Data Centers. IEEE Wireless Communications 24, 3 (June 2017), 48--56.

Digital Library

[15]

Lavinia NĂSTASE, Ionut Eugen SANDU, and Nirvana POPESCU. 2017. An Experimental Evaluation of Application Layer Protocols for the Internet of Things. Studies in Informatics and Control 26, 4 (2017), 403--412.

[16]

C. Pahl and B. Lee. 2015. Containers and Clusters for Edge Cloud Architectures - A Technology Review. In 2015 3rd International Conference on Future Internet of Things and Cloud. 379--386.

Digital Library

[17]

Vernon Turner, John F Gantz, David Reinsel, and Stephen Minton. 2014. The digital universe of opportunities: Rich data and the increasing value of the internet of things. IDC Analyze the Future 16 (2014).

[18]

Radu Velea, Casian CIOBANU, Laurentiu MARGARIT, and Ion Bica. 2017. Network Traffic Anomaly Detection Using Shallow Packet Inspection and Parallel K-means Data Clustering. Studies in Informatics and Control 26, 4 (2017), 387--396.

[19]

Alvaro Videla and Jason JW Williams. 2012. Rabbitmq in action: distributed messaging for everyone. Manning (2012).

[20]

Matei Zaharia, Mosharaf Chowdhury, Tathagata Das, Ankur Dave, Justin Ma, Murphy McCauly, Michael J. Franklin, Scott Shenker, and Ion Stoica. 2012. Resilient Distributed Datasets: A Fault-Tolerant Abstraction for In-Memory Cluster Computing. (2012), 15--28. https://www.usenix.org/conference/nsdi12/technical-sessions/presentation/zaharia

Digital Library

Cited By

Sirbu DNegru CPop FEsposito CHung CHong JBechini ASong E(2021)Storage service for edge computingProceedings of the 36th Annual ACM Symposium on Applied Computing10.1145/3412841.3441991(1165-1171)Online publication date: 22-Mar-2021
https://dl.acm.org/doi/10.1145/3412841.3441991
Shi YGuo YLv LZhang K(2020)An Efficient Resource Scheduling Strategy for V2X Microservice Deployment in Edge ServersFuture Internet10.3390/fi1210017212:10(172)Online publication date: 15-Oct-2020
https://doi.org/10.3390/fi12100172
Balteanu VNeculai ANegru CPop FStoica AHung CCerny TShin DBechini A(2020)Near real-time scheduling in cloud-edge platformsProceedings of the 35th Annual ACM Symposium on Applied Computing10.1145/3341105.3374046(1264-1271)Online publication date: 30-Mar-2020
https://dl.acm.org/doi/10.1145/3341105.3374046
Show More Cited By

Index Terms

My cloudy time machine: a scalable microservice-based platform for data processing in cloud-edge systems: a proof of concept for the ROBIN-cloud project
1. Computer systems organization
  1. Dependable and fault-tolerant systems and networks
    1. Redundancy
  2. Embedded and cyber-physical systems
    1. Embedded systems
    2. Robotics
2. Networks
  1. Network properties
    1. Network reliability

Recommendations

Monitoring-based auto-scalability across hybrid clouds
SAC '18: Proceedings of the 33rd Annual ACM Symposium on Applied Computing

Cloud computing is a relatively new type of Internet-based computing that becomes more and more popular. Using methods like virtualization, adopting architectures based on microservices, automation of building and deployment processes, Cloud could ...
A Conceptual Platform of SLA in Cloud Computing
DASC '11: Proceedings of the 2011 IEEE Ninth International Conference on Dependable, Autonomic and Secure Computing

Cloud computing is a promising technology, where the infrastructure, developing platform, software and storage are delivered as a service. With the development of cloud computing, more and more cloud service providers emerge. However, there are no ...
Auto-scaling techniques in container-based cloud and edge/fog computing: Taxonomy and survey
Abstract
The long-held dream of computing as a service was realized with the emergence of cloud computing. Recently, fog and edge computing have been introduced as extensions of cloud networks, providing networking, processing, data management, ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

SAC '19: Proceedings of the 34th ACM/SIGAPP Symposium on Applied Computing

April 2019

2682 pages

ISBN:9781450359337

DOI:10.1145/3297280

Conference Chairs:
Chih-Cheng Hung
Kennesaw State University, Marietta, Georgia
,
George A. Papadopoulos
University of Cyprus, Nicosia, Cyprus

Copyright © 2019 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGAPP: ACM Special Interest Group on Applied Computing

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 08 April 2019

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

Conference

SAC '19

Sponsor:

SIGAPP

SAC '19: The 34th ACM/SIGAPP Symposium on Applied Computing

April 8 - 12, 2019

Limassol, Cyprus

Acceptance Rates

Overall Acceptance Rate 1,650 of 6,669 submissions, 25%

Upcoming Conference

SAC '25

Sponsor:
sigapp

The 40th ACM/SIGAPP Symposium on Applied Computing

March 31 - April 4, 2025

Catania , Italy

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

4
Total Citations
View Citations
180
Total Downloads

Downloads (Last 12 months)8
Downloads (Last 6 weeks)0

Reflects downloads up to 17 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

Sirbu DNegru CPop FEsposito CHung CHong JBechini ASong E(2021)Storage service for edge computingProceedings of the 36th Annual ACM Symposium on Applied Computing10.1145/3412841.3441991(1165-1171)Online publication date: 22-Mar-2021
https://dl.acm.org/doi/10.1145/3412841.3441991
Shi YGuo YLv LZhang K(2020)An Efficient Resource Scheduling Strategy for V2X Microservice Deployment in Edge ServersFuture Internet10.3390/fi1210017212:10(172)Online publication date: 15-Oct-2020
https://doi.org/10.3390/fi12100172
Balteanu VNeculai ANegru CPop FStoica AHung CCerny TShin DBechini A(2020)Near real-time scheduling in cloud-edge platformsProceedings of the 35th Annual ACM Symposium on Applied Computing10.1145/3341105.3374046(1264-1271)Online publication date: 30-Mar-2020
https://dl.acm.org/doi/10.1145/3341105.3374046
Postoaca ANegru CPop F(2020)Deadline-aware Scheduling in Cloud-Fog-Edge Systems2020 20th IEEE/ACM International Symposium on Cluster, Cloud and Internet Computing (CCGRID)10.1109/CCGrid49817.2020.00-21(691-698)Online publication date: May-2020
https://doi.org/10.1109/CCGrid49817.2020.00-21

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten