Abstract
We introduce an architecture for undertaking data processing across multiple layers of a distributed computing infrastructure, composed of edge devices (making use of Internet-of-Things (IoT) based protocols), intermediate gateway nodes and large scale data centres. In this way, data processing that is intended to be carried out in the data centre can be pushed to the edges of the network – enabling more efficient use of data centre and in-network resources. We suggest the need for specialist data analysis and management algorithms that are resource-aware, and are able to split computation across these different layers. We propose a coordination mechanism that is able to combine different types of data processing capability, such as in-transit and in-situ. An application scenario is used to illustrate the concepts, subsequently evaluated through a multi-site deployment.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Fumo, N., Mago, P., Luck, R.: Methodology to estimate building energy consumption using EnergyPlus benchmark models. Energy Buildings 42(12), 2331–2337 (2010). Elsevier
CometCloud Project. http://nsfcac.rutgers.edu/CometCloud/. Accessed Jul 2015
Amazon Kinesis. http://aws.amazon.com/kinesis/. Accessed Mar 2014
Petri, I., Beach, T., Zou, M. et al.: Exploring models, mechanisms for exchanging resources in a federated cloud. In: International Conference on Cloud Engineering (IC2E 2014), pp. 215–224. IEEE Computer Society, Boston (2013). ISBN: 978-1-4799-3766-0
Petri, I., Rana, O., Yacine, R., Li, H., Beach, T., Zou, M., Diaz-Montes, J., Parashar, M.: Cloud supported building data analytics. In: 14th IEEE/ACM International Symposium on Cluster, Cloud, Grid Computing (CCGrid), 26–29 May 2014, pp. 215–224 (2014). doi:10.1109/CCGrid.2014.29
Diaz-Montes, J., Xie, Y., Rodero, I., Zola, J., Ganapathysubramanian, B., Parashar, M.: Exploring the use of elastic resource federations for enabling large-scale scientific workflows. In: Proceedings of Workshop on Many-Task Computing on Clouds, Grids, and Supercomputers (MTAGS), pp. 1–10 (2013)
National Institute of Standards and Technology (NIST): Cyber Physical Systems. http://www.nist.gov/cps/. Accessed Jul 2015
IEEE: P2413 IoT Architectural Framework. https://standards.ieee.org/develop/project/2413.html. Accessed Jul 2015
Xively. http://xively.com. Accessed Jul 2015
Open Sen.se/Internet of Everything. http://open.sen.se/. Accessed Jul 2015
Think Speak. https://thingspeak.com/. Accessed Jul 2015
Pacific Controls Gateway. http://pacificcontrols.net/products/galaxy.html. Accessed Jul 2015
IoT Cloud. http://sites.google.com/site/opensourceiotcloud/. Accessed Jul 2015
Open IoT. http://www.openiot.eu/. Accessed Jul 2015
Fernando, N., Loke, S.W., Rahayu, W.: Mobile cloud computing. Future Gener. Comput. Syst. 29(1), 84–106 (2013)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2016 ICST Institute for Computer Sciences, Social Informatics and Telecommunications Engineering
About this paper
Cite this paper
Petri, I., Diaz-Montes, J., Rana, O., Rezgui, Y., Parashar, M., Bittencourt, L.F. (2016). Coordinating Data Analysis and Management in Multi-layered Clouds. In: Mandler, B., et al. Internet of Things. IoT Infrastructures. IoT360 2015. Lecture Notes of the Institute for Computer Sciences, Social Informatics and Telecommunications Engineering, vol 169. Springer, Cham. https://doi.org/10.1007/978-3-319-47063-4_37
Download citation
DOI: https://doi.org/10.1007/978-3-319-47063-4_37
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-47062-7
Online ISBN: 978-3-319-47063-4
eBook Packages: Computer ScienceComputer Science (R0)