Abstract
A way to improve energy management is to perform balancing both at the Peer-to-peer (P2P) level and then at the Virtual Microgrid-to-Virtual Microgrid (VMG2VMG) level, while considering the intermittency of available Renewable Energy Source (RES). This paper proposes an interdisciplinary analytics-based approach for the formation of VMGs addressing energy balancing. Our approach incorporates Computer Science methods to address an Energy sector problem, utilizing data preprocessing techniques and Machine Learning concepts. It features P2P balancing, where each peer is a prosumer perceived as an individual entity, and Virtual Microgrids (VMGs) as clusters of peers. We conducted several simulations utilizing clustering and binning algorithms for preprocessing energy data. Our approach offers options for generating VMGs of prosumers, prior to using a customized Exhaustive brute-force Balancing Algorithm (EBA). EBA performs balancing at the cluster-to-cluster level, perceived as VMG2VMG balancing. To that end, the study simulates on data from 94 prosumers, and reports outcomes, biases, and prospects for scaling up and expanding this work. Finally, this paper outlines potential ideal usages for the approach, either standalone or integrated with other toolkits and technologies.
Similar content being viewed by others
Explore related subjects
Discover the latest articles, news and stories from top researchers in related subjects.Availability of data and material (data transparency)
Data partly available in the appendices due to confidentiality clauses for the ongoing eDREAM project.
Code availability (software application or custom code)
N/A due to confidentiality clauses for the ongoing eDREAM project.
Notes
In the simulations, historical data are utilized to have a realistic measure of outcomes and balancing goals.
Abbreviations
- DR:
-
Demand response
- P2P:
-
Peer-to-peer
- PV:
-
Photovoltaic
- RES:
-
Renewable energy source
- DSO:
-
Distribution system operator
- DER:
-
Distributed energy resource
- DR:
-
Demand response
- MG:
-
Microgrid
- VMG:
-
Virtual microgrid
- VMG2VMG:
-
VMG to VMG
- VPP:
-
Virtual power plants
- EBA:
-
Exhaustive balancing algorithm
- P2G:
-
Peer-to-Grid
- SG:
-
Smart grid
- AI:
-
Artificial intelligence
- ML:
-
Machine learning
- ToU:
-
Time of use
- RTP:
-
Real time pricing
- CPP:
-
Critical peak pricing
- KPI:
-
Key performance indicator
- nZEB:
-
Nearly zero energy building
- TAE:
-
Total active energy
References
Cagnano A, De Tuglie E, Mancarella P (2020) Microgrids: overview and guidelines for practical implementations and operation. Appl Energy 258:114039
Tabatabaei NM, Kabalci E, Bizon N (eds) (2019) Microgrid architectures, control and protection methods. Springer, Berlin
Asmus P (2010) Microgrids, virtual power plants and our distributed energy future. Electr J 23(10):72–82
Badami M, Fambri G, Mancò S, Martino M, Damousis IG, Agtzidis D, Tzovaras D (2020) A decision support system tool to manage the flexibility in renewable energy-based power systems. Energies 13(1):153
Kafle YR, Mahmud K, Morsalin S, Town GE (2016, September). Towards an internet of energy. In: 2016 IEEE international conference on power system technology (POWERCON), IEEE, pp 1–6
Tzovaras D, Damousis I, Papanikolaou A, Pitsiladis G, Barbagelata G (2019) DRIMPAC—unified demand response interoperability framework enabling market participation of active energy consumers. In: Multidisciplinary digital publishing institute proceedings, vol 20, No. 1, p 15
Long C, Wu J, Zhou Y, Jenkins N (2018) Peer-to-peer energy sharing through a two-stage aggregated battery control in a community Microgrid. Appl Energy 226:261–276
Hirsch A, Parag Y, Guerrero J (2018) Microgrids: a review of technologies, key drivers, and outstanding issues. Renew Sustain Energy Rev 90:402–411
Paiva LT, Fontes FA (2018) Optimal electric power generation with underwater kite systems. Computing 100(11):1137–1153
Bintoudi AD, Zyglakis L, Apostolos T, Ioannidis D, Al-Agtash S, Martinez-Ramos JL et al. (2017, November). Novel hybrid design for microgrid control. In: 017 IEEE PES Asia-Pacific Power and Energy Engineering Conf. (APPEEC), IEEE, pp 1–6.
Balijepalli VM, Pradhan V, Khaparde SA, Shereef, RM (2011, December). Review of demand response under smart grid paradigm. In ISGT2011-India, IEEE, pp 236–243
Sioshansi FP (ed) (2019) Consumer, prosumer, prosumager: how service innovations will disrupt the utility business model. Academic Press, Cambridge
Charalambous A, Hadjidemetriou L, Zacharia L, Bintoudi AD, Tsolakis AC, Tzovaras D, Kyriakides E (2019) Phase balancing and reactive power support services for microgrids. Appl Sci 9(23):5067
Ellahi M, Abbas G, Khan I, Koola PM, Nasir M, Raza A, Farooq U (2019) Recent approaches of forecasting and optimal economic dispatch to overcome intermittency of wind and photovoltaic (PV) systems: a review. Energies 12(22):4392
Khuntia SR, Rueda JL, van der Meijden MA (2016) Forecasting the load of electrical power systems in mid-and long-term horizons: a review. IET Gener Transm Distrib 10(16):3971–3977
Livingston D, Sivaram V, Freeman M, Fiege M (2018) Applying blockchain technology to electric power systems. Council on Foreign Relations.
Nosratabadi SM, Hooshmand RA, Gholipour E (2017) A comprehensive review on microgrid and virtual power plant concepts employed for distributed energy resources scheduling in power systems. Renew Sustain Energy Rev 67:341–363
Akbary P, Ghiasi M, Pourkheranjani MRR, Alipour H, Ghadimi N (2019) Extracting appropriate nodal marginal prices for all types of committed reserve. Comput Econ 53(1):1–26
Liu N, Yu X, Wang C, Li C, Ma L, Lei J (2017) Energy-sharing model with price-based demand response for microgrids of peer-to-peer prosumers. IEEE Trans Power Syst 32(5):3569–3583
Zhou Y, Wu J, Long C, Cheng M, Zhang C (2017) Performance evaluation of peer-to-peer energy sharing models. Energy Procedia 143:817–822
Moura PS, de Almeida AT (2010) Multi-objective optimization of a mixed renewable system with demand-side management. Renew Sustain Energy Rev 14(5):1461–1468
Blake ST, O’Sullivan DT (2018) Optimization of distributed energy resources in an industrial microgrid. Procedia CIRP 67:104–109
Zhang Y, Gatsis N, Giannakis GB (2013) Robust energy management for microgrids with high-penetration renewables. IEEE Trans Sustain Energy 4(4):944–953
Quiggin D, Cornell S, Tierney M, Buswell R (2012) A simulation and optimisation study: Towards a decentralised microgrid, using real world fluctuation data. Energy 41(1):549–559
Ding YM, Hong SH, Li XH (2014) A demand response energy management scheme for industrial facilities in smart grid. IEEE Trans Industr Inf 10(4):2257–2269
Hawkes AD, Leach MA (2009) Modelling high level system design and unit commitment for a microgrid. Appl Energy 86(7–8):1253–1265
Zhang C, Wu J, Zhou Y, Cheng M, Long C (2018) Peer-to-Peer energy trading in a Microgrid. Appl Energy 220:1–12
Anoh K, Maharjan S, Ikpehai A, Zhang Y, Adebisi B (2019) Energy peer-to-peer trading in virtual microgrids in smart grids: a game-theoretic approach. IEEE Trans Smart Grid 11:1264–1275
Vergados DJ, Mamounakis I, Makris P, Varvarigos E (2016) Prosumer clustering into virtual microgrids for cost reduction in renewable energy trading markets. Sustain Energy Grids Netw 7:90–103
Cioara T, Anghel I, Pop C, Bertoncini M, Croce V, Ioannidis D, D'Oriano L (2018, June). Enabling new technologies for demand response decentralized validation using blockchain. In: 2018 IEEE Int’l conf. on environment and electrical engineering and 2018 ieee industrial and commercial power systems europe (EEEIC/I&CPS Europe), IEEE, pp 1–4
D’Oriano L, Mastandrea G, Rana G, Raveduto G, Croce V, Verber M, Bertoncini M (2018, November). Decentralized blockchain flexibility system for Smart Grids: Requirements engineering and use cases. In: 2018 Int’l IEEE conf. and workshop in obuda on electrical and power engineering (CANDO-EPE), IEEE, pp 39–44
Pop C, Cioara T, Antal M, Anghel I, Salomie I, Bertoncini M (2018) Blockchain based decentralized management of demand response programs in smart energy grids. Sensors 18(1):162
Petrican T, Vesa AV, Antal M, Pop C, Cioara T, Anghel I, Salomie I (2018, September). Evaluating forecasting techniques for integrating household energy prosumers into smart grids. In: 2018 IEEE 14th Int’l conf. on intelligent computer communication and processing (ICCP), IEEE, pp 79–85
Stecchi U, Gomez J, Gallego L, Santori F, Rico J (2019). A multipurpose ICT platform for supporting energy transition: first results in flexibility profiling. In: 2019 1st Int’l Conf. Energy Transition in the Mediterranean Area (SyNERGY MED), IEEE, pp 1–6
Bragatto T, Cresta M, Croce V, Paulucci M, Santori F, Ziu D (2019). A real-life experience on 2 nd life batteries services for Distribution System Operator. In: 2019 IEEE Int’l conf. environment and electrical engineering and 2019 ieee industrial and commercial power systems Europe (EEEIC/I&CPS Europe), IEEE, pp 1–6
Pop C, Antal M, Cioara T, Anghel I, Sera D, Salomie I, Bertoncini M (2019) Blockchain-based scalable and tamper-evident solution for registering energy data. Sensors 19(14):3033
Vesa AV, Cioara T, Anghel I, Antal M, Pop C, Iancu B, Salomie I (2020) Energy flexibility prediction for data center engagement in demand response programs. Sustainability 12(4):1417
Pop C, Cioara T, Anghel I, Antal M, and Salomie I (2020) Blockchain based Decentralized Applications: Technology Review and Development Guidelines. arXiv preprint http://arxiv.org/abs/2003.07131.
Kong X, Liu D, Wang C, Sun F, Li S (2020) Optimal operation strategy for interconnected microgrids in market environment considering uncertainty. Appl Energy 275:115336
Liu W, Gu W, Wang J, Yu W, Xi X (2018) Game theoretic non-cooperative distributed coordination control for multi-microgrids. IEEE Trans Smart Grid 9(6):6986–6997
Cardoso G, Brouhard T, DeForest N, Wang D, Heleno M, Kotzur L (2018) Battery aging in multi-energy microgrid design using mixed integer linear programming. Appl Energy 231:1059–1069
Koukaras P, and Tjortjis C (2019) Social media analytics, types and methodology. In: Machine Learning Paradigms, Springer, Cham, pp 401–427
Dikaiakos MD, Katsaros D, Mehra P, Pallis G, Vakali A (2009) Cloud computing: Distributed internet computing for IT and scientific research. IEEE Internet Comput 13(5):10–13
Papazoglou MP, Georgakopoulos D (2003) Introduction: service-oriented computing. Commun ACM 46(10):24–28
“Digital Innovation Hubs - Smart Specialisation Platform.”, http://s3platform.jrc.ec.europa.eu/digital-innovation-hubs-tool/-/dih/1521/view.
Vafeiadis T, Zikos S, Stavropoulos G, Ioannidis D, Krinidis S, Tzovaras D, and Moustakas K (2017) Machine learning based occupancy detection via the use of smart meters. In: 2017 Int’l symposium on computer science and intelligent controls (ISCSIC), IEEE, pp 6–12
Adamopoulou AA, Tryferidis AM, Tzovaras DK (2016) A context-aware method for building occupancy prediction. Energy Build 110:229–244
McKinney W (2010). Data structures for statistical computing in python. In: Proceedings of the 9th python in science conference, vol 445, pp 51–56
Arthur D, and Vassilvitskii S (2006) k-means++: The advantages of careful seeding. Stanford.
Pedregosa F, Varoquaux G, Gramfort A, Michel V, Thirion B, Grisel O, Vanderplas J (2011) Scikit-learn: Machine learning in Python. J Mach Learn Res 12:2825–2830
Rousseeuw PJ (1987) Silhouettes: a graphical aid to the interpretation and validation of cluster analysis. J Comput Appl Math 20:53–65
Ketchen DJ, Shook CL (1996) The application of cluster analysis in strategic management research: an analysis and critique. Strateg Manag J 17(6):441–458
Conejo AJ, Contreras J, Espínola R, Plazas MA (2005) Forecasting electricity prices for a day-ahead pool-based electric energy market. Int’l J Forecast 21(3):435–462
Tsolakis AC, Moschos I, Votis K, Ioannidis D, Tzovaras D, Pandey P et al. (2018) A Secured and Trusted Demand Response system based on Blockchain technologies. In: 2018 Innovations in intelligent systems and applications (INISTA), IEEE, pp 1–6.
Mendling J, Weber I, Aalst WVD, Brocke JV, Cabanillas C, Daniel F et al (2018) Blockchains for business process management-challenges and opportunities. ACM Trans Manag Inf Syst (TMIS) 9(1):1–16
Acknowledgments
This work has been conducted within the eDREAM project Grant number 774478, co-funded by the European Commission as part of the H2020 Framework Programme (H2020-LCE-2017-SGS).
Funding
The project eDREAM has received funding from the European Union’s Horizon 2020 research and innovation programme under grant agreement N. 774478.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of interest
Researchers in Information Technologies Institute, Centre of Research & Technology or School of Science and Technology, International Hellenic University.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Appendices
Appendix 1: k-means clustering on raw data for different timestamps
On the following figures, different coloring is applied for marked entries that were positioned to different clusters.
Appendix 2: Clustering and balancing on a P2P level example
Each table refers to the figure on its right, while different coloring is applied for marked entries that were positioned to different clusters.
Appendix 3: Binning overview on raw data on a specific timestamp
CUT: #create Bins by pandas.cut (binning) [47] specifically define the bin value edges.
QCUT: create Bins by pandas.qcut (binning) [47] "Quantile-based discretization function" equally sized bins.
Appendix 4: CUT and QCUT methods for “sunlight” timestamps’ example
CUT method output is depicted on the left side figures, while QCUT method output is depicted on the right-side figures.
Rights and permissions
About this article
Cite this article
Koukaras, P., Tjortjis, C., Gkaidatzis, P. et al. An interdisciplinary approach on efficient virtual microgrid to virtual microgrid energy balancing incorporating data preprocessing techniques. Computing 104, 209–250 (2022). https://doi.org/10.1007/s00607-021-00929-7
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00607-021-00929-7