Nothing Special   »   [go: up one dir, main page]

skip to main content
10.1145/2602044.2602051acmconferencesArticle/Chapter ViewAbstractPublication Pagese-energyConference Proceedingsconference-collections
research-article

NILMTK: an open source toolkit for non-intrusive load monitoring

Published: 11 June 2014 Publication History

Abstract

Non-intrusive load monitoring, or energy disaggregation, aims to separate household energy consumption data collected from a single point of measurement into appliance-level consumption data. In recent years, the field has rapidly expanded due to increased interest as national deployments of smart meters have begun in many countries. However, empirically comparing disaggregation algorithms is currently virtually impossible. This is due to the different data sets used, the lack of reference implementations of these algorithms and the variety of accuracy metrics employed. To address this challenge, we present the Non-intrusive Load Monitoring Toolkit (NILMTK); an open source toolkit designed specifically to enable the comparison of energy disaggregation algorithms in a reproducible manner. This work is the first research to compare multiple disaggregation approaches across multiple publicly available data sets. Our toolkit includes parsers for a range of existing data sets, a collection of preprocessing algorithms, a set of statistics for describing data sets, two reference benchmark disaggregation algorithms and a suite of accuracy metrics. We demonstrate the range of reproducible analyses which are made possible by our toolkit, including the analysis of six publicly available data sets and the evaluation of both benchmark disaggregation algorithms across such data sets.

References

[1]
G. W. Hart. Nonintrusive appliance load monitoring. Proceedings of the IEEE, 80(12):1870--1891, 1992.
[2]
S. Darby. The effectiveness of feedback on energy consumption. A Review for DEFRA of the Literature on Metering, Billing and direct Displays, 2006.
[3]
California Public Utilities Commission. Final Opinion Authorizing Pacific Gas and Electric Company to Deploy Advanced Metering Infrastructure. Technical report, 2006.
[4]
Department of Energy & Climate Change. Smart Metering Equipment Technical Specifications Version 2. Technical report, UK, 2013.
[5]
J. Z. Kolter and M. J. Johnson. REDD: A public data set for energy disaggregation research. In Proceedings of 1st KDD Workshop on Data Mining Applications in Sustainability, San Diego, CA, USA, 2011.
[6]
K. Anderson, A. Ocneanu, D. Benitez, D. Carlson, A. Rowe, and M. Bergés. BLUED: A fully labeled public dataset for Event-Based Non-Intrusive load monitoring research. In Proceedings of 2nd KDD Workshop on Data Mining Applications in Sustainability, pages 12--16, Beijing, China, 2012.
[7]
S. Barker, A. Mishra, D. Irwin, E. Cecchet, P. Shenoy, and J. Albrecht. Smart*: An open data set and tools for enabling research in sustainable homes. In Proceedings of 2nd KDD Workshop on Data Mining Applications in Sustainability, Beijing, China, 2012.
[8]
A. L. Goldberger, L. A. Amaral, L. Glass, J. M. Hausdorff, P. C. Ivanov, R. G. Mark, J. E. Mietus, G. B. Moody, C.-K. Peng, and H. E. Stanley. PhysioBank, PhysioToolkit, and PhysioNet: components of a new research resource for complex physiologic signals. Circulation, 101(23):e215--e220, 2000.
[9]
D. Kotz and T. Henderson. Crawdad: A community resource for archiving wireless data at dartmouth. Pervasive Computing, IEEE, 4(4):12--14, 2005.
[10]
F. Pedregosa, G. Varoquaux, A. Gramfort, V. Michel, B. Thirion, O. Grisel, M. Blondel, P. Prettenhofer, R. Weiss, V. Dubourg, J. Vanderplas, A. Passos, D. Cournapeau, M. Brucher, M. Perrot, and E. Duchesnay. Scikit-learn: Machine learning in Python. Journal of Machine Learning Research, 12:2825--2830, 2011. arXiv:1201.0490.
[11]
H. Kim, M. Marwah, M. F. Arlitt, G. Lyon, and J. Han. Unsupervised Disaggregation of Low Frequency Power Measurements. In Proceedings of 11th SIAM International Conference on Data Mining, pages 747--758, Mesa, AZ, USA, 2011.
[12]
K. C. Armel, A. Gupta, G. Shrimali, and A. Albert. Is disaggregation the holy grail of energy efficiency? The case of electricity. Energy Policy, 52:213--234, 2013.
[13]
C. Holcomb. Pecan Street Inc.: A Test-bed for NILM. In International Workshop on Non-Intrusive Load Monitoring, Pittsburgh, PA, USA, 2012.
[14]
J.-P. Zimmermann, M. Evans, J. Griggs, N. King, L. Harding, P. Roberts, and C. Evans. Household Electricity Survey. A study of domestic electrical product usage. Technical Report R66141, DEFRA, May 2012.
[15]
S. Makonin, F. Popowich, L. Bartram, B. Gill, and I. V. Bajic. AMPds: A Public Dataset for Load Disaggregation and Eco-Feedback Research. In IEEE Electrical Power and Energy Conference, Halifax, NS, Canada, 2013.
[16]
N. Batra, M. Gulati, A. Singh, and M. B. Srivastava. It's Different: Insights into home energy consumption in India. In Proceedings of the Fifth ACM Workshop on Embedded Sensing Systems for Energy-Efficiency in Buildings, 2013.
[17]
J. Kelly and W. Knottenbelt. UK-DALE: A dataset recording UK Domestic Appliance-Level Electricity demand and whole-house demand. ArXiv e-prints, 2014. arXiv:1404.0284.
[18]
J. Z. Kolter and T. Jaakkola. Approximate Inference in Additive Factorial HMMs with Application to Energy Disaggregation. In Proceedings of the International Conference on Artificial Intelligence and Statistics, pages 1472--1482, La Palma, Canary Islands, 2012.
[19]
M. Zeifman. Disaggregation of home energy display data using probabilistic approach. IEEE Transactions on Consumer Electronics, 58(1):23--31, 2012.
[20]
M. J. Johnson and A. S. Willsky. Bayesian Nonparametric Hidden Semi-Markov Models. Journal of Machine Learning Research, 14:673--701, 2013. arXiv:1203.1365.
[21]
O. Parson, S. Ghosh, M. Weal, and A. Rogers. Non-intrusive load monitoring using prior models of general appliance types. In Proceedings of the 26th AAAI Conference on Artificial Intelligence, pages 356--362, Toronto, ON, Canada, 2012.
[22]
D. Rahayu, B. Narayanaswamy, S. Krishnaswamy, C. Labbe, and D. P. Seetharam. Learning to be energy-wise: Discriminative methods for load disaggregation. In 3rd International Conference on Future Energy Systems, pages 1--4, 2012.
[23]
N. Batra, H. Dutta, and A. Singh. INDiC: Improved Non-Intrusive load monitoring using load Division and Calibration. In International Conference of Machine Learning and Applications, Miami, FL, USA, 2013.
[24]
K. Anderson, M. Berges, A. Ocneanu, D. Benitez, and J. Moura. Event detection for non intrusive load monitoring. In Proceedings of 38th Annual Conference on IEEE Industrial Electronics Society, pages 3312--3317, 2012.
[25]
Y. Low, J. Gonzalez, A. Kyrola, D. Bickson, C. Guestrin, and J. M. Hellerstein. Graphlab: A new parallel framework for machine learning. In Conference on Uncertainty in Artificial Intelligence, Catalina Island, CA, USA, 2010. arXiv:1006.4990.

Cited By

View all
  • (2024)How Can Non-Intrusive Load Monitoring Contribute to the Assessment of the Smart Readiness Indicator?International Sustainable Energy Conference - Proceedings10.52825/isec.v1i.11371Online publication date: 22-Apr-2024
  • (2024)Energy Management in Residential Microgrid Based on Non-Intrusive Load Monitoring and Internet of ThingsSmart Cities10.3390/smartcities70400757:4(1907-1935)Online publication date: 23-Jul-2024
  • (2024)Enabling End-User Development in Smart Homes: A Machine Learning-Powered Digital Twin for Energy Efficient ManagementFuture Internet10.3390/fi1606020816:6(208)Online publication date: 14-Jun-2024
  • Show More Cited By

Index Terms

  1. NILMTK: an open source toolkit for non-intrusive load monitoring

    Recommendations

    Comments

    Please enable JavaScript to view thecomments powered by Disqus.

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    e-Energy '14: Proceedings of the 5th international conference on Future energy systems
    June 2014
    326 pages
    ISBN:9781450328197
    DOI:10.1145/2602044
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

    Sponsors

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 11 June 2014

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. energy disaggregation
    2. non-intrusive load monitoring
    3. smart meters

    Qualifiers

    • Research-article

    Funding Sources

    Conference

    e-Energy '14
    Sponsor:

    Acceptance Rates

    e-Energy '14 Paper Acceptance Rate 23 of 112 submissions, 21%;
    Overall Acceptance Rate 160 of 446 submissions, 36%

    Upcoming Conference

    E-Energy '25

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)196
    • Downloads (Last 6 weeks)22
    Reflects downloads up to 23 Sep 2024

    Other Metrics

    Citations

    Cited By

    View all
    • (2024)How Can Non-Intrusive Load Monitoring Contribute to the Assessment of the Smart Readiness Indicator?International Sustainable Energy Conference - Proceedings10.52825/isec.v1i.11371Online publication date: 22-Apr-2024
    • (2024)Energy Management in Residential Microgrid Based on Non-Intrusive Load Monitoring and Internet of ThingsSmart Cities10.3390/smartcities70400757:4(1907-1935)Online publication date: 23-Jul-2024
    • (2024)Enabling End-User Development in Smart Homes: A Machine Learning-Powered Digital Twin for Energy Efficient ManagementFuture Internet10.3390/fi1606020816:6(208)Online publication date: 14-Jun-2024
    • (2024)MATNilm: Multi-Appliance-Task Non-Intrusive Load Monitoring With Limited Labeled DataIEEE Transactions on Industrial Informatics10.1109/TII.2023.330102620:3(3177-3187)Online publication date: Mar-2024
    • (2024)Unsupervised Energy Disaggregation Via Convolutional Sparse CodingIEEE Transactions on Consumer Electronics10.1109/TCE.2023.332492170:1(4303-4310)Online publication date: Feb-2024
    • (2024)Data-Driven Recommendation Model Based on Meta-Learning for Non-Intrusive Load MonitoringIEEE Transactions on Consumer Electronics10.1109/TCE.2023.329508370:1(3562-3572)Online publication date: Feb-2024
    • (2024)Automated Load Identification and Consumption Prediction for Smart Energy Meters2024 International Conference on Smart Applications, Communications and Networking (SmartNets)10.1109/SmartNets61466.2024.10577681(1-7)Online publication date: 28-May-2024
    • (2024)CLED: Computer Lab Energy Dataset2024 IEEE International Symposium on Measurements & Networking (M&N)10.1109/MN60932.2024.10615410(1-6)Online publication date: 2-Jul-2024
    • (2024)Low-Frequency Load Identification Using CNN-BiLSTM Attention Mechanism2024 32nd Mediterranean Conference on Control and Automation (MED)10.1109/MED61351.2024.10566167(712-717)Online publication date: 11-Jun-2024
    • (2024)Non-Intrusive Load Monitoring-based Fuzzy Actor-Critic Reinforcement Learning Home Energy Management2024 IEEE 7th International Conference on Industrial Cyber-Physical Systems (ICPS)10.1109/ICPS59941.2024.10639994(1-6)Online publication date: 12-May-2024
    • Show More Cited By

    View Options

    Get Access

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Media

    Figures

    Other

    Tables

    Share

    Share

    Share this Publication link

    Share on social media