research-article

Towards User Activity Recognition Through Energy Usage Analysis And Complex Event Processing

Authors:

Sylvain Hallé,

Sébastien Gaboury,

Bruno BouchardAuthors Info & Claims

PETRA '16: Proceedings of the 9th ACM International Conference on PErvasive Technologies Related to Assistive Environments

Article No.: 3, Pages 1 - 8

https://doi.org/10.1145/2910674.2910707

Published: 29 June 2016 Publication History

Abstract

One of the key challenges related to the field of Ambient Assisted Living (AAL) is the recognition of the user's activities of daily living. Most existing approaches rely on distributed sensors, such as cameras, RFID and motion sensors. These approaches suffer from high intrusiveness for the resident, coupled with an important amount of hardware that requires maintenance. In this paper, we explore a new, low-cost and efficient solution for fine-grained activity recognition using energy consumption as input. Existing works exploiting energy sensors see the problem from an energy saving and costs reducing point of view; the originality of our work is to characterize a user's actions and activities by decomposing the total power load into a sum of loads for individual appliances. This is done using only the data from a single energy sensor located at the main electrical panel. These contributions have been implemented and tested in real live smart home prototype, using a Complex Event Processing (CEP) engine.

References

[1]

AAL-WELL, ambient assistive living technologies for wellness, engagement and long life, 2013. http://www.aal-well.org/index.html.

[2]

D. J. Abadi, Y. Ahmad, M. Balazinska, U. Çetintemel, M. Cherniack, J.-H. Hwang, W. Lindner, A. Maskey, A. Rasin, E. Ryvkina, N. Tatbul, Y. Xing, and S. B. Zdonik. The design of the borealis stream processing engine. In CIDR, pages 277--289, 2005.

[3]

A. Arasu, B. Babcock, S. Babu, J. Cieslewicz, M. Datar, K. Ito, R. Motwani, U. Srivastava, and J. Widom. Stream: The stanford data stream management system. Technical Report 2004-20, Stanford InfoLab, 2004.

[4]

C. Belley, S. Gaboury, B. Bouchard, and A. Bouzouane. Activity recognition in smart homes based on electrical devices identification. In F. Makedon, M. Betke, M. S. El-Nasr, and I. Maglogiannis, editors, The 6th International Conference on PErvasive Technologies Related to Assistive Environments, PETRA '13, Island of Rhodes, Greece, May 29-31, 2013, pages 7:1--7:8. ACM, 2013.

Digital Library

[5]

C. Belley, S. Gaboury, B. Bouchard, and A. Bouzouane. An efficient and inexpensive method for activity recognition within a smart home based on load signatures of appliances. Pervasive and Mobile Computing, 12:58--78, 2014.

[6]

S. Blackman, C. Matlo, C. Bobrovitskiy, A. Waldoch, M. L. Fang, P. Jackson, A. Mihailidis, L. Nygård, A. Astell, and A. Sixsmith. Ambient assisted living technologies for aging well: A scoping review. J. Intelligent Systems, 25(1):55--69, 2016.

[7]

L. Brenna, J. Gehrke, M. Hong, and D. Johansen. Distributed event stream processing with non-deterministic finite automata. In A. S. Gokhale and D. C. Schmidt, editors, DEBS. ACM, 2009.

Digital Library

[8]

S. Chandrasekaran, O. Cooper, A. Deshpande, M. J. Franklin, J. M. Hellerstein, W. Hong, S. Krishnamurthy, S. Madden, V. Raman, F. Reiss, and M. A. Shah. TelegraphCQ: Continuous dataflow processing for an uncertain world. In CIDR, 2003.

[9]

C. Chen and D. J. Cook. Novelty detection in human behavior through analysis of energy utilization, pages 65--85. IGI Global, 2013.

[10]

C. Chen, D. J. Cook, and A. S. Crandall. The user side of sustainability: Modeling behavior and energy usage in the home. Pervasive and Mobile Computing, 9(1):161--175, 2013.

Digital Library

[11]

Y. Chu, Y. C. Song, R. Levinson, and H. A. Kautz. Interactive activity recognition and prompting to assist people with cognitive disabilities. JAISE, 4(5):443--459, 2012.

Digital Library

[12]

D. J. Cook, M. Schmitter-Edgecombe, and P. Dawadi. Analyzing activity behavior and movement in a naturalistic environment using smart home techniques. IEEE J. Biomedical and Health Informatics, 19(6):1882--1892, 2015.

[13]

P. Cottone, S. Gaglio, G. L. Re, and M. Ortolani. User activity recognition for energy saving in smart homes. Pervasive and Mobile Computing, 16:156--170, 2015.

Digital Library

[14]

L. Fiore, D. Fehr, R. Bodor, A. Drenner, G. Somasundaram, and N. Papanikolopoulos. Multi-camera human activity monitoring. Journal of Intelligent and Robotic Systems, 52(1):5--43, 2008.

Digital Library

[15]

D. Fortin-Simard, J.-S. Bilodeau, K. Bouchard, S. Gaboury, B. Bouchard, and A. Bouzouane. Exploiting passive RFID technology for activity recognition in smart homes. IEEE Intelligent Systems, 30(4):7--15, 2015.

Digital Library

[16]

N. Halbwachs, F. Lagnier, and C. Ratel. Programming and verifying real-time systems by means of the synchronous data-flow language LUSTRE. IEEE Trans. Software Eng., 18(9):785--793, 1992.

Digital Library

[17]

S. Hallé, S. Gaboury, and B. Bouchard. Activity recognition through complex event processing: First findings. In AAAI Workshop on artificial intelligence applied to assistive technologies and smart environments (ATSE-16). Association for the Advancement of Artificial Intelligence, 2016. To appear.

[18]

S. Hallé. A declarative language interpreter for CEP. In W. Mayer, S. Hallé, and G. Grossmann, editors, 19th IEEE International Enterprise Distributed Object Computing Conference, EDOC 2015, Adelaide, Australia, September 22-24, 2015, pages 1--4. IEEE Computer Society, 2015.

Digital Library

[19]

S. Hallé and S. Varvaressos. A formalization of complex event stream processing. In M. Reichert, S. Rinderle-Ma, and G. Grossmann, editors, 18th IEEE International Enterprise Distributed Object Computing Conference, EDOC 2014, Ulm, Germany, September 1-5, 2014, pages 2--11. IEEE Computer Society, 2014.

Digital Library

[20]

D. C. Luckham. The power of events -- An introduction to complex event processing in distributed enterprise systems. ACM, 2005.

Digital Library

[21]

A. Mihailidis, J. Boger, M. Canido, and J. Hoey. The use of an intelligent prompting system for people with dementia. Interactions, 14(4):34--37, 2007.

Digital Library

[22]

E. F. Moore. Gedanken-experiments on sequential machines. Automata Studies, Annals of Mathematical Studies, 34:129--153, 1956.

[23]

M. T. Moutacalli, A. Bouzouane, and B. Bouchard. The behavioral profiling based on times series forecasting for smart homes assistance. J. Ambient Intelligence and Humanized Computing, 6(5):647--659, 2015.

[24]

C. A. Ong and B. T. Lau. Human activity recognition: a review. In 2014 IEEE International Conference on Control System, Computing and Engineering, ICCSCE 2014, Penang, Malaysia, November 28-30, 2014, pages 389--393. IEEE, 2014.

[25]

S. Rahimi, A. Chan, and R. Goubran. Usage monitoring of electrical devices in a smart home. In Proc. of the 33rd Annual Conference of the EBMS, pages 5307--5310. IEEE, 2011.

[26]

P. Roy, B. Bouchard, A. Bouzouane, and S. Giroux. Ambient activity recognition in smart environments for cognitive assistance. IJRAT, 1(1):29--56, 2013.

[27]

G. Singla, D. J. Cook, and M. Schmitter-Edgecombe. Recognizing independent and joint activities among multiple residents in smart environments. J. Ambient Intelligence and Humanized Computing, 1(1):57--63, 2010.

[28]

S. Suhothayan, K. Gajasinghe, I. Loku Narangoda, S. Chaturanga, S. Perera, and V. Nanayakkara. Siddhi: A second look at complex event processing architectures. In Proceedings of the 2011 ACM Workshop on Gateway Computing Environments, GCE '11, pages 43--50, New York, NY, USA, 2011. ACM.

Digital Library

[29]

E. Wu, Y. Diao, and S. Rizvi. High-performance complex event processing over streams. In S. Chaudhuri, V. Hristidis, and N. Polyzotis, editors, SIGMOD Conference, pages 407--418. ACM, 2006.

Digital Library

[30]

M. Zeifman and K. Roth. Nonintrusive appliance load monitoring: Review and outlook. IEEE Trans. Consumer Electronics, 57(1):76--84, 2011.

Digital Library

Cited By

Son HLee CFakhrHosseini SLee SCoughlin JRudnik J(2022)Reshaping the Smart Home Research and Development in the Pandemic Era: Considerations around Scalable and Easy-to-Install DesignProceedings of the ACM on Human-Computer Interaction10.1145/35129616:CSCW1(1-28)Online publication date: 7-Apr-2022
https://dl.acm.org/doi/10.1145/3512961
Burgess EReddy MMohr D(2022)"I Just Can't Help But Smile Sometimes": Collaborative Self-Management of DepressionProceedings of the ACM on Human-Computer Interaction10.1145/35129176:CSCW1(1-32)Online publication date: 7-Apr-2022
https://dl.acm.org/doi/10.1145/3512917
Huang XVitak J(2022)"Finsta gets all my bad pictures": Instagram Users' Self-Presentation Across Finsta and Rinsta AccountsProceedings of the ACM on Human-Computer Interaction10.1145/35129166:CSCW1(1-25)Online publication date: 7-Apr-2022
https://dl.acm.org/doi/10.1145/3512916
Show More Cited By

Recommendations

Activity recognition with hand-worn magnetic sensors

Activity recognition is a key technology for realizing ambient assisted living applications such as care of the elderly and home automation. This paper proposes a new activity recognition method that employs hand-worn magnetic sensors to recognize a ...
Annotating smart environment sensor data for activity learning
Smart Environments: Technology to Support Healthcare

The pervasive sensing technologies found in smart homes offer unprecedented opportunities for providing health monitoring and assistance to individuals experiencing difficulties living independently at home. In order to monitor the functional health of ...
Bootstrapping activity modeling for ambient assisted living
ICSH'13: Proceedings of the 2013 international conference on Smart Health

In many societies, the age profile of the population is increasing, posing many challenges for societies, health services and carers. One response to this unfolding situation has been to direct research effort towards Ambient Assisted Living (AAL), ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Other conferences

PETRA '16: Proceedings of the 9th ACM International Conference on PErvasive Technologies Related to Assistive Environments

June 2016

455 pages

ISBN:9781450343374

DOI:10.1145/2910674

Copyright © 2016 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 29 June 2016

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed limited

Conference

PETRA '16

PETRA '16: 9th ACM International Conference on PErvasive Technologies Related to Assistive Environments

June 29 - July 1, 2016

Island, Corfu, Greece

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

10
Total Citations
View Citations
116
Total Downloads

Downloads (Last 12 months)2
Downloads (Last 6 weeks)0

Reflects downloads up to 13 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

Son HLee CFakhrHosseini SLee SCoughlin JRudnik J(2022)Reshaping the Smart Home Research and Development in the Pandemic Era: Considerations around Scalable and Easy-to-Install DesignProceedings of the ACM on Human-Computer Interaction10.1145/35129616:CSCW1(1-28)Online publication date: 7-Apr-2022
https://dl.acm.org/doi/10.1145/3512961
Burgess EReddy MMohr D(2022)"I Just Can't Help But Smile Sometimes": Collaborative Self-Management of DepressionProceedings of the ACM on Human-Computer Interaction10.1145/35129176:CSCW1(1-32)Online publication date: 7-Apr-2022
https://dl.acm.org/doi/10.1145/3512917
Huang XVitak J(2022)"Finsta gets all my bad pictures": Instagram Users' Self-Presentation Across Finsta and Rinsta AccountsProceedings of the ACM on Human-Computer Interaction10.1145/35129166:CSCW1(1-25)Online publication date: 7-Apr-2022
https://dl.acm.org/doi/10.1145/3512916
Dagan ECárdenas Gasca ARobinson ANoriega ATham YVaish RMonroy-Hernández A(2022)Project IRL: Playful Co-Located Interactions with Mobile Augmented RealityProceedings of the ACM on Human-Computer Interaction10.1145/35129096:CSCW1(1-27)Online publication date: 7-Apr-2022
https://dl.acm.org/doi/10.1145/3512909
Maitre JHallé SBouchard KGaboury SBujari AManzoni PForster AMota EGaggi O(2019)Electric Device Recognition and Recommendation in Real-Time Based on Complex Event Processing for Smart HomesProceedings of the 5th EAI International Conference on Smart Objects and Technologies for Social Good10.1145/3342428.3343033(43-48)Online publication date: 25-Sep-2019
https://dl.acm.org/doi/10.1145/3342428.3343033
Kamel EMemari A(2019)State-of-the-Art Review of Energy Smart HomesJournal of Architectural Engineering10.1061/(ASCE)AE.1943-5568.000033725:1Online publication date: Mar-2019
https://doi.org/10.1061/(ASCE)AE.1943-5568.0000337
Hao JBouzouane AGaboury S(2017)Complex behavioral pattern mining in non-intrusive sensor-based smart homes using an intelligent activity inference engineJournal of Reliable Intelligent Environments10.1007/s40860-017-0041-23:2(99-116)Online publication date: 29-May-2017
https://doi.org/10.1007/s40860-017-0041-2
Hao JBouzouane ABouchard BGaboury S(2017)Activity inference engine for real-time cognitive assistance in smart environmentsJournal of Ambient Intelligence and Humanized Computing10.1007/s12652-017-0467-79:3(679-698)Online publication date: 17-Mar-2017
https://doi.org/10.1007/s12652-017-0467-7
Halle SGaboury SKhoury R(2016)A glue language for event stream processing2016 IEEE International Conference on Big Data (Big Data)10.1109/BigData.2016.7840873(2384-2391)Online publication date: Dec-2016
https://doi.org/10.1109/BigData.2016.7840873
Hallé S(2016)When RV Meets CEPRuntime Verification10.1007/978-3-319-46982-9_6(68-91)Online publication date: 20-Sep-2016
https://doi.org/10.1007/978-3-319-46982-9_6

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten