research-article

Mobile activity recognition for a whole day: recognizing real nursing activities with big dataset

Authors:

Yasunobu Nohara,

Naoki NakashimaAuthors Info & Claims

UbiComp '15: Proceedings of the 2015 ACM International Joint Conference on Pervasive and Ubiquitous Computing

Pages 1269 - 1280

https://doi.org/10.1145/2750858.2807533

Published: 07 September 2015 Publication History

Abstract

In this paper, we provide a real nursing data set for mobile activity recognition that can be used for supervised machine learning, and big data combined the patient medical records and sensors attempted for 2 years, and also propose a method for recognizing activities for a whole day utilizing prior knowledge about the activity segments in a day. Furthermore, we demonstrate data mining by applying our method to the bigger data with additional hospital data. In the proposed method, we 1) convert a set of segment timestamps into a prior probability of the activity segment by exploiting the concept of importance sampling, 2) obtain the likelihood of traditional recognition methods for each local time window within the segment range, and, 3) apply Bayesian estimation by marginalizing the conditional probability of estimating the activities for the segment samples. By evaluating with the dataset, the proposed method outperformed the traditional method without using the prior knowledge by 25.81% at maximum by balanced classification rate. Moreover, the proposed method significantly reduces duration errors of activity segments from 324.2 seconds of the traditional method to 74.6 seconds at maximum. We also demonstrate the data mining by applying our method to bigger data in a hospital.

References

[1]

Bao, L., and Intille, S. S. Pervasive Computing, vol. 3001 of Lecture Notes in Computer Science. Springer Berlin Heidelberg, Berlin, Heidelberg, 2004.

[2]

Chavarriaga, R., Sagha, H., Calatroni, A., Digumarti, S. T., Troster, G., Millan, J. D. R., and Roggen, D. The Opportunity challenge: A benchmark database for on-body sensor-based activity recognition. Pattern Recognition Letters 34 (2013), 2033--2042.

Digital Library

[3]

Chen, L., Hoey, J., Nugent, C. D., Cook, D. J., and Yu, Z. Sensor-based activity recognition, 2012.

[4]

Collobert, R., Weston, J., Bottou, L., Karlen, M., Kavukcuoglu, K., and Kuksa, P. Natural Language Processing (almost) from Scratch. Journal of Machine Learning Research 12 (2011), 2493--2537.

Digital Library

[5]

Damas, M., Rojas, I., Amft, O., Toth, A. M., Baños, O., Pomares, H., and Tóth, M. A. A benchmark dataset to evaluate sensor displacement in activity recognition. In Proceedings of the 2012 ACM Conference on Ubiquitous Computing - UbiComp '12 (2012), 1026.

Digital Library

[6]

Demuynck, K., and Laureys, T. A comparison of different approaches to automatic speech segmentation. In Text, Speech and Dialogue (2002), 277--284.

Digital Library

[7]

Dietterich, T. Machine learning for sequential data: A review. Structural, syntactic, and statistical pattern recognition (2002), 1--15.

Digital Library

[8]

Farringdon, J., Moore, A., Tilbury, N., Church, J., and Biemond, P. Wearable sensor badge and sensor jacket for context awareness. Digest of Papers. Third International Symposium on Wearable Computers (1999).

Digital Library

[9]

Fawcett, T. ROC Graphs: Notes and Practical Considerations for Researchers. ReCALL 31 (2004), 1--38.

[10]

Fawcett, T. An introduction to ROC analysis. Pattern Recognition Letters 27 (2006), 861--874.

Digital Library

[11]

Franco, A., and Destrebecqz, A. Chunking or not chunking? How do we find words in artificial language learning? Advances in Cognitive Psychology 8 (2012), 144--154.

[12]

Gooch, P., and Roudsari, A. Computerization of workflows, guidelines, and care pathways: a review of implementation challenges for process-oriented health information systems. Journal of the American Medical Informatics Association: JAMIA 18 (2011), 738--48.

[13]

Guyon, I., and Elisseeff, A. An introduction to variable and feature selection. Journal of Machine Learning Research 3 (2003), 1157--1182.

Digital Library

[14]

Hand, D., and Till, R. A simple generalisation of the area under the ROC curve for multiple class classification problems. Machine Learning (2001), 171--186.

Digital Library

[15]

Hattori, Y., Inoue, S., and Hirakawa, G. A Large Scale Gathering System for Activity Data with Mobile Sensors. 2011 15th Annual International Symposium on Wearable Computers (2011), 97--100.

Digital Library

[16]

He, H., and Garcia, E. A. Learning from imbalanced data. IEEE Transactions on Knowledge and Data Engineering 21 (2009), 1263--1284.

Digital Library

[17]

He, X. H. X., Zemel, R., and Carreira-Perpinan, M. Multiscale conditional random fields for image labeling. Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004. 2 (2004).

Digital Library

[18]

Hido, S., Kashima, H., and Takahashi, Y. Roughly balanced Bagging for Imbalanced data. Statistical Analysis and Data Mining 2 (2009), 412--426.

Digital Library

[19]

Kasteren, T. V., Noulas, A., Englebienne, G., and Kr, B. Accurate Activity Recognition in a Home Setting. In UbiComp '08 Proceedings of the 10th international conference on Ubiquitous computing (2008), 1--9.

Digital Library

[20]

Kawaguchi, N., Ogawa, N., and Iwasaki, Y. Hasc challenge: gathering large scale human activity corpus for the real-world activity understandings. In Proceedings of the 2nd Augmented Human International Conference (2011), 27.

Digital Library

[21]

Kelder, T., Conklin, B. R., Evelo, C. T., and Pico, A. R. Finding the right questions: Exploratory pathway analysis to enhance biological discovery in large datasets. PLoS Biology 8 (2010), 11--12.

[22]

Khoshgoftaar, T. M., Golawala, M., and Hulse, J. V. An Empirical Study of Learning from Imbalanced Data Using Random Forest. 19th IEEE International Conference on Tools with Artificial Intelligence(ICTAI 2007) (Oct. 2007), 310--317.

Digital Library

[23]

Khoshgoftaar, T. M., Van Hulse, J., and Napolitano, A. Comparing boosting and bagging techniques with noisy and imbalanced data. IEEE Transactions on Systems, Man, and Cybernetics Part A: Systems and Humans 41 (2011), 552--568.

Digital Library

[24]

Kim, E., Helal, S., and Cook, D. Human Activity Recognition and Pattern Discovery. Pervasive Computing, IEEE 9 (2010), 48--53.

Digital Library

[25]

Klinger, R. Classical Probabilistic Models and Conditional Random Fields. Entropy 51 (2007), 282--289.

[26]

Kwapisz, J. R., Weiss, G. M., and Moore, S. A. Activity Recognition using Cell Phone Accelerometers. Human Factors 12 (2010), 74--82.

Digital Library

[27]

Lafferty, J., McCallum, A., and Pereira, F. C. N. Conditional random fields: Probabilistic models for segmenting and labeling sequence data. ICML '01 Proceedings of the Eighteenth International Conference on Machine Learning (2001), 282--289.

Digital Library

[28]

Lane, N. D., Miluzzo, E., Lu, H., Peebles, D., Choudhury, T., and Campbell, A. T. A survey of mobile phone sensing. IEEE Communications Magazine 48 (2010), 140--150.

Digital Library

[29]

Lemmens, L., Van Zelm, R., Vanhaecht, K., and Kerkkamp, H. Systematic review: Indicators to evaluate effectiveness of clinical pathways for gastrointestinal surgery, 2008.

[30]

Lymberopoulos, D., Bamis, A., and Savvides, A. Extracting spatiotemporal human activity patterns in assisted living using a home sensor network, 2011.

[31]

Mannini, A., and Sabatini, A. M. Machine learning methods for classifying human physical activity from on-body accelerometers. Sensors 10 (2010), 1154--1175.

[32]

McQueen, J. M. Segmentation of continuous speech using phonotactics. Journal of Memory and Language 39 (1998), 21--46.

[33]

Mohri, M., Moreno, P., and Weinstein, E. Discriminative Topic Segmentation of Text and Speech. Artificial Intelligence 9 (2010), 533--540.

[34]

Naya, F., Ohmura, R., Takayanagi, F., Noma, H., and Kogure, K. Workers' Routine Activity Recognition using Body Movements and Location Information. 2006 10th IEEE International Symposium on Wearable Computers (2006), 105--108.

[35]

Nohara, Y., Sozo, I., Nakashima, N., Naonori, U., and Kitsuregawa, M. Large-scale Sensor Dataset in a Hospital. In International Workshop on Pattern Recognition for Healthcare Analytics (Tsukuba, Japan, 2012), 4 pages.

[36]

Osmani, V., Balasubramaniam, S., and Botvich, D. Human activity recognition in pervasive health-care: Supporting efficient remote collaboration. Journal of Network and Computer Applications 31, 4 (Nov. 2008), 628--655.

Digital Library

[37]

Panella, M., Marchisio, S., and Di Stanislao, F. Reducing clinical variations with clinical pathways: Do pathways work? International Journal for Quality in Health Care 15 (2003), 509--521.

[38]

Roggen, D., Calatroni, A., Rossi, M., Holleczek, T., Forster, K., Troster, G., Lukowicz, P., Bannach, D., Pirkl, G., Ferscha, A., Doppler, J., Holzmann, C., Kurz, M., Holl, G., Chavarriaga, R., Sagha, H., Bayati, H., Creatura, M., and Millan, J. d. R. Collecting complex activity datasets in highly rich networked sensor environments. Networked Sensing Systems (INSS), 2010 Seventh International Conference on (2010).

[39]

Roggen, D., Troster, G., Lukowicz, P., Ferscha, a., Millan, J. D. R., and Chavarriaga, R. Opportunistic human activity and context recognition. Computer 46 (2013), 36--45.

Digital Library

[40]

Rotter, T., Kinsman, L., James, E., Machotta, A., Gothe, H., Willis, J., Snow, P., and Kugler, J. Clinical pathways: effects on professional practice, patient outcomes, length of stay and hospital costs. The Cochrane database of systematic reviews (2010), CD006632.

[41]

Saraiya, P., North, C., and Duca, K. Visualizing biological pathways: requirements analysis, systems evaluation and research agenda. Information Visualization 4 (2005), 191--205.

Digital Library

[42]

Sun, X., Kashima, H., Tomioka, R., and Ueda, N. Large scale real-life action recognition using conditional random fields with stochastic training. Advances in Knowledge ... (2011), 222--233.

Digital Library

[43]

Tang, K., Wang, R., and Chen, T. Towards Maximizing the Area Under the ROC Curve for Multi-Class Classification Problems. AAAI, Elkan 2001 (2011), 483--488.

[44]

Tapia, E. M., Intille, S. S., Haskell, W., Larson, K., Wright, J., King, A., and Friedman, R. Real-time recognition of physical activities and their intensities using wireless accelerometers and a heart rate monitor. In Proceedings - International Symposium on Wearable Computers, ISWC (2007), 37--40.

Digital Library

[45]

Tentori, M., and Favela, J. Monitoring behavioral patterns in hospitals through activity-aware computing. In 2008 Second International Conference on Pervasive Computing Technologies for Healthcare, IEEE (Jan. 2008), 173--176.

[46]

Vail, D., Veloso, M., and Lafferty, J. Conditional random fields for activity recognition. In Proceedings of the 6th international joint conference on Autonomous agents and multiagent systems, vol. 5 (2007), 1--8.

Digital Library

[47]

Vail, D. L., Lafferty, J. D., and Veloso, M. M. Feature selection in conditional random fields for activity recognition. In 2007 IEEE/RSJ International Conference on Intelligent Robots and Systems (2007), 3379--3384.

[48]

Vinh, L. T., Lee, S., Le, H. X., Ngo, H. Q., Kim, H. I., Han, M., and Lee, Y. K. Semi-Markov conditional random fields for accelerometer-based activity recognition. Applied Intelligence 35 (2011), 226--241.

Digital Library

[49]

Wang, D., Lu, L., and Zhang, H.-J. Speech segmentation without speech recognition. In IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP '03)., vol. 1 (2003), 468--471.

[50]

Ward, J. A., Lukowicz, P., Tröster, G., and Starner, T. E. Activity recognition of assembly tasks using body-worn microphones and accelerometers. IEEE Transactions on Pattern Analysis and Machine Intelligence 28 (2006), 1553--1566.

Digital Library

[51]

Zhan, K., Faux, S., and Ramos, F. Multi-scale Conditional Random Fields for first-person activity recognition. Pervasive Computing and ... (2014).

[52]

Zhang, M., and Sawchuk, A. Motion primitive-based human activity recognition using a bag-of-features approach. Proceedings of the 2nd ACM SIGHIT ..., 1 (2012), 631.

Digital Library

[53]

Zhang, M., and Sawchuk, A. A. A feature selection-based framework for human activity recognition using wearable multimodal sensors. In Int. Conf. Body Area Networks (2011), 92--98.

Digital Library

Cited By

Dewan AGunturi VNaik V(2023)Deep Learning Models for NEAT Activity Detection on Smartwatch2023 IEEE Smart World Congress (SWC)10.1109/SWC57546.2023.10449263(1-6)Online publication date: 28-Aug-2023
https://doi.org/10.1109/SWC57546.2023.10449263
Lv XYu CJin HZhang R(2022)Cost Efficient Sensor Positions Determination For Human Activity RecognitionIEEE Transactions on Sustainable Computing10.1109/TSUSC.2021.31014947:1(125-134)Online publication date: 1-Jan-2022
https://doi.org/10.1109/TSUSC.2021.3101494
Frank AKubota ARiek L(2022)Wearable activity recognition for robust human-robot teaming in safety-critical environments via hybrid neural networks2019 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS)10.1109/IROS40897.2019.8968615(449-454)Online publication date: 28-Dec-2022
https://dl.acm.org/doi/10.1109/IROS40897.2019.8968615
Show More Cited By

Index Terms

Mobile activity recognition for a whole day: recognizing real nursing activities with big dataset
1. Hardware
  1. Communication hardware, interfaces and storage
    1. Signal processing systems

Recommendations

Nurse care activity recognition challenge: summary and results
UbiComp/ISWC '19 Adjunct: Adjunct Proceedings of the 2019 ACM International Joint Conference on Pervasive and Ubiquitous Computing and Proceedings of the 2019 ACM International Symposium on Wearable Computers

Although activity recognition has been studied for a long time now, research and applications have focused on physical activity recognition. Even if many application domains require the recognition of more complex activities, research on such activities ...
A Mobile App for Nursing Activity Recognition
UbiComp '18: Proceedings of the 2018 ACM International Joint Conference and 2018 International Symposium on Pervasive and Ubiquitous Computing and Wearable Computers

We propose FonLog: a mobile app that can be used for a data collection tool in human activity recognition for nursing services. The app has essential features to collect activity data efficiently found by the feedbacks from nursing facilities from the ...
Activity Recognition and Future Prediction in Hospitals
MOBIQUITOUS 2016: Adjunct Proceedings of the 13th International Conference on Mobile and Ubiquitous Systems: Computing Networking and Services

In this paper, we firstly introduce our work [9] where we proposed for recognizing whole day activities using prior knowledge, and applied the method for real nursing sensor dataset we have collected. Then, we introduce the method for predicting the ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

UbiComp '15: Proceedings of the 2015 ACM International Joint Conference on Pervasive and Ubiquitous Computing

September 2015

1302 pages

ISBN:9781450335744

DOI:10.1145/2750858

General Chairs:
Kenji Mase
Nagoya University, JP
,
Marc Langheinrich
Università della Svizzera italiana (USI), CH
,
Daniel Gatica-Perez
IDIAP-EPFL, CH
,
Program Chairs:
Hans Gellersen
Lancaster University, UK
,
Tanzeem Choudhury
Cornell University
,
Koji Yatani
Univerisity of Tokyo, JP

Copyright © 2015 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Yahoo! Japan: Yahoo! Japan
SIGMOBILE: ACM Special Interest Group on Mobility of Systems, Users, Data and Computing
FX Palo Alto Laboratory, Inc.: FX Palo Alto Laboratory, Inc.
Google Inc.
ACM: Association for Computing Machinery
Rakuten Institute of Technology: Rakuten Institute of Technology
Microsoft: Microsoft
Bell Labs: Bell Laboratories
SIGCHI: ACM Special Interest Group on Computer-Human Interaction
KDDI
Panasonic: Panasonic Corporation
NTT DoCoMo
Telefónica: Telefónica
ISTC-PC: Intel Science and Technology Center for Pervasive Computing

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 07 September 2015

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

Japan Society for the Promotion of Science

Conference

UbiComp '15

Sponsor:

Yahoo! Japan
SIGMOBILE
FX Palo Alto Laboratory, Inc.
ACM
Rakuten Institute of Technology
Microsoft
Bell Labs
SIGCHI
Panasonic
Telefónica
ISTC-PC

UbiComp '15: The 2015 ACM International Joint Conference on Pervasive and Ubiquitous Computing

September 7 - 11, 2015

Osaka, Japan

Acceptance Rates

UbiComp '15 Paper Acceptance Rate 101 of 394 submissions, 26%;

Overall Acceptance Rate 764 of 2,912 submissions, 26%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

41
Total Citations
View Citations
898
Total Downloads

Downloads (Last 12 months)20
Downloads (Last 6 weeks)1

Reflects downloads up to 19 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Dewan AGunturi VNaik V(2023)Deep Learning Models for NEAT Activity Detection on Smartwatch2023 IEEE Smart World Congress (SWC)10.1109/SWC57546.2023.10449263(1-6)Online publication date: 28-Aug-2023
https://doi.org/10.1109/SWC57546.2023.10449263
Lv XYu CJin HZhang R(2022)Cost Efficient Sensor Positions Determination For Human Activity RecognitionIEEE Transactions on Sustainable Computing10.1109/TSUSC.2021.31014947:1(125-134)Online publication date: 1-Jan-2022
https://doi.org/10.1109/TSUSC.2021.3101494
Frank AKubota ARiek L(2022)Wearable activity recognition for robust human-robot teaming in safety-critical environments via hybrid neural networks2019 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS)10.1109/IROS40897.2019.8968615(449-454)Online publication date: 28-Dec-2022
https://dl.acm.org/doi/10.1109/IROS40897.2019.8968615
Fujinami KNaganuma TShinoda YYamazaki KKoike S(2022)Attempts Toward Behavior Recognition of the Asian Black Bears Using an AccelerometerSensor- and Video-Based Activity and Behavior Computing10.1007/978-981-19-0361-8_4(57-79)Online publication date: 4-May-2022
https://doi.org/10.1007/978-981-19-0361-8_4
Adachi KLago PHattori YInoue S(2022)Using LUPI to Improve Complex Activity RecognitionSensor- and Video-Based Activity and Behavior Computing10.1007/978-981-19-0361-8_3(39-55)Online publication date: 4-May-2022
https://doi.org/10.1007/978-981-19-0361-8_3
Mäkela SLämsä AKeränen JLiikka JRonkainen JPeltola JHäikiö JJärvinen SBordallo López M(2021)Introducing VTT-ConIot: A Realistic Dataset for Activity Recognition of Construction Workers Using IMU DevicesSustainability10.3390/su1401022014:1(220)Online publication date: 26-Dec-2021
https://doi.org/10.3390/su14010220
Alia SAdachi KHossain TLe NKaneko HLago POkita TInoue S(2021)Summary of the Third Nurse Care Activity Recognition Challenge - Can We Do from the Field Data?Adjunct Proceedings of the 2021 ACM International Joint Conference on Pervasive and Ubiquitous Computing and Proceedings of the 2021 ACM International Symposium on Wearable Computers10.1145/3460418.3479391(428-433)Online publication date: 21-Sep-2021
https://dl.acm.org/doi/10.1145/3460418.3479391
Kaneko HHossain TInoue S(2021)Analysis of Feature Importances for Automatic Generation of Care RecordsAdjunct Proceedings of the 2021 ACM International Joint Conference on Pervasive and Ubiquitous Computing and Proceedings of the 2021 ACM International Symposium on Wearable Computers10.1145/3460418.3479354(316-321)Online publication date: 21-Sep-2021
https://dl.acm.org/doi/10.1145/3460418.3479354
Dewan AGunturi VNaik VDutta K(2021)NEAT Activity Detection using Smartwatch at Low Sampling Frequency2021 IEEE SmartWorld, Ubiquitous Intelligence & Computing, Advanced & Trusted Computing, Scalable Computing & Communications, Internet of People and Smart City Innovation (SmartWorld/SCALCOM/UIC/ATC/IOP/SCI)10.1109/SWC50871.2021.00014(25-32)Online publication date: Oct-2021
https://doi.org/10.1109/SWC50871.2021.00014
Zhao BLi SGao YLi CLi W(2020)A Framework of Combining Short-Term Spatial/Frequency Feature Extraction and Long-Term IndRNN for Activity RecognitionSensors10.3390/s2023698420:23(6984)Online publication date: 7-Dec-2020
https://doi.org/10.3390/s20236984
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents