Article

SenseCam: a retrospective memory aid

Authors:

Lyndsay Williams,

James Srinivasan,

Narinder Kapur,

Ken WoodAuthors Info & Claims

UbiComp'06: Proceedings of the 8th international conference on Ubiquitous Computing

Pages 177 - 193

https://doi.org/10.1007/11853565_11

Published: 17 September 2006 Publication History

Abstract

This paper presents a novel ubiquitous computing device, the SenseCam, a sensor augmented wearable stills camera. SenseCam is designed to capture a digital record of the wearer's day, by recording a series of images and capturing a log of sensor data. We believe that reviewing this information will help the wearer recollect aspects of earlier experiences that have subsequently been forgotten, and thereby form a powerful retrospective memory aid. In this paper we review existing work on memory aids and conclude that there is scope for an improved device. We then report on the design of SenseCam in some detail for the first time. We explain the details of a first in-depth user study of this device, a 12-month clinical trial with a patient suffering from amnesia. The results of this initial evaluation are extremely promising; periodic review of images of events recorded by SenseCam results in significant recall of those events by the patient, which was previously impossible. We end the paper with a discussion of future work, including the application of SenseCam to a wider audience, such as those with neurodegenerative conditions such as Alzheimer's disease.

References

[1]

Bourgeois, M.S.: Enhancing conversation skills in patients with Alzheimer's disease using a prosthetic memory aid. Journal of Applied Behavior Analysis, 23 (1990), 29-32.

[2]

Brewer, W. F.: What is autobiographical memory? In D. Rubin (Ed.), Autobiographical Memory (pp. 25-49). Cambridge: Cambridge University Press, 1986.

[3]

Brewer, W. F.: Qualitative analysis of the recalls of randomly sampled autobiographical events. In M. M. Gruneberg, P. E. Morris, & R. N. Sykes (Eds.), Practical Aspects of Memory: Current Research and Issues (Vol. 1, pp. 263-268). Chichester: Wiley, 1988.

[4]

Cherry, S.: Total Recall, IEEE Spectrum, November 2005, pp. 25-30.

Digital Library

[5]

Conway, M.A.: Memory and the self. Journal of Memory and Language, 53: 594-628 (2005).

[6]

DejaView: CamWear, http://www.mydejaview.com/, March 2006.

[7]

Gemmell, Jim, Williams, Lyndsay, Wood, Ken, Bell, Gordon and Lueder, Roger: Passive Capture and Ensuing Issues for a Personal Lifetime Store, Proceedings of The First ACM Workshop on Continuous Archival and Retrieval of Personal Experiences (CARPE '04), Oct. 15, 2004, New York, NY, USA, pp. 48-55.

Digital Library

[8]

Greenberg, D.L. & Rubin, D.C: Cortex, 39, 687-728 (2003).

[9]

Healey, J. and Picard, R. StartleCam: A Cybernetic Wearable Camera. Proceedings of the International Symposium on Wearable Computing, Pittsburgh, Pennsylvania, 19-20 October 1998, pp. 42-49.

Digital Library

[10]

HP Laboratories, The Casual Capture Prototype, http://www.hpl.hp.com/news/2004/janmar/ casualcapture.html, March 2006.

[11]

Hoisko, J.: Context Triggered Visual Episodic Memory Prosthesis, Proceedings of the International Symposium on Wearable Computing, Washington, DC, October 2000, pp. 185.

Digital Library

[12]

Julesz, B.: Textons, the elements of texture perception, and their interactions. Nature, 290(5802):91-7, March 1981.

[13]

Kapur, N., Glisky, E.L. & Wilson, B.A.: External memory aids and computers in memory rehabilitation. In A.D. Baddeley, M.D. Kopelman & B.A. Wilson (Eds.), The Handbook of Memory Disorders, Second Edition (pp. 757-784). Chichester, UK: John Wiley, 2002.

[14]

Kime, S.K., Lamb, D.G. & Wilson, M.B.: Use of a comprehensive programme of external cueing to enhance procedural memory in a patient with dense amnesia. Brain Injury, 10, (1), 17-25 (1996).

[15]

Lamming, M., Brown, P., Carter, K., Eldridge, M., Flynn, M., Louie, G., Robinson, P., & Sellen, AJ. (1994). The design of a human memory prosthesis. Computer Journal, 37(3), 153-163.

[16]

Landauer, T.K. & Bjork, R.A.: Optimum rehearsal patterns and name learning. In M. M. Gruneberg, P. E. Morris, & R. N. Sykes (Eds.), Practical Aspects of Memory (pp. 625- 632). London: Academic Press, 1978.

[17]

Mann, S.: Wearcam (The Wearable Camera), Proceedings of the International Symposium on Wearable Computers, pages 124-131, 1998.

Digital Library

[18]

Minox: DD1 Camera, http://www.minox.com/, March 2006.

[19]

Ueoka, T., Kawamura, T., Baba, S., Yoshimura, S., Kono, Y. and Kidode, M.: Wearable Camera Device for Supporting Object-Triggered Memory Augmentation, The 3rd CREST/ISWC Workshop on Advanced Computing and Communicating Techniques for Wearable Information Playing, Arlington, VA, October 2004.

[20]

Wilson, B.A., Evans, J.J., Emslie, H. & Malinek, V.: Evaluation of NeuroPage: a new memory aid. Journal of Neurology, Neurosurgery and Psychiatry, 63, 113-115 (1997).

[21]

Wilson, B.A., Emslie, H.C., Quirk, K. & Evans, J.J.: Reducing everyday memory and planning problems by means of a paging system: a randomised control crossover study. Journal of Neurology, Neurosurgery and Psychiatry, 70, 477-482 (2001).

[22]

Woods, B.: Reducing the impact of cognitive impairment in dementia. In A.D. Baddeley, M.D. Kopelman & B.A. Wilson (Eds.), The Handbook of Memory Disorders, Second Edition (pp. 757-784). Chichester, UK: John Wiley, 2002.

Cited By

Kimura RNakajima T(2024)TinyHappy with Tiny Habits: A Platform for Reflecting Happy MomentsProceedings of the 27th International Academic Mindtrek Conference10.1145/3681716.3689449(281-285)Online publication date: 8-Oct-2024
https://dl.acm.org/doi/10.1145/3681716.3689449
Villa SWeiss YLu MZiarko MSchmidt ANiess J(2024)Envisioning Futures: How the Modality of AI Recommendations Impacts Conversation Flow in AR-enhanced DialogueProceedings of the 26th International Conference on Multimodal Interaction10.1145/3678957.3685731(182-193)Online publication date: 4-Nov-2024
https://dl.acm.org/doi/10.1145/3678957.3685731
Mamish JAlharbi RSen SHolla SKamath PSangar YAlshurafa NHester J(2024)NIR-sighted: A Programmable Streaming Architecture for Low-Energy Human-Centric Vision ApplicationsACM Transactions on Embedded Computing Systems10.1145/367207623:6(1-26)Online publication date: 11-Sep-2024
https://dl.acm.org/doi/10.1145/3672076
Show More Cited By

Recommendations

Encountering SenseCam: personal recording technologies in everyday life
UbiComp '09: Proceedings of the 11th international conference on Ubiquitous computing

In this paper, we present a study of responses to the idea of being recorded by a ubicomp recording technology called SenseCam. This study focused on real-life situations in two North American and two European locations. We present the findings of this ...
Experiencing SenseCam: a case study interview exploring seven years living with a wearable camera
SenseCam '13: Proceedings of the 4th International SenseCam & Pervasive Imaging Conference

This paper presents the findings from an interview with CG, an individual who has worn an automated camera, the SenseCam, every day for the past seven years. Of interest to the study were the participant's day-to-day experiences wearing the camera and ...
The use of the Sensecam to explore daily functioning of older adults with chronic pain
SenseCam '13: Proceedings of the 4th International SenseCam & Pervasive Imaging Conference

Chronic pain often interferes with daily living. This study aimed to explore day-to-day patterns of functioning and experiences of older adults living with chronic pain. Thirteen older adults (65+ years) living with chronic pain (pain lasting >3 months) ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Other conferences

UbiComp'06: Proceedings of the 8th international conference on Ubiquitous Computing

September 2006

526 pages

ISBN:9783540396345

Editors:
Paul Dourish
Donald Bren School of Information and Computer Sciences, University of California, Irvine, Irvine, CA
,
Adrian Friday
Computing Department, Lancaster University, InfoLab 2, South Drive, Lancaster, CA, UK

Sponsors

Google Inc.
Nokia
Microsoft: Microsoft
Intel: Intel
IBM: IBM

In-Cooperation

Publisher

Springer-Verlag

Berlin, Heidelberg

Publication History

Published: 17 September 2006

Check for updates

Qualifiers

Article

Acceptance Rates

UbiComp'06 Paper Acceptance Rate 30 of 204 submissions, 15%;

Overall Acceptance Rate 764 of 2,912 submissions, 26%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

211
Total Citations
View Citations
0
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 18 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Kimura RNakajima T(2024)TinyHappy with Tiny Habits: A Platform for Reflecting Happy MomentsProceedings of the 27th International Academic Mindtrek Conference10.1145/3681716.3689449(281-285)Online publication date: 8-Oct-2024
https://dl.acm.org/doi/10.1145/3681716.3689449
Villa SWeiss YLu MZiarko MSchmidt ANiess J(2024)Envisioning Futures: How the Modality of AI Recommendations Impacts Conversation Flow in AR-enhanced DialogueProceedings of the 26th International Conference on Multimodal Interaction10.1145/3678957.3685731(182-193)Online publication date: 4-Nov-2024
https://dl.acm.org/doi/10.1145/3678957.3685731
Mamish JAlharbi RSen SHolla SKamath PSangar YAlshurafa NHester J(2024)NIR-sighted: A Programmable Streaming Architecture for Low-Energy Human-Centric Vision ApplicationsACM Transactions on Embedded Computing Systems10.1145/367207623:6(1-26)Online publication date: 11-Sep-2024
https://dl.acm.org/doi/10.1145/3672076
Tran QNguyen BJones GGurrin CGurrin CKongkachandra RSchoeffmann KDang-Nguyen DRossetto LSatoh SZhou L(2024)MemoriLens: a Low-cost Lifelog Camera Using Raspberry Pi ZeroProceedings of the 2024 International Conference on Multimedia Retrieval10.1145/3652583.3657592(1255-1259)Online publication date: 30-May-2024
https://dl.acm.org/doi/10.1145/3652583.3657592
Aiordachioae AVatavu R(2024)Lifelogging in Mixed RealityExtended Abstracts of the CHI Conference on Human Factors in Computing Systems10.1145/3613905.3650897(1-8)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613905.3650897
Brombacher HDritsa DVos SHouben S(2024)"To Click or not to Click": Back to Basic for Experience Sampling for Office Well-being in Shared Office SpacesProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642295(1-18)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642295
Liu YRitchie JKratz SSra MSmith BMonroy-Hernández AVaish R(2023)Memento Player: Shared Multi-Perspective Playback of Volumetrically-Captured Moments in Augmented RealityExtended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544549.3585588(1-9)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544549.3585588
Hodges SKristensson PHester JKrüger AMankoff JOlivier PRogers Y(2023)Hardware is Hard—is it Worth it?Extended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544549.3583751(1-4)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544549.3583751
Catană AVatavu R(2023)Fingerhints: Understanding Users’ Perceptions of and Preferences for On-Finger Kinesthetic NotificationsProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3581022(1-17)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544548.3581022
Clinch SDavies N(2023)Hacking the Brain: The Risks and Challenges of Cognitive AugmentationHuman-Computer Interaction – INTERACT 202310.1007/978-3-031-42293-5_18(255-258)Online publication date: 28-Aug-2023
https://dl.acm.org/doi/10.1007/978-3-031-42293-5_18
Show More Cited By

View Options

View options

Media

Figures

Other

Tables

View Table of Contents