research-article

Accessing Passersby Proxemic Signals through a Head-Worn Camera: Opportunities and Limitations for the Blind

Authors:

Chieko Asakawa,

Hernisa KacorriAuthors Info & Claims

ASSETS '21: Proceedings of the 23rd International ACM SIGACCESS Conference on Computers and Accessibility

Article No.: 8, Pages 1 - 15

https://doi.org/10.1145/3441852.3471232

Published: 17 October 2021 Publication History

Abstract

The spatial behavior of passersby can be critical to blind individuals to initiate interactions, preserve personal space, or practice social distancing during a pandemic. Among other use cases, wearable cameras employing computer vision can be used to extract proxemic signals of others and thus increase access to the spatial behavior of passersby for blind people. Analyzing data collected in a study with blind (N=10) and sighted (N=40) participants, we explore: (i) visual information on approaching passersby captured by a head-worn camera; (ii) pedestrian detection algorithms for extracting proxemic signals such as passerby presence, relative position, distance, and head pose; and (iii) opportunities and limitations of using wearable cameras for helping blind people access proxemics related to nearby people. Our observations and findings provide insights into dyadic behaviors for assistive pedestrian detection and lead to implications for the design of future head-worn cameras and interactions.

Supplementary Material

VTT File (TP9752.vtt)

Download
12.10 KB

MP4 File (9752-file3.mp4)

Supplemental materials

Download
17.19 MB

MP4 File (TP9752.mp4)

Video presentation

Download
17.19 MB

References

[1]

OrCam MyEye 2. 2021. Help people who are blind or partially sighted. https://www.orcam.com/en/

[2]

University of Maryland A. James Clark School of Engineering. 2020. Sci-Fi Social Distancing?https://eng.umd.edu/news/story/scifi-social-distancing?utm_source=Publicate&utm_medium=email&utm_content=sci-fi-social-distancing&utm_campaign=200911+-+EMAIL

[3]

Amandine Afonso, Alan Blum, Christian Jacquemin, Michel Denis, and Brian FG Katz. 2005. A study of spatial cognition in an immersive virtual audio environment: Comparing blind and blindfolded individuals. Georgia Institute of Technology.

[4]

R. Agarwal, N. Ladha, M. Agarwal, K. K. Majee, A. Das, S. Kumar, S. K. Rai, A. K. Singh, S. Nayak, S. Dey, R. Dey, and H. N. Saha. 2017. Low cost ultrasonic smart glasses for blind. In 2017 8th IEEE Annual Information Technology, Electronics and Mobile Communication Conference (IEMCON). 210–213.

[5]

Subeida Ahmed, Harshadha Balasubramanian, Simone Stumpf, Cecily Morrison, Abigail Sellen, and Martin Grayson. 2020. Investigating the Intelligibility of a Computer Vision System for Blind Users. In Proceedings of the 25th International Conference on Intelligent User Interfaces (Cagliari, Italy) (IUI ’20). Association for Computing Machinery, New York, NY, USA, 419–429. https://doi.org/10.1145/3377325.3377508

Digital Library

[6]

Tousif Ahmed, Roberto Hoyle, Kay Connelly, David Crandall, and Apu Kapadia. 2015. Privacy concerns and behaviors of people with visual impairments. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems. 3523–3532.

Digital Library

[7]

Tousif Ahmed, Apu Kapadia, Venkatesh Potluri, and Manohar Swaminathan. 2018. Up to a Limit? Privacy Concerns of Bystanders and Their Willingness to Share Additional Information with Visually Impaired Users of Assistive Technologies. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 2, 3 (2018), 1–27.

Digital Library

[8]

Tousif Ahmed, Patrick Shaffer, Kay Connelly, David Crandall, and Apu Kapadia. 2016. Addressing physical safety, security, and privacy for people with visual impairments. In Twelfth Symposium on Usable Privacy and Security ({SOUPS} 2016). 341–354.

[9]

Dragan Ahmetovic, Daisuke Sato, Uran Oh, Tatsuya Ishihara, Kris Kitani, and Chieko Asakawa. 2020. Recog: Supporting blind people in recognizing personal objects. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems. 1–12.

Digital Library

[10]

Aira. 2020. Aira Ends Support for Horizon. https://aira.io/march-aira-update

[11]

Aira. 2021. Connecting you to real people instantly to simplify daily life. https://aira.io/

[12]

Taslima Akter, Tousif Ahmed, Apu Kapadia, and Swami Manohar Swaminathan. 2020. Privacy Considerations of the Visually Impaired with Camera Based Assistive Technologies: Misrepresentation, Impropriety, and Fairness. In The 22nd International ACM SIGACCESS Conference on Computers and Accessibility. 1–14.

Digital Library

[13]

Taslima Akter, Bryan Dosono, Tousif Ahmed, Apu Kapadia, and Bryan Semaan. 2020. ”I am uncomfortable sharing what I can’t see”: Privacy Concerns of the Visually Impaired with Camera Based Assistive Applications. In 29th {USENIX} Security Symposium ({USENIX} Security 20).

[14]

Gary L Albrecht, Vivian G Walker, and Judith A Levy. 1982. Social distance from the stigmatized: A test of two theories. Social Science & Medicine 16, 14 (1982), 1319–1327.

[15]

Shiri Azenkot, Richard E Ladner, and Jacob O Wobbrock. 2011. Smartphone haptic feedback for nonvisual wayfinding. In The proceedings of the 13th international ACM SIGACCESS conference on Computers and accessibility. 281–282.

Digital Library

[16]

Jan Balata, Zdenek Mikovec, and Lukas Neoproud. 2015. Blindcamera: Central and golden-ratio composition for blind photographers. In Proceedings of the Mulitimedia, Interaction, Design and Innnovation. 1–8.

Digital Library

[17]

Jeffrey P Bigham, Chandrika Jayant, Hanjie Ji, Greg Little, Andrew Miller, Robert C Miller, Robin Miller, Aubrey Tatarowicz, Brandyn White, Samual White, 2010. VizWiz: nearly real-time answers to visual questions. In Proceedings of the 23nd annual ACM symposium on User interface software and technology. ACM, 333–342.

Digital Library

[18]

Vuzix Blade. 2021. Augment Reality (AR) Smart Glasses for the Consumer. https://www.vuzix.com/products/blade-smart-glasses

[19]

Stacy M. Branham, Ali Abdolrahmani, William Easley, Morgan Scheuerman, Erick Ronquillo, and Amy Hurst. 2017. “Is Someone There? Do They Have a Gun”: How Visual Information about Others Can Improve Personal Safety Management for Blind Individuals. In Proceedings of the 19th International ACM SIGACCESS Conference on Computers and Accessibility(Baltimore, Maryland, USA) (ASSETS ’17). Association for Computing Machinery, New York, NY, USA, 260–269. https://doi.org/10.1145/3132525.3132534

Digital Library

[20]

Virginia Braun and Victoria Clarke. 2006. Using thematic analysis in psychology. Qualitative research in psychology 3, 2 (2006), 77–101.

[21]

Lookout by Google. 2021. Use Lookout to explore your surroundings. https://support.google.com/accessibility/android/answer/9031274

[22]

Wallace T Cleaves and Russell W Royal. 1979. Spatial memory for configurations by congenitally blind, late blind, and sighted adults.Journal of Visual Impairment & Blindness(1979).

[23]

Digit-Eyes. 2021. Identify and organize your world. http://www.digit-eyes.com/

[24]

Envision. 2021. Hear what you want to see. https://www.letsenvision.com/

[25]

Zekeriya Erkin, Martin Franz, Jorge Guajardo, Stefan Katzenbeisser, Inald Lagendijk, and Tomas Toft. 2009. Privacy-preserving face recognition. In International symposium on privacy enhancing technologies symposium. Springer, 235–253.

Digital Library

[26]

eSight. 2021. Electronic glasses for the legally blind. https://esighteyewear.com/

[27]

Be My Eyes. 2021. Brining sight to blind and low-vision people. https://www.bemyeyes.com/

[28]

Martina Feierabend, Hans-Otto Karnath, and Jörg Lewald. 2019. Auditory Space Perception in the Blind: Horizontal Sound Localization in Acoustically Simple and Complex Situations. Perception 48, 11 (2019), 1039–1057.

[29]

Alexander Fiannaca, Ilias Apostolopoulous, and Eelke Folmer. 2014. Headlock: A Wearable Navigation Aid That Helps Blind Cane Users Traverse Large Open Spaces. In Proceedings of the 16th International ACM SIGACCESS Conference on Computers and Accessibility (Rochester, New York, USA) (ASSETS ’14). Association for Computing Machinery, New York, NY, USA, 19–26. https://doi.org/10.1145/2661334.2661453

Digital Library

[30]

Arturo Flores, Eric Christiansen, David Kriegman, and Serge Belongie. 2013. Camera distance from face images. In International Symposium on Visual Computing. Springer, 513–522.

[31]

American Foundation for the Blind. 2020. Flatten Inaccessibility Study: Executive Summary. https://www.afb.org/research-and-initiatives/flatten-inaccessibility-survey/executive-summary

[32]

Lakshmi Gade, Sreekar Krishna, and Sethuraman Panchanathan. 2009. Person localization using a wearable camera towards enhancing social interactions for individuals with visual impairment. In Proceedings of the 1st ACM SIGMM international workshop on Media studies and implementations that help improving access to disabled users. 53–62.

Digital Library

[33]

Isha Ghodgaonkar, Subhankar Chakraborty, Vishnu Banna, Shane Allcroft, Mohammed Metwaly, Fischer Bordwell, Kohsuke Kimura, Xinxin Zhao, Abhinav Goel, Caleb Tung, 2020. Analyzing Worldwide Social Distancing through Large-Scale Computer Vision. arXiv preprint arXiv:2008.12363(2020).

[34]

Ian J Goodfellow, Jonathon Shlens, and Christian Szegedy. 2014. Explaining and harnessing adversarial examples. arXiv preprint arXiv:1412.6572(2014).

[35]

Nicolas Gourier, Daniela Hall, and James L Crowley. 2004. Estimating face orientation from robust detection of salient facial features. In ICPR International Workshop on Visual Observation of Deictic Gestures. Citeseer.

[36]

Martin Grayson, Anja Thieme, Rita Marques, Daniela Massiceti, Ed Cutrell, and Cecily Morrison. 2020. A Dynamic AI System for Extending the Capabilities of Blind People. In Extended Abstracts of the 2020 CHI Conference on Human Factors in Computing Systems (Honolulu, HI, USA) (CHI EA ’20). Association for Computing Machinery, New York, NY, USA, 1–4. https://doi.org/10.1145/3334480.3383142

Digital Library

[37]

Martin Grayson, Anja Thieme, Rita Marques, Daniela Massiceti, Ed Cutrell, and Cecily Morrison. 2020. A dynamic AI system for extending the capabilities of blind people. In Extended Abstracts of the 2020 CHI Conference on Human Factors in Computing Systems. 1–4.

Digital Library

[38]

Lighthouse Guild. 2020. How People Who Are Blind or Have Low Vision Can Safely Practice Social Distancing During COVID-19. https://www.lighthouseguild.org/newsroom/how-people-who-are-blind-or-have-low-vision-can-safely-practice-social-distancing-during-covid-19

[39]

David Guth and Robert LaDuke. 1994. The veering tendency of blind pedestrians: An analysis of the problem and literature review.Journal of Visual Impairment & Blindness(1994).

[40]

Leslie A Hayduk and Steven Mainprize. 1980. Personal space of the blind. Social Psychology Quarterly(1980), 216–223.

[41]

David Horsley and Richard J. Przybyla. 2020. Ultrasonic Range Sensors Bring Precision to Social-Distance Monitoring and Contact Tracing. https://www.electronicdesign.com/industrial-automation/article/21139839/ultrasonic-range-sensors-bring-precision-to-socialdistance-monitoring-and-contact-tracing

[42]

Alex D Hwang and Eli Peli. 2014. An augmented-reality edge enhancement application for Google Glass. Optometry and vision science: official publication of the American Academy of Optometry 91, 8 (2014), 1021.

[43]

Hyukseong Kwon, Youngrock Yoon, Jae Byung Park, and A. C. Kak. 2005. Person Tracking with a Mobile Robot using Two Uncalibrated Independently Moving Cameras. In Proceedings of the 2005 IEEE International Conference on Robotics and Automation. 2877–2883.

[44]

Dhruv Jain, Hung Ngo, Pratyush Patel, Steven Goodman, Leah Findlater, and Jon Froehlich. 2020. SoundWatch: Exploring Smartwatch-Based Deep Learning Approaches to Support Sound Awareness for Deaf and Hard of Hearing Users. In The 22nd International ACM SIGACCESS Conference on Computers and Accessibility (Virtual Event, Greece) (ASSETS ’20). Association for Computing Machinery, New York, NY, USA, Article 30, 13 pages. https://doi.org/10.1145/3373625.3416991

Digital Library

[45]

Chandrika Jayant, Hanjie Ji, Samuel White, and Jeffrey P Bigham. 2011. Supporting blind photography. In The proceedings of the 13th international ACM SIGACCESS conference on Computers and accessibility. ACM, 203–210.

Digital Library

[46]

Hernisa Kacorri. 2017. Teachable Machines for Accessibility. SIGACCESS Access. Comput.119 (Nov. 2017), 10–18. https://doi.org/10.1145/3167902.3167904

Digital Library

[47]

Hernisa Kacorri, Kris M Kitani, Jeffrey P Bigham, and Chieko Asakawa. 2017. People with visual impairment training personal object recognizers: Feasibility and challenges. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems. ACM, 5839–5849.

Digital Library

[48]

Seita Kayukawa, Keita Higuchi, João Guerreiro, Shigeo Morishima, Yoichi Sato, Kris Kitani, and Chieko Asakawa. 2019. BBeep: A Sonic Collision Avoidance System for Blind Travellers and Nearby Pedestrians. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (Glasgow, Scotland Uk) (CHI ’19). Association for Computing Machinery, New York, NY, USA, 1–12. https://doi.org/10.1145/3290605.3300282

Digital Library

[49]

Seita Kayukawa, Tatsuya Ishihara, Hironobu Takagi, Shigeo Morishima, and Chieko Asakawa. 2020. Guiding Blind Pedestrians in Public Spaces by Understanding Walking Behavior of Nearby Pedestrians. Proc. ACM Interact. Mob. Wearable Ubiquitous Technol. 4, 3, Article 85 (Sept. 2020), 22 pages. https://doi.org/10.1145/3411825

Digital Library

[50]

Adam Kendon. 1990. Conducting interaction: Patterns of behavior in focused encounters. Vol. 7. CUP Archive.

[51]

Sreekar Krishna, Greg Little, John Black, and Sethuraman Panchanathan. 2005. A wearable face recognition system for individuals with visual impairments. In Proceedings of the 7th international ACM SIGACCESS conference on Computers and accessibility. ACM, 106–113.

Digital Library

[52]

Kyungjun Lee, Jonggi Hong, Simone Pimento, Ebrima Jarjue, and Hernisa Kacorri. 2019. Revisiting blind photography in the context of teachable object recognizers. In The 21st International ACM SIGACCESS Conference on Computers and Accessibility. 83–95.

Digital Library

[53]

Kyungjun Lee and Hernisa Kacorri. 2019. Hands Holding Clues for Object Recognition in Teachable Machines. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems. 1–12.

Digital Library

[54]

Kyungjun Lee, Daisuke Sato, Saki Asakawa, Hernisa Kacorri, and Chieko Asakawa. 2020. Pedestrian Detection with Wearable Cameras for the Blind: A Two-Way Perspective. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems (Honolulu, HI, USA) (CHI ’20). Association for Computing Machinery, New York, NY, USA, 1–12. https://doi.org/10.1145/3313831.3376398

Digital Library

[55]

Bing Li, J Pablo Munoz, Xuejian Rong, Jizhong Xiao, Yingli Tian, and Aries Arditi. 2016. ISANA: wearable context-aware indoor assistive navigation with obstacle avoidance for the blind. In European Conference on Computer Vision. Springer, 448–462.

[56]

Hong Liu, Jun Wang, Xiangdong Wang, and Yueliang Qian. 2015. iSee: obstacle detection and feedback system for the blind. In Adjunct Proceedings of the 2015 ACM International Joint Conference on Pervasive and Ubiquitous Computing and Proceedings of the 2015 ACM International Symposium on Wearable Computers. 197–200.

Digital Library

[57]

LookTel. 2021. LookTel Money Reader. http://www.looktel.com/moneyreader

[58]

Gang Luo and Eli Peli. 2006. Use of an augmented-vision device for visual search by patients with tunnel vision. Investigative ophthalmology & visual science 47, 9 (2006), 4152–4159.

[59]

Minghuang Ma, Haoqi Fan, and Kris M Kitani. 2016. Going deeper into first-person activity recognition. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 1894–1903.

[60]

Anmol Madan, Manuel Cebrian, David Lazer, and Alex Pentland. 2010. Social Sensing for Epidemiological Behavior Change. In Proceedings of the 12th ACM International Conference on Ubiquitous Computing (Copenhagen, Denmark) (UbiComp ’10). Association for Computing Machinery, New York, NY, USA, 291–300. https://doi.org/10.1145/1864349.1864394

Digital Library

[61]

Troy McDaniel, Sreekar Krishna, Vineeth Balasubramanian, Dirk Colbry, and Sethuraman Panchanathan. 2008. Using a haptic belt to convey non-verbal communication cues during social interactions to individuals who are blind. In 2008 IEEE International Workshop on Haptic Audio visual Environments and Games. IEEE, 13–18.

[62]

Andrea McIntosh, Safwat Hassan, and Abram Hindle. 2019. What can Android mobile app developers do about the energy consumption of machine learning?Empirical Software Engineering 24, 2 (2019), 562–601. https://doi.org/10.1007/s10664-018-9629-2

Digital Library

[63]

Ross Mead, Amin Atrash, and Maja J. Mataric. 2011. Recognition of Spatial Dynamics for Predicting Social Interaction. In Proceedings of the 6th International Conference on Human-Robot Interaction (Lausanne, Switzerland) (HRI ’11). Association for Computing Machinery, New York, NY, USA, 201–202. https://doi.org/10.1145/1957656.1957731

Digital Library

[64]

Mohamed L. Mekhalfi, Farid Melgani, Abdallah Zeggada, Francesco G.B. [De Natale], Mohammed A.-M. Salem, and Alaa Khamis. 2016. Recovering the sight to blind people in indoor environments with smart technologies. Expert Systems with Applications 46 (2016), 129 – 138. https://doi.org/10.1016/j.eswa.2015.09.054

Digital Library

[65]

Kyle Min and Jason J Corso. 2021. Integrating Human Gaze into Attention for Egocentric Activity Recognition. In Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision. 1069–1078.

[66]

Cecily Morrison, Edward Cutrell, Martin Grayson, Anja Thieme, Alex Taylor, Geert Roumen, Camilla Longden, Sebastian Tschiatschek, Rita Faia Marques, and Abigail Sellen. 2021. Social Sensemaking with AI: Designing an Open-Ended AI Experience with a Blind Child. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems (Yokohama, Japan) (CHI ’21). Association for Computing Machinery, New York, NY, USA, Article 396, 14 pages. https://doi.org/10.1145/3411764.3445290

Digital Library

[67]

Karst M.P. Hoogsteen, Sjoukje A. Osinga, Bea L.P.A. Steenbekkers, and Sarit F.A. Szpiro. 2020. Functionality versus Inconspicuousness: Attitudes of People with Low Vision towards OST Smart Glasses. In The 22nd International ACM SIGACCESS Conference on Computers and Accessibility (Virtual Event, Greece) (ASSETS ’20). Association for Computing Machinery, New York, NY, USA, Article 70, 4 pages. https://doi.org/10.1145/3373625.3418012

Digital Library

[68]

Annika Muehlbradt, Varsha Koushik, and Shaun K Kane. 2017. Goby: A wearable swimming aid for blind athletes. In Proceedings of the 19th international acm sigaccess conference on computers and accessibility. 377–378.

Digital Library

[69]

Yasir M Mustafah, Rahizall Noor, Hasbullah Hasbi, and Amelia Wong Azma. 2012. Stereo vision images processing for real-time object distance and size measurements. In 2012 international conference on computer and communication engineering (ICCCE). IEEE, 659–663.

[70]

Nicoletta Noceti, Luca Giuliani, Joan Sosa-Garciá, Luca Brayda, Andrea Trucco, and Francesca Odone. 2019. Designing audio-visual tools to support multisensory disabilities. In Multimodal Behavior Analysis in the Wild. Elsevier, 79–102.

[71]

NuEyes. 2021. Creating Inclusive Experiences Through Technology. https://www.nueyes.com/

[72]

World Health Organization. 2020. Advice for public. https://www.who.int/emergencies/diseases/novel-coronavirus-2019/advice-for-public

[73]

World Health Organization. 2020. Social Distancing, Quarantine, and Isolation: Keep Your Distance to Slow the Spread. https://www.cdc.gov/coronavirus/2019-ncov/prevent-getting-sick/social-distancing.html

[74]

World Health Organization. 2020. WHO Director-General’s opening remakrs at the media briefing on COVID-19. https://www.who.int/dg/speeches/detail/who-director-general-s-opening-remarks-at-the-media-briefing-on-covid-19---11-march-2020

[75]

Venet Osmani, Iacopo Carreras, Aleksandar Matic, and Piret Saar. 2014. An analysis of distance estimation to detect proximity in social interactions. Journal of Ambient Intelligence and Humanized Computing 5, 3 (2014), 297–306.

[76]

Sethuraman Panchanathan, Shayok Chakraborty, and Troy McDaniel. 2016. Social interaction assistant: a person-centered approach to enrich social interactions for individuals with visual impairments. IEEE Journal of Selected Topics in Signal Processing 10, 5(2016), 942–951.

[77]

Rupal Patel and Deb Roy. 1998. Teachable interfaces for individuals with dysarthric speech and severe physical disabilities. In Proceedings of the AAAI Workshop on Integrating Artificial Intelligence and Assistive Technology. 40–47.

[78]

Eli Peli and Russell L Woods. 2009. Image enhancement for impaired vision: the challenge of evaluation. International Journal on Artificial Intelligence Tools 18, 03(2009), 415–438.

[79]

Albert Postma, Sander Zuidhoek, Matthijs L Noordzij, and Astrid ML Kappers. 2007. Differences between early-blind, late-blind, and blindfolded-sighted people in haptic spatial-configuration learning and resulting memory traces. Perception 36, 8 (2007), 1253–1265.

[80]

Halley Profita, Reem Albaghli, Leah Findlater, Paul Jaeger, and Shaun K Kane. 2016. The AT effect: how disability affects the perceived social acceptability of head-mounted display use. In proceedings of the 2016 CHI conference on human factors in computing systems. ACM, 4884–4895.

Digital Library

[81]

The Pallets Projects. 2020. Flask: web development, one drop at a time. https://palletsprojects.com/p/flask/

[82]

Joaquin Quiñonero-Candela, Masashi Sugiyama, Neil D Lawrence, and Anton Schwaighofer. 2009. Dataset shift in machine learning. Mit Press.

Digital Library

[83]

K. A. Rahman, M. S. Hossain, M. A. Bhuiyan, T. Zhang, M. Hasanuzzaman, and H. Ueno. 2009. Person to Camera Distance Measurement Based on Eye-Distance. In 2009 Third International Conference on Multimedia and Ubiquitous Engineering. 137–141.

[84]

KNFB Reader. 2021. KNFB Reader gives you easy access to print and files, anytime, anywhere. https://knfbreader.com/

[85]

Zhongzheng Ren, Yong Jae Lee, and Michael S Ryoo. 2018. Learning to anonymize faces for privacy preserving action detection. In Proceedings of the european conference on computer vision (ECCV). 620–636.

Digital Library

[86]

Mahdi Rezaei and Mohsen Azarmi. 2020. DeepSOCIAL: Social Distancing Monitoring and Infection Risk Assessment in COVID-19 Pandemic. arXiv preprint arXiv:2008.11672(2020).

[87]

Jillian Rickly, Nigel Halpern, Marcus Hansen, Scott McCabe, and John Fellenor. 2020. Covid-19: The effects of isolation and social distancing on people with vision impairment. (2020).

[88]

Brigitte RoÈder, Wolfgang Teder-SaÈlejaÈrvi, Anette Sterr, Frank RoÈsler, Steven A Hillyard, and Helen J Neville. 1999. Improved auditory spatial tuning in blind humans. Nature 400, 6740 (1999), 162–166.

[89]

Larry D Rosen, Kelly Whaling, L Mark Carrier, Nancy A Cheever, and Jeffrey Rokkum. 2013. The media and technology usage and attitudes scale: An empirical investigation. Computers in human behavior 29, 6 (2013), 2501–2511.

[90]

Jaime Sánchez and Matías Espinoza. 2011. Audio haptic videogaming for navigation skills in learners who are blind. In The proceedings of the 13th international ACM SIGACCESS conference on Computers and accessibility. 227–228.

Digital Library

[91]

M Saquib Sarfraz, Angela Constantinescu, Melanie Zuzej, and Rainer Stiefelhagen. 2017. A multimodal assistive system for helping visually impaired in social interactions. Informatik-Spektrum 40, 6 (2017), 540–545.

[92]

SeeingAI. 2021. Talking camera app for those with a visual impairment. https://www.microsoft.com/en-us/seeing-ai

[93]

S. Seneviratne, Y. Hu, T. Nguyen, G. Lan, S. Khalifa, K. Thilakarathna, M. Hassan, and A. Seneviratne. 2017. A Survey of Wearable Devices and Challenges. IEEE Communications Surveys Tutorials 19, 4 (2017), 2573–2620. https://doi.org/10.1109/COMST.2017.2731979

[94]

A. Stangl, K. Shiroma, B. Xie, K. R. Fleischmann, and D. Gurari. 2020. Visual Content Considered Private by People Who Are Blind. In Proceedings of the 22nd International ACM SIGACCESS Conference on Computers and Accessibility.

[95]

Lee Stearns, Leah Findlater, and Jon E. Froehlich. 2018. Design of an Augmented Reality Magnification Aid for Low Vision Users. In Proceedings of the 20th International ACM SIGACCESS Conference on Computers and Accessibility(Galway, Ireland) (ASSETS ’18). Association for Computing Machinery, New York, NY, USA, 28–39. https://doi.org/10.1145/3234695.3236361

Digital Library

[96]

Lee Stearns and Anja Thieme. 2018. Automated Person Detection in Dynamic Scenes to Assist People with Vision Impairments: An Initial Investigation. In Proceedings of the 20th International ACM SIGACCESS Conference on Computers and Accessibility (Galway, Ireland) (ASSETS ’18). Association for Computing Machinery, New York, NY, USA, 391–394. https://doi.org/10.1145/3234695.3241017

Digital Library

[97]

Enrico Tanuwidjaja, Derek Huynh, Kirsten Koa, Calvin Nguyen, Churen Shao, Patrick Torbett, Colleen Emmenegger, and Nadir Weibel. 2014. Chroma: a wearable augmented-reality solution for color blindness. In Proceedings of the 2014 ACM international joint conference on pervasive and ubiquitous computing. 799–810.

Digital Library

[98]

TapTapSee. 2021. Assistive Technology for the Blind and Visually Impaired. https://taptapseeapp.com/

[99]

Lauren Thevin, Carine Briant, and Anke M Brock. 2020. X-road: virtual reality glasses for orientation and mobility training of people with visual impairments. ACM Transactions on Accessible Computing (TACCESS) 13, 2 (2020), 1–47.

Digital Library

[100]

Carla Tinti, Mauro Adenzato, Marco Tamietto, and Cesare Cornoldi. 2006. Visual experience is not necessary for efficient survey spatial cognition: evidence from blindness. Quarterly journal of experimental psychology 59, 7(2006), 1306–1328.

[101]

Nelson Daniel Troncoso Aldas, Sooyeon Lee, Chonghan Lee, Mary Beth Rosson, John M Carroll, and Vijaykrishnan Narayanan. 2020. AIGuide: An Augmented Reality Hand Guidance Application for People with Visual Impairments. In The 22nd International ACM SIGACCESS Conference on Computers and Accessibility. 1–13.

Digital Library

[102]

Marynel Vázquez and Aaron Steinfeld. 2012. Helping visually impaired users properly aim a camera. In Proceedings of the 14th international ACM SIGACCESS conference on Computers and accessibility. 95–102.

Digital Library

[103]

Michele A. Williams, Caroline Galbraith, Shaun K. Kane, and Amy Hurst. 2014. “just Let the Cane Hit It”: How the Blind and Sighted See Navigation Differently. In Proceedings of the 16th International ACM SIGACCESS Conference on Computers & Accessibility (Rochester, New York, USA) (ASSETS ’14). Association for Computing Machinery, New York, NY, USA, 217–224. https://doi.org/10.1145/2661334.2661380

Digital Library

[104]

Edy Winarno, Agus Harjoko, Aniati Murni Arymurthy, and Edi Winarko. 2014. Development of face recognition system and face distance estimation using stereo vision camera. Journal Of Theoretical And Applied Information Technology 67, 3(2014), 652–657.

[105]

Katrin Wolf, Yomna Abdelrahman, David Schmid, Tilman Dingler, and Albrecht Schmidt. 2015. Effects of camera position and media type on lifelogging images. In Proceedings of the 14th International Conference on Mobile and Ubiquitous Multimedia. 234–244.

Digital Library

[106]

Jian Xu, Syed Masum Billah, Roy Shilkrot, and Aruna Balasubramanian. 2019. DarkReader: Bridging the Gap Between Perception and Reality of Power Consumption in Smartphones for Blind Users. In The 21st International ACM SIGACCESS Conference on Computers and Accessibility (Pittsburgh, PA, USA) (ASSETS ’19). Association for Computing Machinery, New York, NY, USA, 96–104. https://doi.org/10.1145/3308561.3353806

Digital Library

[107]

Yan Yan, Elisa Ricci, Gaowen Liu, and Nicu Sebe. 2015. Egocentric daily activity recognition via multitask clustering. IEEE Transactions on Image Processing 24, 10 (2015), 2984–2995.

Digital Library

[108]

Shuo Yang, Ping Luo, Chen-Change Loy, and Xiaoou Tang. 2016. Wider face: A face detection benchmark. In Proceedings of the IEEE conference on computer vision and pattern recognition. 5525–5533.

[109]

Heng Yu, Eshed Ohn-Bar, Donghyun Yoo, and Kris M Kitani. 2018. SmartPartNet: Part-Informed Person Detection for Body-Worn Smartphones. In 2018 IEEE Winter Conference on Applications of Computer Vision (WACV). IEEE, 1103–1112.

[110]

Kaipeng Zhang, Zhanpeng Zhang, Zhifeng Li, and Yu Qiao. 2016. Joint face detection and alignment using multitask cascaded convolutional networks. IEEE Signal Processing Letters 23, 10 (2016), 1499–1503.

[111]

Xiaoyang Zhang, Harshit Vadodaria, Na Li, Kyoung-Don Kang, and Yao Liu. 2020. A Smartphone Thermal Temperature Analysis for Virtual and Augmented Reality. 2020 IEEE International Conference on Artificial Intelligence and Virtual Reality (AIVR) (2020), 301–306.

[112]

Jian Zhao, Jianshu Li, Yu Cheng, Terence Sim, Shuicheng Yan, and Jiashi Feng. 2018. Understanding humans in crowded scenes: Deep nested adversarial learning and a new benchmark for multi-human parsing. In Proceedings of the 26th ACM international conference on Multimedia. 792–800.

Digital Library

[113]

Yuhang Zhao, Michele Hu, Shafeka Hashash, and Shiri Azenkot. 2017. Understanding Low Vision People’s Visual Perception on Commercial Augmented Reality Glasses. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems. 4170–4181.

Digital Library

[114]

Yuhang Zhao, Elizabeth Kupferstein, Brenda Veronica Castro, Steven Feiner, and Shiri Azenkot. 2019. Designing AR visualizations to facilitate stair navigation for people with low vision. In Proceedings of the 32nd Annual ACM Symposium on User Interface Software and Technology. 387–402.

Digital Library

[115]

Yuhang Zhao, Sarit Szpiro, and Shiri Azenkot. 2015. Foresee: A customizable head-mounted vision enhancement system for people with low vision. In Proceedings of the 17th International ACM SIGACCESS Conference on Computers & Accessibility. 239–249.

Digital Library

[116]

Yuhang Zhao, Shaomei Wu, Lindsay Reynolds, and Shiri Azenkot. 2018. A Face Recognition Application for People with Visual Impairments: Understanding Use Beyond the Lab. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems. ACM, 215.

Digital Library

[117]

Annuska Zolyomi, Anushree Shukla, and Jaime Snyder. 2017. Technology-Mediated Sight: A Case Study of Early Adopters of a Low Vision Assistive Technology. In Proceedings of the 19th International ACM SIGACCESS Conference on Computers and Accessibility (Baltimore, Maryland, USA) (ASSETS ’17). Association for Computing Machinery, New York, NY, USA, 220–229. https://doi.org/10.1145/3132525.3132552

Digital Library

Cited By

Kamikubo RKacorri HAsakawa C(2024)"We are at the mercy of others' opinion": Supporting Blind People in Recreational Window Shopping with AI-infused TechnologyProceedings of the 21st International Web for All Conference10.1145/3677846.3677860(45-58)Online publication date: 13-May-2024
https://dl.acm.org/doi/10.1145/3677846.3677860
Stangl ASadjo EEmami-Naeini PWang YGurari DFindlater L(2023)“Dump it, Destroy it, Send it to Data Heaven”: Blind People’s Expectations for Visual Privacy in Visual Assistance TechnologiesProceedings of the 20th International Web for All Conference10.1145/3587281.3587296(134-147)Online publication date: 30-Apr-2023
https://dl.acm.org/doi/10.1145/3587281.3587296
Lee KHong JJarjue EMensah EKacorri HAhmetovic DYaneva V(2022)From the lab to people's homeProceedings of the 19th International Web for All Conference10.1145/3493612.3520448(1-11)Online publication date: 25-Apr-2022
https://dl.acm.org/doi/10.1145/3493612.3520448

Index Terms

Accessing Passersby Proxemic Signals through a Head-Worn Camera: Opportunities and Limitations for the Blind
1. Human-centered computing
  1. Human computer interaction (HCI)

Index terms have been assigned to the content through auto-classification.

Recommendations

Pedestrian Detection with Wearable Cameras for the Blind: A Two-way Perspective
CHI '20: Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems

Blind people have limited access to information about their surroundings, which is important for ensuring one's safety, managing social interactions, and identifying approaching pedestrians. With advances in computer vision, wearable cameras can provide ...
Demonstrating Proxemic Cursor Input for Touchless Displays
SUI '23: Proceedings of the 2023 ACM Symposium on Spatial User Interaction

Touchless gesture interfaces often use cursor-based interactions, where widgets are targeted by a movable cursor and activated with a mid-air gesture. Proxemic cursor interactions are a novel alternative that facilitate faster selection without the need ...
Proxemic interaction: designing for a proximity and orientation-aware environment
ITS '10: ACM International Conference on Interactive Tabletops and Surfaces

In the everyday world, much of what we do is dictated by how we interpret spatial relationships, or proxemics. What is surprising is how little proxemics are used to mediate people's interactions with surrounding digital devices. We imagine proxemic ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

ASSETS '21: Proceedings of the 23rd International ACM SIGACCESS Conference on Computers and Accessibility

October 2021

730 pages

ISBN:9781450383066

DOI:10.1145/3441852

Editors:
Jonathan Lazar
University of Maryland, USA
,
Jinjuan Heidi Feng
Towson University, USA
,
Faustina Hwang
Towson University, USA

Copyright © 2021 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

SIGACCESS: ACM Special Interest Group on Accessible Computing

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 17 October 2021

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed limited

Funding Sources

Shimizu Corporation
National Institute on Disability, Independent Living, and Rehabilitation Research

Conference

ASSETS '21

Sponsor:

SIGACCESS

ASSETS '21: The 23rd International ACM SIGACCESS Conference on Computers and Accessibility

October 18 - 22, 2021

Virtual Event, USA

Acceptance Rates

ASSETS '21 Paper Acceptance Rate 36 of 134 submissions, 27%;

Overall Acceptance Rate 436 of 1,556 submissions, 28%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

3
Total Citations
View Citations
300
Total Downloads

Downloads (Last 12 months)83
Downloads (Last 6 weeks)7

Reflects downloads up to 14 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Kamikubo RKacorri HAsakawa C(2024)"We are at the mercy of others' opinion": Supporting Blind People in Recreational Window Shopping with AI-infused TechnologyProceedings of the 21st International Web for All Conference10.1145/3677846.3677860(45-58)Online publication date: 13-May-2024
https://dl.acm.org/doi/10.1145/3677846.3677860
Stangl ASadjo EEmami-Naeini PWang YGurari DFindlater L(2023)“Dump it, Destroy it, Send it to Data Heaven”: Blind People’s Expectations for Visual Privacy in Visual Assistance TechnologiesProceedings of the 20th International Web for All Conference10.1145/3587281.3587296(134-147)Online publication date: 30-Apr-2023
https://dl.acm.org/doi/10.1145/3587281.3587296
Lee KHong JJarjue EMensah EKacorri HAhmetovic DYaneva V(2022)From the lab to people's homeProceedings of the 19th International Web for All Conference10.1145/3493612.3520448(1-11)Online publication date: 25-Apr-2022
https://dl.acm.org/doi/10.1145/3493612.3520448

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

HTML Format

View this article in HTML Format.

Media

Figures

Other

Tables

View Table of Contents