Nothing Special   »   [go: up one dir, main page]

skip to main content
10.1145/3242587.3242641acmconferencesArticle/Chapter ViewAbstractPublication PagesuistConference Proceedingsconference-collections
research-article

CamTrackPoint: Camera-Based Pointing Stick Using Transmitted Light through Finger

Published: 11 October 2018 Publication History

Abstract

We present CamTrackPoint, a new input interface that can be controlled by finger gestures captured by front or rear cameras of a mobile device. CamTrackPoint mounts a 3D-printed ring on the camera's bezel, and it senses the movements of the user's finger by tracking the light passed through the finger. The proposed method provides mobile devices with a new input interface that offers physical force feedback like a pointing stick. The cost of our method is low as it needs only a simple ring-shaped part on the camera bezel. Moreover, the ring doesn't disturb the functions of the camera, unless a user uses the interface. We implement a prototype for a smartphone; two CamTrackPoint rings are made for the front and rear cameras. We evaluate its performance and characteristics in an experiment. The proposed technique provides smooth scrolling and would give better game experience on the available smartphone.

Supplementary Material

suppl.mov (ufp1384p.mp4)
Supplemental video
MP4 File (p313-yamada.mp4)

References

[1]
Jun-Ho An, Jin-Hong Min, and Kwang-Seok Hong. 2011. Finger gesture estimation for mobile device user interface using a rear-facing camera. In Future Information Technology. Springer, 230--237.
[2]
Patrick Baudisch and Gerry Chu. 2009. Back-of-device Interaction Allows Creating Very Small Touch Devices. In Proc. CHI '09. 1923--1932.
[3]
Christian Corsten, Ignacio Avellino, Max Möllers, and Jan Borchers. 2013. Instant User Interfaces: Repurposing Everyday Objects As Input Devices. In Proc. ITS '13. 71--80.
[4]
Christian Corsten, Bjoern Daehlmann, Simon Voelker, and Jan Borchers. 2017. BackXPress: Using Back-of-Device Finger Pressure to Augment Touchscreen Input on Smartphones. In In Proc. CHI'17. ACM, New York, NY, USA, 4654--4666.
[5]
Hiroyuki Hakoda, Yoshitomo Fukatsu, Buntarou Shizuki, and Jiro Tanaka. 2015. Back-of-Device Interaction Based on the Range of Motion of the Index Finger. In In Proc. OzCHI'15. ACM, New York, NY, USA, 202--206.
[6]
Chris Harrison and Scott E. Hudson. 2010. Minput: Enabling Interaction on Small Mobile Devices with High-precision, Low-cost, Multipoint Optical Tracking. In Proc. CHI '10. 1661--1664.
[7]
Kunihiro Kato and Homei Miyashita. 2015. ExtensionSticker: A Proposal for a Striped Pattern Sticker to Extend Touch Interfaces and Its Assessment. In Proc. CHI '15. 1851--1854.
[8]
Huy Viet Le, Patrick Bader, Thomas Kosch, and Niels Henze. 2016. Investigating Screen Shifting Techniques to Improve One-Handed Smartphone Usage. In Proc. NordiCHI'16. ACM, New York, NY, USA, Article 27, 10 pages.
[9]
Huy Viet Le, Sven Mayer, Patrick Bader, and Niels Henze. 2017. A Smartphone Prototype for Touch Interaction on the Whole Device Surface. In Proc. MobileHCI'17. ACM, New York, NY, USA, Article 100, 8 pages.
[10]
Markus Löchtefeld, Christoph Hirtz, and Sven Gehring. 2013. Evaluation of Hybrid Front- and Back-of-device Interaction on Mobile Devices. In Proc. MUM'13. ACM, New York, NY, USA, Article 17, 4 pages.
[11]
Larry J Mengelkoch, Daniel Martin, and John Lawler. 1994. A Review of the Principles of Pulse Oximetry and Accuracy of Pulse Oximeter Estimates During Exercise. In Physical Therapy, Vol. 74. 40--49.
[12]
Pelegris P, Banitsas K, Orbach T, and Marias K. 2010. A Novel Method to Detect Heart Beat Rate Using a Mobile Phone. In Proc. IEEE EMBS '10. 5488--5491.
[13]
Dennis W. Rowe, John Sibert, and Don Irwin. 1998. Heart Rate Variability: Indicator of User State As an Aid to Human-computer Interaction. In Proc. CHI '98. 480--487.
[14]
Dilbag Singh, B S Saini, and Vinod Kumar. 2008. Heart Rate Variability-A Bibliographical Survey. In IETE Journal of Research, Vol. 54. 209--216.
[15]
Daniel Wigdor, Clifton Forlines, Patrick Baudisch, John Barnwell, and Chia Shen. 2007. Lucid Touch: A See-through Mobile Device. In Proc. UIST '07. 269--278.
[16]
Jacob O. Wobbrocka, Brad A. Myers, and Htet Htet Aung. 2008. The Performance of Hand Postures in Front- and Back-of-Device Interaction for Mobile Computing. In International Journal of Human-Computer Studies, Vol. 66. 857--875.
[17]
Pui Chung Wong, Hongbo Fu, and Kening Zhu. 2016. Back-Mirror: Back-of-device One-handed Interaction on Smartphones. In Proc. SA '16.
[18]
Xiang Xiao, Teng Han, and Jingtao Wang. 2013. LensGesture: Augmenting Mobile Interactions with Back-of-device Finger Gestures. In Proc. ICMI '13. 287--294.
[19]
Koji Yatani, Kurt Partridge, Marshall Bern, and Mark W. Newman. 2008. Escape: A Target Selection Technique Using Visually-cued Gestures. In Proc. CHI '08. 285--294.
[20]
Watabe Yoichi, Sato Katsunari, Makino Yasutoshi, and Maeno Takashi. 2012. Input Device for Touch Panel Applying Optical Force Measurement Method. In Proc. IPSJ Interaction '12 (written in Japanese).

Cited By

View all
  • (2024)LensLeech: On-Lens Interaction for Arbitrary Camera DevicesProceedings of the Eighteenth International Conference on Tangible, Embedded, and Embodied Interaction10.1145/3623509.3633382(1-10)Online publication date: 11-Feb-2024
  • (2023)OmniSense: Exploring Novel Input Sensing and Interaction Techniques on Mobile Device with an Omni-Directional CameraProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3580747(1-18)Online publication date: 19-Apr-2023
  • (2022)Understanding and Creating Spatial Interactions with Distant Displays Enabled by Unmodified Off-The-Shelf SmartphonesMultimodal Technologies and Interaction10.3390/mti61000946:10(94)Online publication date: 19-Oct-2022
  • Show More Cited By

Index Terms

  1. CamTrackPoint: Camera-Based Pointing Stick Using Transmitted Light through Finger

        Recommendations

        Comments

        Please enable JavaScript to view thecomments powered by Disqus.

        Information & Contributors

        Information

        Published In

        cover image ACM Conferences
        UIST '18: Proceedings of the 31st Annual ACM Symposium on User Interface Software and Technology
        October 2018
        1016 pages
        ISBN:9781450359481
        DOI:10.1145/3242587
        Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

        Sponsors

        Publisher

        Association for Computing Machinery

        New York, NY, United States

        Publication History

        Published: 11 October 2018

        Permissions

        Request permissions for this article.

        Check for updates

        Author Tags

        1. back-of-device interaction
        2. gesture interface
        3. mobile
        4. pointing stick

        Qualifiers

        • Research-article

        Conference

        UIST '18

        Acceptance Rates

        UIST '18 Paper Acceptance Rate 80 of 375 submissions, 21%;
        Overall Acceptance Rate 561 of 2,567 submissions, 22%

        Contributors

        Other Metrics

        Bibliometrics & Citations

        Bibliometrics

        Article Metrics

        • Downloads (Last 12 months)32
        • Downloads (Last 6 weeks)2
        Reflects downloads up to 09 Nov 2024

        Other Metrics

        Citations

        Cited By

        View all
        • (2024)LensLeech: On-Lens Interaction for Arbitrary Camera DevicesProceedings of the Eighteenth International Conference on Tangible, Embedded, and Embodied Interaction10.1145/3623509.3633382(1-10)Online publication date: 11-Feb-2024
        • (2023)OmniSense: Exploring Novel Input Sensing and Interaction Techniques on Mobile Device with an Omni-Directional CameraProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3580747(1-18)Online publication date: 19-Apr-2023
        • (2022)Understanding and Creating Spatial Interactions with Distant Displays Enabled by Unmodified Off-The-Shelf SmartphonesMultimodal Technologies and Interaction10.3390/mti61000946:10(94)Online publication date: 19-Oct-2022
        • (2022)TetraForce: A Magnetic-Based Interface Enabling Pressure Force and Shear Force Input Applied to Front and Back of a SmartphoneProceedings of the ACM on Human-Computer Interaction10.1145/35677176:ISS(185-206)Online publication date: 14-Nov-2022
        • (2022)One–Handed Control for Smartwatches Using Thumb Gestures to RingProceedings of the Asian HCI Symposium 202210.1145/3516492.3558790(30-32)Online publication date: 29-Apr-2022
        • (2021)MagneTrack: Magnetic Field Separation Method for Continuous and Simultaneous 1-DOF Tracking of Two-magnetsProceedings of the 23rd International Conference on Mobile Human-Computer Interaction10.1145/3447526.3472052(1-11)Online publication date: 27-Sep-2021
        • (2020)Battery-Free Game BoyProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/34118394:3(1-34)Online publication date: 4-Sep-2020
        • (2019)Expanding One-Handed Touch Input Vocabulary Using Index Finger on and Above Back-of-DeviceProceedings of the 31st Australian Conference on Human-Computer-Interaction10.1145/3369457.3369537(585-589)Online publication date: 2-Dec-2019
        • (2019)ShearSheet: Low-Cost Shear Force Input with Elastic Feedback for Augmenting Touch InteractionProceedings of the 2019 ACM International Conference on Interactive Surfaces and Spaces10.1145/3343055.3359717(77-87)Online publication date: 10-Nov-2019
        • (2019)Ohmic-StickerProceedings of the 32nd Annual ACM Symposium on User Interface Software and Technology10.1145/3332165.3347903(1021-1030)Online publication date: 17-Oct-2019
        • Show More Cited By

        View Options

        Get Access

        Login options

        View options

        PDF

        View or Download as a PDF file.

        PDF

        eReader

        View online with eReader.

        eReader

        Media

        Figures

        Other

        Tables

        Share

        Share

        Share this Publication link

        Share on social media