research-article

Fast blur removal for wearable QR code scanners

Authors:

Gábor Sörös,

Stephan Semmler,

Otmar HilligesAuthors Info & Claims

ISWC '15: Proceedings of the 2015 ACM International Symposium on Wearable Computers

Pages 117 - 124

https://doi.org/10.1145/2802083.2808390

Published: 07 September 2015 Publication History

Abstract

We present a fast restoration-recognition algorithm for scanning motion-blurred QR codes on handheld and wearable devices. We blindly estimate the blur from the salient edges of the code in an iterative optimization scheme, alternating between image sharpening, blur estimation, and decoding. The restored image is constrained to exploit the properties of QR codes which ensures fast convergence. The checksum of the code allows early termination when the code is first readable and precludes false positive detections. General blur removal algorithms perform poorly in restoring visual codes and are slow even on high-performance PCs. The proposed algorithm achieves good reconstruction quality on QR codes and outperforms existing methods in terms of speed. We present PC and Android implementations of a complete QR scanner and evaluate the algorithm on synthetic and real test images. Our work indicates a promising step towards enterprise-grade scan performance with wearable devices.

Supplementary Material

PDF File (p117-soros_supp.pdf)

Supplemental files.

Download
1.63 MB

MP4 File (p117-soros.mp4)

Download
21.91 MB

References

[1]

Chen, X., He, X., Yang, J., and Wu, Q. An effective document image deblurring algorithm. In IEEE Conference on Computer Vision and Pattern Recognition (CVPR) (2011).

Digital Library

[2]

Cho, H., Wang, J., and Lee, S. Text image deblurring using text-specific properties. In European Conference on Computer Vision (ECCV) (2012).

Digital Library

[3]

Cho, S., and Lee, S. Fast motion deblurring. In ACM SIGGRAPH Asia (2009).

Digital Library

[4]

Cho, T. S., Paris, S., Horn, B., and Freeman, W. Blur kernel estimation using the radon transform. In IEEE Conference on Computer Vision and Pattern Recognition (CVPR) (2011).

Digital Library

[5]

Joshi, N., Szeliski, R., and Kriegman, D. PSF estimation using sharp edge prediction. In IEEE Conference on Computer Vision and Pattern Recognition (CVPR) (2008).

[6]

Krishnan, D., and Fergus, R. Fast image deconvolution using hyper-Laplacian priors. In Advances in Neural Information Processing Systems (NIPS) (2009).

Digital Library

[7]

Levin, A., Weiss, Y., Durand, F., and Freeman, W. Understanding and evaluating blind deconvolution algorithms. In IEEE Conference on Computer Vision and Pattern Recognition (CVPR) (2009).

[8]

Liu, N., Zheng, X., Sun, H., and Tan, X. Two-dimensional bar code out-of-focus deblurring via the increment constrained least squares filter. Pattern Recognition Letters 34, 2 (2013).

Digital Library

[9]

Liu, R., and Jia, J. Reducing boundary artifacts in image deconvolution. In IEEE International Conference on Image Processing (ICIP) (2008).

[10]

Pan, J., Hu, Z., Su, Z., and Yang, M.-H. Deblurring text images via L0-regularized intensity and gradient prior. In IEEE Conference on Computer Vision and Pattern Recognition (CVPR) (2014).

Digital Library

[11]

Pan, J., Liu, R., Su, Z., and Gu, X. Kernel estimation from salient structure for robust motion deblurring. Signal Processing: Image Communication 28, 9 (2013).

Digital Library

[12]

Park, S., and Levoy, M. Gyro-based multi-image deconvolution for removing handshake blur. In IEEE Conference on Computer Vision and Pattern Recognition (CVPR) (2014).

Digital Library

[13]

Perrone, D., and Favaro, P. Total variation blind deconvolution: The devil is in the details. In IEEE Conference on Computer Vision and Pattern Recognition (CVPR) (2014).

Digital Library

[14]

Sörös, G., and Flörkemeier, C. Blur-resistant joint 1D and 2D barcode localization for smartphones. In ACM 12th International Conference on Mobile and Ubiquitous Multimedia (MUM) (2013).

Digital Library

[15]

Sun, L., Cho, S., Wang, J., and Hays, J. Edge-based blur kernel estimation using patch priors. In IEEE International Conference on Computational Photography (ICCP) (2013).

[16]

Tai, Y.-W., Chen, X., Kim, S., Kim, S. J., Li, F., Yang, J., Yu, J., Matsushita, Y., and Brown, M. Nonlinear camera response functions and image deblurring: Theoretical analysis and practice. IEEE Transactions on Pattern Analysis and Machine Intelligence 35, 10 (2013).

Digital Library

[17]

van Gennip, Y., Athavale, P., Gilles, J., and Choksi, R. A regularization approach to blind deblurring and denoising of qr barcodes. arXiv:1410.6333 (2014).

[18]

Whyte, O., Sivic, J., Zisserman, A., and Ponce, J. Non-uniform deblurring for shaken images. International Journal of Computer Vision 98, 2 (2012).

Digital Library

[19]

Xu, L., and Jia, J. Two-phase kernel estimation for robust motion deblurring. In European Conference on Computer Vision (ECCV) (2010).

Digital Library

[20]

Xu, L., Zheng, S., and Jia, J. Unnatural L0 sparse representation for natural image deblurring. In IEEE Conference on Computer Vision and Pattern Recognition (CVPR) (2013).

Digital Library

[21]

Xu, W., and McCloskey, S. 2D Barcode localization and motion deblurring using a flutter shutter camera. In IEEE Workshop on Applications of Computer Vision (WACV) (2011).

Digital Library

[22]

Yahyanejad, S., and Ström, J. Removing motion blur from barcode images. In IEEE Conference on Computer Vision and Pattern Recognition Workshops (2010).

[23]

Zhang, Q., Xu, L., and Jia, J. 100+ times faster weighted median filter (WMF). In IEEE Conference on Computer Vision and Pattern Recognition (CVPR) (2014).

Digital Library

Cited By

Xu BJin RLi JZhang BLiu K(2024)Robust and fast QR code images deblurring via local maximum and minimum intensity priorThe Visual Computer10.1007/s00371-024-03272-yOnline publication date: 27-Feb-2024
https://doi.org/10.1007/s00371-024-03272-y
Mazursky ATeng SNith RLopes P(2021)Demonstrating MagnetIO: Passive yet Interactive Soft Haptic Patches AnywhereACM SIGGRAPH 2021 Emerging Technologies10.1145/3450550.3465342(1-4)Online publication date: 5-Aug-2021
https://dl.acm.org/doi/10.1145/3450550.3465342
Mazursky ATeng SNith RLopes PKitamura YQuigley AIsbister KIgarashi TBjørn PDrucker S(2021)MagnetIO: Passive yet Interactive Soft Haptic Patches AnywhereProceedings of the 2021 CHI Conference on Human Factors in Computing Systems10.1145/3411764.3445543(1-15)Online publication date: 6-May-2021
https://dl.acm.org/doi/10.1145/3411764.3445543
Show More Cited By

Index Terms

Fast blur removal for wearable QR code scanners

Recommendations

Fast motion deblurring
SIGGRAPH Asia '09: ACM SIGGRAPH Asia 2009 papers

This paper presents a fast deblurring method that produces a deblurring result from a single image of moderate size in a few seconds. We accelerate both latent image estimation and kernel estimation in an iterative deblurring process by introducing a ...
Motion Deblur of QR Code Based on Generative Adversative Network
ACAI '19: Proceedings of the 2019 2nd International Conference on Algorithms, Computing and Artificial Intelligence

Aiming at the problem that the QR codes cannot be recognized due to factors such as motion blur caused by the hand tremor and environmental noise in the QR codes of the packaged product, this paper proposes an algorithm based on the Generative ...
Fast motion deblurring

This paper presents a fast deblurring method that produces a deblurring result from a single image of moderate size in a few seconds. We accelerate both latent image estimation and kernel estimation in an iterative deblurring process by introducing a ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

ISWC '15: Proceedings of the 2015 ACM International Symposium on Wearable Computers

September 2015

223 pages

ISBN:9781450335782

DOI:10.1145/2802083

General Chairs:
Kenji Mase
Nagoya University, JP
,
Marc Langheinrich
Università della Svizzera italiana (USI), CH
,
Daniel Gatica-Perez
IDIAP-EPFL, CH
,
Program Chairs:
Kristof Van Laerhoven,
Tsutomu Terada

Copyright © 2015 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Yahoo! Japan: Yahoo! Japan
SIGMOBILE: ACM Special Interest Group on Mobility of Systems, Users, Data and Computing
FX Palo Alto Laboratory, Inc.: FX Palo Alto Laboratory, Inc.
Google Inc.
ACM: Association for Computing Machinery
Rakuten Institute of Technology: Rakuten Institute of Technology
Microsoft: Microsoft
Bell Labs: Bell Laboratories
SIGCHI: ACM Special Interest Group on Computer-Human Interaction
KDDI
Panasonic: Panasonic Corporation
NTT DoCoMo
Telefónica: Telefónica
ISTC-PC: Intel Science and Technology Center for Pervasive Computing

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 07 September 2015

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

UbiComp '15

Sponsor:

Yahoo! Japan
SIGMOBILE
FX Palo Alto Laboratory, Inc.
ACM
Rakuten Institute of Technology
Microsoft
Bell Labs
SIGCHI
Panasonic
Telefónica
ISTC-PC

UbiComp '15: The 2015 ACM International Joint Conference on Pervasive and Ubiquitous Computing

September 7 - 11, 2015

Osaka, Japan

Acceptance Rates

Overall Acceptance Rate 38 of 196 submissions, 19%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

9
Total Citations
View Citations
411
Total Downloads

Downloads (Last 12 months)13
Downloads (Last 6 weeks)2

Reflects downloads up to 01 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Xu BJin RLi JZhang BLiu K(2024)Robust and fast QR code images deblurring via local maximum and minimum intensity priorThe Visual Computer10.1007/s00371-024-03272-yOnline publication date: 27-Feb-2024
https://doi.org/10.1007/s00371-024-03272-y
Mazursky ATeng SNith RLopes P(2021)Demonstrating MagnetIO: Passive yet Interactive Soft Haptic Patches AnywhereACM SIGGRAPH 2021 Emerging Technologies10.1145/3450550.3465342(1-4)Online publication date: 5-Aug-2021
https://dl.acm.org/doi/10.1145/3450550.3465342
Mazursky ATeng SNith RLopes PKitamura YQuigley AIsbister KIgarashi TBjørn PDrucker S(2021)MagnetIO: Passive yet Interactive Soft Haptic Patches AnywhereProceedings of the 2021 CHI Conference on Human Factors in Computing Systems10.1145/3411764.3445543(1-15)Online publication date: 6-May-2021
https://dl.acm.org/doi/10.1145/3411764.3445543
Mazursky ATeng SNith RLopes P(2021)Demonstrating Passive yet Interactive Soft Haptic Patches Anywhere using MagnetIOExtended Abstracts of the 2021 CHI Conference on Human Factors in Computing Systems10.1145/3411763.3451548(1-4)Online publication date: 8-May-2021
https://dl.acm.org/doi/10.1145/3411763.3451548
Song KLiu NGao ZZhang JZhai GZhang X(2020)Deep Restoration of Invisible QR Code from TPVM Display2020 IEEE International Conference on Multimedia & Expo Workshops (ICMEW)10.1109/ICMEW46912.2020.9105961(1-6)Online publication date: Jul-2020
https://doi.org/10.1109/ICMEW46912.2020.9105961
Pu HFan MYang JLian J(2019)Quick response barcode deblurring via doubly convolutional neural networkMultimedia Tools and Applications10.1007/s11042-018-5802-278:1(897-912)Online publication date: 1-Jan-2019
https://dl.acm.org/doi/10.1007/s11042-018-5802-2
Bodnár PGrósz TTóth LNyúl L(2018)Efficient visual code localization with neural networksPattern Analysis & Applications10.1007/s10044-017-0619-621:1(249-260)Online publication date: 1-Feb-2018
https://dl.acm.org/doi/10.1007/s10044-017-0619-6
Nose-Filho KTakahata ASuyama RLopes RRomano J(2017)On Minimum Entropy Deconvolution of Bi-level ImagesLatent Variable Analysis and Signal Separation10.1007/978-3-319-53547-0_46(489-498)Online publication date: 15-Feb-2017
https://doi.org/10.1007/978-3-319-53547-0_46
Olti EVerbeke TBraeckman GDadarlat VMunteanu A(2016)Robot tracking in low-power visual sensor networksProceedings of the 10th International Conference on Distributed Smart Camera10.1145/2967413.2967420(19-24)Online publication date: 12-Sep-2016
https://dl.acm.org/doi/10.1145/2967413.2967420

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents