Nothing Special   »   [go: up one dir, main page]

skip to main content
10.1145/1502650.1502688acmconferencesArticle/Chapter ViewAbstractPublication PagesiuiConference Proceedingsconference-collections
research-article

Subobject detection through spatial relationships on mobile phones

Published: 08 February 2009 Publication History

Abstract

We present a novel image classification technique for detecting multiple objects (called subobjects) in a single image. In addition to image classifiers, we apply spatial relationships among the subobjects to verify and to predict the locations of detected and undetected subobjects, respectively. By continuously refining the spatial relationships throughout the detection process, even locations of completely occluded exhibits can be determined. This approach is applied in the context of PhoneGuide, an adaptive museum guidance system for camera-equipped mobile phones.
Laboratory tests as well as a field experiment reveal recognition rates and performance improvements when compared to related approaches.

References

[1]
S. Agarwal, A. Awan, and D. Roth. Learning to detect objects in images via a sparse, part-based representation. Pattern Analysis and Machine Intelligence, IEEE Transactions on, 26(11):1475--1490, 2004.
[2]
H. Bay, B. Fasel, and L. V. Gool. Interactive museum guide. In Proc. Ubiquitous Computing, Workshop on Smart Environments and Their Applications to Cultural Heritage, 2005.
[3]
H. Bay, B. Fasel, and L. V. Gool. Interactive museum guide: Fast and robust recognition of museum objects. In Workshop on Mobile Vision, 2006.
[4]
H. Bay, T. Tuytelaars, and L. V. Gool. Surf: Speeded up robust features. In Proc. Conference on Computer Vision, 2006.
[5]
E. Bruns and O. Bimber. Adaptive training of video sets for image recognition on mobile phones. Journal of Personal and Ubiquitous Computing, 2008.
[6]
E. Bruns and O. Bimber. Phone-to-phone communication for adaptive image classification. In Proc. Advances in Mobile Computing and Multimedia, pages 276--281, 2008.
[7]
E. Bruns, B. Brombach, and O. Bimber. Mobile phone enabled museum guidance with adaptive classification. Journal of Computer Graphics and Applications, 28(4):98--102, 2008.
[8]
E. Bruns, B. Brombach, T. Zeidler, and O. Bimber. Enabling mobile phones to support large-scale museum guidance. Journal of MultiMedia, 14(2):16--25, 2007.
[9]
D. Comaniciu and P. Meer. Mean shift: A robust approach toward feature space analysis. Transactions Pattern Analysis Machine Intelligence, 24(5):603--619, 2002.
[10]
N. Davies, K. Cheverst, A. Dix, and A. Hesse. Understanding the role of image recognition in mobile tour guides. In MobileHCI '05: Proceedings of the 7th international conference on Human computer interaction with mobile devices & services, pages 191--198. ACM, 2005.
[11]
M. Egenhofer and R. Franzosa. Point-set topological spatial relations. Journal of Geographical Information Systems, 5 (2):161--174, 1991.
[12]
E. A. El-Kwae and M. R. Kabuka. A robust framework for content-based retrieval by spatial similarity in image databases. Transactions on Information Systems, 17(2):174--198, 1999.
[13]
R. Fergus, P. Perona, A. Zisserman, and O. P. U. K. Object class recognition by unsupervised scale-invariant learning. In In CVPR, pages 264--271, 2003.
[14]
P. Föckler, T. Zeidler, B. Brombach, E. Bruns, and O. Bimber. Phoneguide: museum guidance supported by on-device object recognition on mobile phones. In Proc. Mobile and ubiquitous multimedia, pages 3--10, 2005.
[15]
W. Förstner and E. Gülch. A fast operator for detection and precise location of distinct points, corners and centers of circular features. ISPRS Intercommission Workshop on Fast Processing of Photogrammetric Data, pages 149--155, 1987.
[16]
G. Fritz, C. Seifert, and L. Paletta. A mobile vision system for urban detection with informative local descriptors. In Proc. Computer Vision Systems, 2006.
[17]
J. S. Hare and P. H. Lewis. Content-based image retrieval using a mobile device as a novel interface. In Proc. Storage and Retrieval Methods and Applications for Multimedia, pages 64--75, 2004.
[18]
J. Lewis. Fast normalized cross-correlation. In Vision Interface, pages 120--123, 1995.
[19]
D. G. Lowe. Distinctive image features from scale-invariant keypoints. Journal of Computer Vision, 60(2):91--110, 2004.
[20]
C. Millet, I. Bloch, P. Hede, and P.-A. Moellic. Using relative spatial relationships to improve individual region recognition. In Proc. Integration of Knowledge, Semantic and Digital Media Technologies, pages 119--126, 2005.
[21]
D. Papadias and Y. Theodoridis. Spatial relations, minimum bounding rectangles, and spatial data structures. Journal of Geographical Information Science, 11(2):111--138, 1997.
[22]
T. V. Pham and A. W. M. Smeulders. Learning spatial relations in object recognition. Pattern Recognition Letters, 27(14):1673--1684, 2006.
[23]
G. Takacs, V. Chandrasekhar, N. Gelfand, Y. Xiong, W.-C. Chen, T. Bismpigiannis, R. Grzeszczuk, K. Pulli, and B. Girod. Outdoor augmented reality on mobile phone using loxel-based visual feature organization. In Multimedia Information Retrieval, 2008.
[24]
P. Viola and M. Jones. Robust real-time object detection. Technical report, Compaq CRL, 2002.
[25]
N. Wanas and M. Kamel. Decision fusion in neural network ensembles. Proc. Joint Conference on Neural Networks, 4:2952--2957, 2001.
[26]
L. Wiskott, J.-M. Fellous, N. Krüger, and C. von der Malsburg. Face recognition by elastic bunch graph matching. Journal of Pattern Analysis and Machine Intelligence, 19(7):775--779, 1997.

Cited By

View all
  • (2014)Level-of-detail AR: Managing points of interest for attentive augmented reality2014 IEEE International Conference on Consumer Electronics (ICCE)10.1109/ICCE.2014.6776037(351-352)Online publication date: Jan-2014
  • (2011)PhoneGuide: Adaptive Image Classification for Mobile Museum Guidance2011 International Symposium on Ubiquitous Virtual Reality10.1109/ISUVR.2011.12(1-4)Online publication date: Jul-2011

Recommendations

Reviews

Charalambos Poullis

This paper presents an "image classification technique for detecting multiple objects (called subobjects) in a single image." Unlike existing techniques, the proposed approach combines image classifiers and "spatial relationships among the subobjects to verify [the object locations] and to predict the locations of detected and undetected subobjects." The approach is then applied and evaluated in the context of a museum guidance system. On the positive side, the application is interesting and relevant. While there are previous examples of approaches to the solutions of this problem, it remains a fairly novel area of application. The approach provides an engaging and intuitive form of information presentation and should be of general interest to the mobile computing and user interface communities, and, to a lesser extent, the computer vision community. The paper is clear and quite well written, with few language errors. The paper has a number of weaknesses, though. The described techniques are relatively simple and straightforward, and seem to be a simple collection of known computer vision methods. Therefore, this paper is a systems/application paper, which is acceptable provided the application is new or the results are particularly outstanding, when compared to other previously published approaches. While the results appear good, the experimentation is, unfortunately, somewhat limited and of average complexity. There is only one real experiment with 12 subobject groups, each containing 3 to 8 subobjects; this is a relatively small and selective sample. In summary, the results are good and the approach is likely correct and promising, but the evaluation is somewhat limited. Online Computing Reviews Service

Access critical reviews of Computing literature here

Become a reviewer for Computing Reviews.

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences
IUI '09: Proceedings of the 14th international conference on Intelligent user interfaces
February 2009
522 pages
ISBN:9781605581682
DOI:10.1145/1502650
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 08 February 2009

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. image classification
  2. mobile computing
  3. museum guidance application
  4. spatial relationships
  5. subobject detection

Qualifiers

  • Research-article

Conference

IUI09
IUI09: 14th International Conference on Intelligent User Interfaces
February 8 - 11, 2009
Florida, Sanibel Island, USA

Acceptance Rates

Overall Acceptance Rate 746 of 2,811 submissions, 27%

Upcoming Conference

IUI '25

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)3
  • Downloads (Last 6 weeks)1
Reflects downloads up to 14 Nov 2024

Other Metrics

Citations

Cited By

View all
  • (2014)Level-of-detail AR: Managing points of interest for attentive augmented reality2014 IEEE International Conference on Consumer Electronics (ICCE)10.1109/ICCE.2014.6776037(351-352)Online publication date: Jan-2014
  • (2011)PhoneGuide: Adaptive Image Classification for Mobile Museum Guidance2011 International Symposium on Ubiquitous Virtual Reality10.1109/ISUVR.2011.12(1-4)Online publication date: Jul-2011

View Options

Get Access

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media