research-article

Face annotation for personal photos using context-assisted face recognition

Authors:

Jae Young Choi,

Konstantinos N. PlataniotisAuthors Info & Claims

MIR '08: Proceedings of the 1st ACM international conference on Multimedia information retrieval

Pages 44 - 51

https://doi.org/10.1145/1460096.1460106

Published: 30 October 2008 Publication History

Abstract

Face annotation for personal photos has a number of potential applications in Multimedia Information Retrieval (MIR). We propose a novel face annotation method that systematically combines contextual information of photos with traditional Face Recognition (FR) technologies. To overcome the limitations of conventional FR-based annotation approaches, situation and person clustering methods are proposed based on context of personal photos. By relying on the proposed clustering methods, multiple facial images that belong to the same person are applied to subspace FR methods. This allows traditional FR methods to take the advantages of feature- or measurement-level fusion strategies for automatic annotation of faces on personal photos. The effectiveness of the proposed method was successfully tested on 1,120 personal photos selected from standard MPEG-7 Visual Core Experiment 3 (VCE-3). Extensive experimental results showed that the proposed method improves annotation accuracy by at least an order of magnitude compared with conventional FR-based approaches.

References

[1]

K. Rodden and K. R. Wood, "How do people manage their digital photographs," Proc. of ACM. on Human Factors in Computing Systems, 2003.

Digital Library

[2]

A. Girgensohh, J. Adcock, and L. Wilcox, "Leveraging Face Recognition Technology to Find and Organize Photos," Proc. of ACM conf. on MIR, 2004.

Digital Library

[3]

R. Chellappa, C. L. Wilson, and S. Sirohey, "Human and Machine Recognition of Faces: A Survey," Proc. IEEE, vol. 83, no. 5, pp. 705--740, 1995.

[4]

B. Suh and B. B. Bederson, "Semi-automatic photo annotation strategies using event based clustering and clothing based person recognition," International Journal of Interacting with Computers, vol. 19, no. 2, pp. 524--544, 2007.

Digital Library

[5]

L. Zhang, Y. Hu, M. Li, W. Ma, and H.J. Zhang, "Efficient Propagation for Face Annotation in Family Albums," Proc. of ACM conf. on MM, 2004.

Digital Library

[6]

L. Chen, B. Hu, L. Zhang, M. Li, and H.J. Zhang, "Face annotation for family photo album management," International Journal of Image and Graphics, vol. 3, no. 1, pp. 1--14, 2003.

[7]

S. Cooray et al., "Identifying Person Reoccurrences for Personal Photo Management Applications," Proc. of IEEE conf. on VIE, 2006.

Digital Library

[8]

A. Jain, K. Nandakumar, and A. Ross, "Score normalization in multimodal biometric systems," Pattern Recognit., vol. 38, no. 12, pp. 2270--2285, 2005.

Digital Library

[9]

J. Yang, J.Y. Yang, D. Zhang, and J.F Lu, "Feature Fusion: Parallel Strategy vs. Serial Strategy," Pattern Recognit, vol. 36, no. 2, pp. 1369--1381, 2003.

[10]

M. A. Turk and A. P. Pentland, "Eigenfaces for Recognition," J. Cognitive Neurosci., vol. 3, no. 1, pp. 71--86, 1991.

Digital Library

[11]

P. N. Belhumeur, J. P. Hesphanha, and D. J. Kriegman, "Eigenfaces vs. Fisherfaces: Recognition Using Class Specific Linear Projection," IEEE Trans. on PAMI, vo1. 9, no. 7, pp. 711--720, 1997.

Digital Library

[12]

B. Moghaddam, T. Jebara, and A. Pentland, "Bayesian face recognition," Pattern Recognit., vol. 33, no. 11, pp. 1771--1782, 2000.

[13]

M. Bober, S.K. Bober, "Description of MPEG-7 Visual Core Experiments," MPEG-7 Visual Group ISO/IEC JTC1/SC29/WG11, N6905, 2005

[14]

J. Wang, K. N. Plataniotis, J. Lu, and A. N. Venetsanopoulos, "On solving the face recognition problem with one training sample per subject," Pattern Recognit., vol. 39, no. 6, pp. 1746--1762, 2006.

Digital Library

[15]

T. Sim, S. Baker, and M. Bsat, "The CMU Pose, Illumination, and Expression Database," IEEE Trans. on PAMI, vol. 25, no. 12, pp. 1615--1618, 2003.

Digital Library

[16]

P. J. Phillips, H. Moon, S. A. Rizvi, and P. J. Rauss, "The FERET Evaluation Methodology for Face Recognition Algorithms," IEEE Trans. on PAMI., vol. 22, no. 10, pp. 1090--1104, 2000.

Digital Library

[17]

"Exchangeable image file format for digital still cameras: Exif Version 2.2 (JEITA CP-3451)," Standard of Japan Electronics and Information Technology Industries Association, 2002.

[18]

S. Yang, S. K. Kim, K. S. Seo, and Y. M. Ro. "Automated Situation Change Clustering of Home Photos for Digital Albuming," Proc. of SPIE on Electronic Imaging, 2005.

[19]

C.-L. Liu, "Classifier combination based on confidence transformation," Pattern Recognit., vol. 38, no. 1, pp. 11--28, 2005.

Digital Library

Cited By

Andrade DMaia LFigueirêdo HViana WTrinta FSouza Baptista C(2018)Photo annotationMultimedia Tools and Applications10.1007/s11042-016-4281-677:1(423-457)Online publication date: 1-Jan-2018
https://dl.acm.org/doi/10.1007/s11042-016-4281-6
Kader MBoedihardjo AHossain M(2018)F2ConText: how to extract holistic contexts of persons of interest for enhancing exploratory analysisKnowledge and Information Systems10.1007/s10115-018-1304-9Online publication date: 17-Dec-2018
https://doi.org/10.1007/s10115-018-1304-9
Jamil NSa'dan S(2014)Automated face annotation for personal photo management2014 International Conference on Computational Science and Technology (ICCST)10.1109/ICCST.2014.7045176(1-5)Online publication date: Aug-2014
https://doi.org/10.1109/ICCST.2014.7045176
Show More Cited By

Index Terms

Face annotation for personal photos using context-assisted face recognition
1. Computing methodologies
  1. Artificial intelligence
    1. Computer vision
2. Information systems
  1. Information retrieval
    1. Document representation
    2. Search engine architectures and scalability
      1. Search engine indexing

Recommendations

Collaborative Face Recognition for Improved Face Annotation in Personal Photo Collections Shared on Online Social Networks

Using face annotation for effective management of personal photos in online social networks (OSNs) is currently of considerable practical interest. In this paper, we propose a novel collaborative face recognition (FR) framework, improving the accuracy ...
Automatic Face Annotation in Personal Photo Collections Using Context-Based Unsupervised Clustering and Face Information Fusion

In this paper, a novel face annotation framework is proposed that systematically leverages context information such as situation awareness information with current face recognition (FR) solutions. In particular, unsupervised situation and subject ...
Face annotation for personal photos using collaborative face recognition in online social networks
DSP'09: Proceedings of the 16th international conference on Digital Signal Processing

Automatic face annotation (or tagging) facilitates improved retrieval and organization of personal photos in online social networks. In this paper, we present a new collaborative face recognition (FR) method that aims to improve face annotation ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

MIR '08: Proceedings of the 1st ACM international conference on Multimedia information retrieval

October 2008

506 pages

ISBN:9781605583129

DOI:10.1145/1460096

General Chair:
Michael S. Lew
Leiden University, The Netherlands
,
Program Chairs:
Alberto del Bimbo
University of Florence, Italy
,
Erwin M. Bakker
Leiden University, The Netherlands

Copyright © 2008 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 30 October 2008

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

MM08

Sponsor:

MM08: ACM Multimedia Conference 2008

October 30 - 31, 2008

British Columbia, Vancouver, Canada

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

22
Total Citations
View Citations
476
Total Downloads

Downloads (Last 12 months)2
Downloads (Last 6 weeks)1

Reflects downloads up to 18 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Andrade DMaia LFigueirêdo HViana WTrinta FSouza Baptista C(2018)Photo annotationMultimedia Tools and Applications10.1007/s11042-016-4281-677:1(423-457)Online publication date: 1-Jan-2018
https://dl.acm.org/doi/10.1007/s11042-016-4281-6
Kader MBoedihardjo AHossain M(2018)F2ConText: how to extract holistic contexts of persons of interest for enhancing exploratory analysisKnowledge and Information Systems10.1007/s10115-018-1304-9Online publication date: 17-Dec-2018
https://doi.org/10.1007/s10115-018-1304-9
Jamil NSa'dan S(2014)Automated face annotation for personal photo management2014 International Conference on Computational Science and Technology (ICCST)10.1109/ICCST.2014.7045176(1-5)Online publication date: Aug-2014
https://doi.org/10.1109/ICCST.2014.7045176
Jamil NSa'dan SNarawi AGobil A(2014)Attire-based photo annotation2014 IEEE Conference on e-Learning, e-Management and e-Services (IC3e)10.1109/IC3e.2014.7081257(144-149)Online publication date: Dec-2014
https://doi.org/10.1109/IC3e.2014.7081257
Lo Presti LLa Cascia M(2014)Concurrent photo sequence organizationMultimedia Tools and Applications10.1007/s11042-012-1079-z68:3(777-803)Online publication date: 1-Feb-2014
https://dl.acm.org/doi/10.1007/s11042-012-1079-z
Monaghan FHandschuh SO’Sullivan D(2013)ACRONYMSemantic Web10.4018/978-1-4666-3610-1.ch009(201-234)Online publication date: 2013
https://doi.org/10.4018/978-1-4666-3610-1.ch009
Moura EGomes HCarvalho J(2013)An Improved Face Verification Approach Based on Speedup Robust Features and Pairwise MatchingProceedings of the 2013 XXVI Conference on Graphics, Patterns and Images10.1109/SIBGRAPI.2013.57(362-369)Online publication date: 5-Aug-2013
https://dl.acm.org/doi/10.1109/SIBGRAPI.2013.57
Brenner MIzquierdo E(2013)Recognizing people by face and body in Photo Collections2013 10th IEEE International Conference and Workshops on Automatic Face and Gesture Recognition (FG)10.1109/FG.2013.6553751(1-7)Online publication date: Apr-2013
https://doi.org/10.1109/FG.2013.6553751
Monaghan FHandschuh SO'Sullivan D(2011)ACRONYMInternational Journal on Semantic Web & Information Systems10.4018/jswis.20111001017:4(1-35)Online publication date: 1-Oct-2011
https://dl.acm.org/doi/10.4018/jswis.2011100101
Kim JLee SWon JMoon Y(2011)Photo CubeProceedings of the 2011 IEEE Ninth International Conference on Dependable, Autonomic and Secure Computing10.1109/DASC.2011.199(1228-1234)Online publication date: 12-Dec-2011
https://dl.acm.org/doi/10.1109/DASC.2011.199
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents