Synonyms
Image indexing; Video indexing
Definition
Visual content analysis is the process of deriving meaningful descriptors for image and video data. These descriptors are the basis for searching large image and video collections. In practice, before the process starts, one applies image processing techniques which take the visual data, apply an operator, and return other visual data with less noise or specific characteristics of the visual data emphasized. The analysis considered in this contribution starts from here, ultimately aiming at semantic descriptors.
Historical Background
Analyzing the content of visual data using computers has a long history, dating back to the 1960s. Some initial successes prompted researchers in the 1970s to predict that the problem of understanding visual material would soon be solved completely. However, the research in the 80s showed that these predictions were far too optimistic. Even now, understanding visual data is still a major challenge.
In the...
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Recommended Reading
Chang CC, Lin CJ. LIBSVM: a library for support vector machines. 2001. Software available at: http://www.csie.ntu.edu.tw/~cjlin/libsvm/.
Everingham M, van Gool L, Williams C, Winn J, Zisserman A. The PASCAL visual object classes homepage. Available at: http://www.pascal-network.org/challenges/VOC/.
Gemert J, Geusebroek J, Veenman C, Snoek C, Smeulders A. Robust scene categorization by learning image statistics in context. In: Proceedings of the International Workshop on Semantic Learning Applications in Multimedia; 2006.
Geusebroek J, Boomgaard R, Smeulders A, Geerts H. Color invariance. IEEE Trans Pattern Anal Mach Intell. 2001;23(12):1338–50.
Jain A, Duin R, Mao J. Statistical pattern recognition: a review. IEEE Trans Pattern Anal Mach Intell. 2000;22(1):4–37.
Jiang YG, Ngo CW, Yang J. VIREO-374: LSCOM semantic concept detectors using local keypoint features. Available at: http://www.cs.cityu.edu.hk/~yjiang/vireo374/.
Lowe DG. Distinctive image features from scale-invariant keypoints. Int J Comput Vis. 2004;60(2):91–110.
Sikora T. The MPEG-7 visual standard for content description-an overview. IEEE Trans Circ Syst Video Tech. 2001;11(6):696–702.
Smeaton A. Large scale evaluations of multimedia information retrieval: the TRECVid experience. In: Proceedings of the 4th International Conference on Image and Video Retrieval; 2005. p. 19–27.
Smeulders A, Worring M, Santini S, Gupta A, Jain R. Content based image retrieval at the end of the early years. IEEE Trans Pattern Anal Mach Intell. 2000;22(12):1349–80.
Snoek C, Worring M. Multimodal video indexing: a review of the state-of-the-art. Multimed Tool Appl. 2005;25(1):5–35.
Snoek C, Worring M, van Gemert JC, Geusebroek JM, Smeulders A. The challenge problem for automated detection of 101 semantic concepts in multimedia. In: Proceedings of the 14th ACM International Conference on Multimedia; 2006.
Snoek C, Worring M, Geusebroek J, Koelma D, Seinstra F, Smeulders A. The semantic pathfinder: using an authoring metaphor for generic multimedia indexing. IEEE Trans Pattern Analy Mechine Intell. 2006;28(10):1678–89.
Vapnik V. The nature of statistical learning theory. New York: Springer; 2000.
Yanagawa A, Chang SF, Kennedy L, Hsu W. Columbia university’s baseline detectors for 374 LSCOM semantic visual concepts. Columbia University, 2007. aDVENT technical report 222-2006-8.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Section Editor information
Rights and permissions
Copyright information
© 2018 Springer Science+Business Media, LLC, part of Springer Nature
About this entry
Cite this entry
Worring, M., Snoek, C. (2018). Visual Content Analysis. In: Liu, L., Özsu, M.T. (eds) Encyclopedia of Database Systems. Springer, New York, NY. https://doi.org/10.1007/978-1-4614-8265-9_1019
Download citation
DOI: https://doi.org/10.1007/978-1-4614-8265-9_1019
Published:
Publisher Name: Springer, New York, NY
Print ISBN: 978-1-4614-8266-6
Online ISBN: 978-1-4614-8265-9
eBook Packages: Computer ScienceReference Module Computer Science and Engineering