Nothing Special   »   [go: up one dir, main page]

skip to main content
10.1145/1460096.1460150acmconferencesArticle/Chapter ViewAbstractPublication PagesmmConference Proceedingsconference-collections
research-article

Improving object detection by removing noisy samples from training sets

Published: 30 October 2008 Publication History

Abstract

Object detection is often formulated as a binary classification task with supervised learning that involves training datasets. Noisy samples, including mislabeled samples and ``hard-to-learn" samples, are usually found in training datasets. Such samples have a detrimental effect on the generalization performance of trained classifiers and are required to be pruned. In this paper, we propose a novel data pruning algorithm that is based on recursive Bayes approach and AdaBoost. Recursive Bayes approach increases the confidence of predictions in every iteration, while AdaBoost minimizes the number of predictions that have low confidence. Extensive experiments on real datasets show the effectiveness of the proposed algorithm in identifying and pruning noisy samples from training datasets and concurrently improving the performance of classification and object detection.

References

[1]
M. Alvira and R. Rifkin. An empirical comparison of snow and svms for face detection. A. I. memo 2001--004, CBCL, MIT, Cambridge, MA, 2001.
[2]
A. Angelova, Y. Abu-Mostafa, and P. Perona. Pruning training sets for learning of object categories. In CVPR, 2005.
[3]
R. O. Duda, P. E. Hart, and D. G. Stork. Pattern Classification. Wiley Interscience, 2nd edition, 2000.
[4]
V. J. Hodge and J. Austin. A survey of outlier detection methodologies. Artificial Intelligence Review, 22(2), 2004.
[5]
R. Lienhart, A. Kuranov, and V. Pisarevsky. Empirical analysis of detection cascades of boosted classifiers for rapid object detection. In 25th Pattern Recognition Symposium, 2003.
[6]
C.-J. Lin, R. C. Weng, and S. S. Keerthi. Trust region newton method for large-scale logistic regression. In ICML, 2007.
[7]
A. Nicholson. Generalization Error Estimates and Training Data Evaluation. PhD thesis, California Institute of Technology, California, 2002.
[8]
R. E. Schapire, Y. Freund, P. Bartlett, and W. S. Lee. Boosting the margin: a new explanation for the effectiveness of voting methods. In ICML, 1997.
[9]
A. Vezhnevets and O. Barinova. Avoiding boosting overfitting by removing confusing samples. In ECML, 2007.
[10]
P. Viola and M. Jones. Rapid object detection using a boosted cascade of simple features. In CVPR, 2001.
[11]
I. H. Witten and E. Frank. Data Mining: Practical Machine Learning Tools and Techniques. Morgan Kaufmann, second edition, 2005.
[12]
J. Wu, M. D. Mullin, and J. M. Rehg. Linear asymmetric classifier for cascade detectors. In ICML, 2005.
[13]
H. Xiong, G. Pandey, M. Steinbach, and V. Kumar. Enhancing data analysis with noise removal. IEEE Trans. on Knowledge and Data Eng., 18(3), 2006.

Cited By

View all
  • (2009)Enhancing Concept Detection by Pruning Data with MCA-Based Transaction WeightsProceedings of the 2009 11th IEEE International Symposium on Multimedia10.1109/ISM.2009.125(304-311)Online publication date: 14-Dec-2009

Index Terms

  1. Improving object detection by removing noisy samples from training sets

      Recommendations

      Comments

      Please enable JavaScript to view thecomments powered by Disqus.

      Information & Contributors

      Information

      Published In

      cover image ACM Conferences
      MIR '08: Proceedings of the 1st ACM international conference on Multimedia information retrieval
      October 2008
      506 pages
      ISBN:9781605583129
      DOI:10.1145/1460096
      Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

      Sponsors

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      Published: 30 October 2008

      Permissions

      Request permissions for this article.

      Check for updates

      Author Tags

      1. adaboost
      2. data pruning
      3. noisy samples
      4. recursive bayes

      Qualifiers

      • Research-article

      Conference

      MM08
      Sponsor:
      MM08: ACM Multimedia Conference 2008
      October 30 - 31, 2008
      British Columbia, Vancouver, Canada

      Contributors

      Other Metrics

      Bibliometrics & Citations

      Bibliometrics

      Article Metrics

      • Downloads (Last 12 months)1
      • Downloads (Last 6 weeks)0
      Reflects downloads up to 14 Dec 2024

      Other Metrics

      Citations

      Cited By

      View all
      • (2009)Enhancing Concept Detection by Pruning Data with MCA-Based Transaction WeightsProceedings of the 2009 11th IEEE International Symposium on Multimedia10.1109/ISM.2009.125(304-311)Online publication date: 14-Dec-2009

      View Options

      Login options

      View options

      PDF

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader

      Media

      Figures

      Other

      Tables

      Share

      Share

      Share this Publication link

      Share on social media