Nothing Special   »   [go: up one dir, main page]

skip to main content
10.5555/2981780.2981877guideproceedingsArticle/Chapter ViewAbstractPublication PagesnipsConference Proceedingsconference-collections
Article

Multi-label multiple kernel learning

Published: 08 December 2008 Publication History

Abstract

We present a multi-label multiple kernel learning (MKL) formulation in which the data are embedded into a low-dimensional space directed by the instance-label correlations encoded into a hypergraph. We formulate the problem in the kernel-induced feature space and propose to learn the kernel matrix as a linear combination of a given collection of kernel matrices in the MKL framework. The proposed learning formulation leads to a non-smooth min-max problem, which can be cast into a semi-infinite linear program (SILP). We further propose an approximate formulation with a guaranteed error bound which involves an unconstrained convex optimization problem. In addition, we show that the objective function of the approximate formulation is differentiable with Lipschitz continuous gradient, and hence existing methods can be employed to compute the optimal solution efficiently. We apply the proposed formulation to the automated annotation of Drosophila gene expression pattern images, and promising results have been reported in comparison with representative algorithms.

References

[1]
S. Agarwal, K. Branson, and S. Belongie. Higher order learning with graphs. In ICML, pages 17-24, 2006.
[2]
D. Zhou, J. Huang, and B. Schölkopf. Learning with hypergraphs: Clustering, classification, and embedding. In NIPS, pages 1601-1608. 2007.
[3]
Z. H. Zhou and M. L. Zhang. Multi-instance multi-label learning with application to scene classification. In NIPS, pages 1609-1616. 2007.
[4]
D. R. Hardoon, S. R. Szedmak, and J. R. Shawe-taylor. Canonical correlation analysis: An overview with application to learning methods. Neural Computation, 16(12):2639-2664, 2004.
[5]
Y. Nesterov. Introductory Lectures on Convex Optimization: A Basic Course. Springer, 2003.
[6]
Y. Nesterov. Smooth minimization of non-smooth functions. Mathematical Programming, 103(1):127-152, 2005.
[7]
P. Tomancak and et al. Systematic determination of patterns of gene expression during Drosophila embryogenesis. Genome Biology, 3(12), 2002.
[8]
S. Ji, L. Sun, R. Jin, S. Kumar, and J. Ye. Automated annotation of Drosophila gene expression patterns using a controlled vocabulary. Bioinformatics, 24(17):1881-1888, 2008.
[9]
K. Grauman and T. Darrell. Approximate correspondences in high dimensions. In NIPS, pages 505-512. 2006.
[10]
F. R. K. Chung. Spectral Graph Theory. American Mathematical Society, 1997.
[11]
S. Schölkopf and A. Smola. Learning with Kernels: Support Vector Machines, Regularization, Optimization and Beyond. MIT Press, 2002.
[12]
G. R. G. Lanckriet, N. Cristianini, P. Bartlett, L. E. Ghaoui, and M. I. Jordan. Learning the kernel matrix with semidefinite programming. Journal of Machine Learning Research, 5:27-72, 2004.
[13]
R. Hettich and K. O. Kortanek. Semi-infinite programming: Theory, methods, and applications. SIAM Review, 35(3):380-429, 1993.
[14]
S. Sonnenburg, G. Rätsch, C. Schäfer, and B. Schölkopf. Large scale multiple kernel learning. Journal of Machine Learning Research, 7:1531-1565, July 2006.
[15]
K. Mikolajczyk and C. Schmid. A performance evaluation of local descriptors. IEEE Transactions on Pattern Analysis and Machine Intelligence, 27(10):1615-1630, 2005.

Cited By

View all
  • (2017)2,1 norm regularized multi-kernel based joint nonlinear feature selection and over-sampling for imbalanced data classificationNeurocomputing10.1016/j.neucom.2016.12.036234:C(38-57)Online publication date: 19-Apr-2017
  • (2017)Classifying biomedical knowledge in PubMed using multi-label vector machines with weaker optimization constraintsNeural Computing and Applications10.1007/s00521-016-2439-928:1(1233-1243)Online publication date: 1-Jan-2017
  • (2014)Multi-label image classification with a probabilistic label enhancement modelProceedings of the Thirtieth Conference on Uncertainty in Artificial Intelligence10.5555/3020751.3020796(430-439)Online publication date: 23-Jul-2014
  • Show More Cited By

Recommendations

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image Guide Proceedings
NIPS'08: Proceedings of the 21st International Conference on Neural Information Processing Systems
December 2008
2000 pages
ISBN:9781605609492

Publisher

Curran Associates Inc.

Red Hook, NY, United States

Publication History

Published: 08 December 2008

Qualifiers

  • Article

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)0
  • Downloads (Last 6 weeks)0
Reflects downloads up to 25 Nov 2024

Other Metrics

Citations

Cited By

View all
  • (2017)2,1 norm regularized multi-kernel based joint nonlinear feature selection and over-sampling for imbalanced data classificationNeurocomputing10.1016/j.neucom.2016.12.036234:C(38-57)Online publication date: 19-Apr-2017
  • (2017)Classifying biomedical knowledge in PubMed using multi-label vector machines with weaker optimization constraintsNeural Computing and Applications10.1007/s00521-016-2439-928:1(1233-1243)Online publication date: 1-Jan-2017
  • (2014)Multi-label image classification with a probabilistic label enhancement modelProceedings of the Thirtieth Conference on Uncertainty in Artificial Intelligence10.5555/3020751.3020796(430-439)Online publication date: 23-Jul-2014
  • (2013)Multi-label learning with millions of labelsProceedings of the 22nd international conference on World Wide Web10.1145/2488388.2488391(13-24)Online publication date: 13-May-2013
  • (2010)Large scale max-margin multi-label classification with priorsProceedings of the 27th International Conference on International Conference on Machine Learning10.5555/3104322.3104377(423-430)Online publication date: 21-Jun-2010
  • (2010)Multi-label multiple kernel learning by stochastic approximationProceedings of the 23rd International Conference on Neural Information Processing Systems - Volume 110.5555/2997189.2997226(325-333)Online publication date: 6-Dec-2010

View Options

View options

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media