Nothing Special   »   [go: up one dir, main page]

skip to main content
research-article

Label distribution learning with noisy labels via three-way decisions

Published: 01 November 2022 Publication History

Abstract

Label distribution learning (LDL) as a soft-labeling paradigm is allowed to learn single or multi-labeled information distribution. Overwhelmingly, in the open world, the distribution of labels is usually disturbed by the noise (such as the man-made induction bias, shake of hardware devices), which in turn affects the decision of downstream tasks. To address this problem, we propose a novel LDL approach by using the three-way decisions theory to clear the amplified noise in this paper. First, we evaluate the confidence of each training sample and use a three-way decisions-based method to identify the trustworthy samples and the noisy samples. Second, we apply the sample correlation between the trustworthy samples and the noisy samples to correct the noisy labels. Finally, we re-weight every sample based on the learned confidences to train the robust LDL model. Experiments show that our approach has better performance in handling noisy data compared to existing algorithms.

References

[1]
G. Tsoumakas, I. Katakis, Multi-label classification: an overview, Int. J. Data Warehous. Min. 3 (3) (2009) 1–13.
[2]
X. Geng, Label distribution learning, IEEE Trans. Knowl. Data Eng. 28 (7) (2016) 1734–1748.
[3]
X. Geng, L. Luo, Multilabel ranking with inconsistent rankers, in: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2014, pp. 3742–3747.
[4]
H. Huang, S. Cheng, Z. Hong, L. Xu, Label distribution learning based age-invariant face recognition, in: Pacific-Asia Conference on Knowledge Discovery and Data Mining, Springer, 2019, pp. 214–222.
[5]
Y. Ren, X. Geng, Sense beauty by label distribution learning, in: Proceedings of the 26th International Joint Conference on Artificial Intelligence, 2017, pp. 2648–2654.
[6]
X. Geng, C. Yin, Z. Zhou, Facial age estimation by learning from label distributions, IEEE Trans. Pattern Anal. Mach. Intell. 35 (10) (2013) 2401–2412.
[7]
P. Li, Y. Hu, X. Wu, R. He, Z. Sun, Deep label refinement for age estimation, Pattern Recognit. 100 (2020).
[8]
H. Zhang, Y. Zhang, X. Geng, Practical age estimation using deep label distribution learning, Front. Comput. Sci. 15 (3) (2021) 1–6.
[9]
L. Xu, J. Chen, Y. Gan, Head pose estimation using improved label distribution learning with fewer annotations, Multimed. Tools Appl. 78 (14) (2019) 19141–19162.
[10]
X. Geng, X. Qian, Z. Huo, Y. Zhang, Head pose estimation based on multivariate label distribution, IEEE Trans. Pattern Anal. Mach. Intell. 44 (4) (2022) 1974–1991.
[11]
Z. Zhang, M. Wang, X. Geng, Crowd counting in public video surveillance by label distribution learning, Neurocomputing 166 (2015) 151–163.
[12]
X. Zheng, X. Jia, W. Li, Label distribution learning by exploiting sample correlations locally, in: Proceedings of the AAAI Conference on Artificial Intelligence, vol. 32, 2018, pp. 4556–4563.
[13]
W. Shen, K. Zhao, Y. Guo, A.L. Yuille, Label distribution learning forests, Adv. Neural Inf. Process. Syst. 30 (2017).
[14]
B. Gao, C. Xing, C. Xie, J. Wu, X. Geng, Deep label distribution learning with label ambiguity, IEEE Trans. Image Process. 26 (6) (2017) 2825–2838.
[15]
T. Ren, X. Jia, W. Li, L. Chen, Z. Li, Label distribution learning with label-specific features, in: Proceedings of the 28th International Joint Conference on Artificial Intelligence, ijcai.org, 2019, pp. 3318–3324.
[16]
B. Han, Q. Yao, X. Yu, G. Niu, M. Xu, W. Hu, I. Tsang, M. Sugiyama, Co-teaching: robust training of deep neural networks with extremely noisy labels, Adv. Neural Inf. Process. Syst. 31 (2018).
[17]
Y. Liu, N. Xu, Y. Zhang, X. Geng, Label distribution for learning with noisy labels, in: Proceedings of the 29th International Joint Conference on Artificial Intelligence, 2021, pp. 2568–2574.
[18]
M. Xie, S. Huang, Partial multi-label learning with noisy label identification, IEEE Trans. Pattern Anal. Mach. Intell. (2021).
[19]
B. Nicholson, V.S. Sheng, J. Zhang, Label noise correction and application in crowdsourcing, Expert Syst. Appl. 66 (2016) 149–162.
[20]
H. Zhang, L. Jiang, W. Xu, Multiple noisy label distribution propagation for crowdsourcing, in: Proceedings of the 28th International Joint Conference on Artificial Intelligence, 2019, pp. 1473–1479.
[21]
Y. Yao, Three-way decisions with probabilistic rough sets, Inf. Sci. 180 (3) (2010) 341–353.
[22]
H. Jiang, B. Hu, An optimization viewpoint on evaluation-based interval-valued multi-attribute three-way decision model, Inf. Sci. 603 (2022) 60–90.
[23]
G. Lang, J. Luo, Y. Yao, Three-way conflict analysis: a unification of models based on rough sets and formal concept analysis, Knowl.-Based Syst. 194 (2020).
[24]
J. Ye, J. Zhan, Z. Xu, A novel decision-making approach based on three-way decisions in fuzzy information systems, Inf. Sci. 541 (2020) 362–390.
[25]
J. Li, C. Huang, J. Qi, Y. Qian, W. Liu, Three-way cognitive concept learning via multi-granularity, Inf. Sci. 378 (2017) 244–263.
[26]
X. Jia, W. Li, L. Shang, A multiphase cost-sensitive learning method based on the multiclass three-way decision-theoretic rough set model, Inf. Sci. 485 (2019) 248–262.
[27]
H. Yu, X. Wang, G. Wang, X. Zeng, An active three-way clustering method via low-rank matrices for multi-view data, Inf. Sci. 507 (2020) 823–839.
[28]
S. Cheng, Y. Wu, Y. Li, F. Yao, F. Min, Twd-sfnn: three-way decisions with a single hidden layer feedforward neural network, Inf. Sci. 579 (2021) 15–32.
[29]
Y. Yao, Granular computing and sequential three-way decisions, in: International Conference on Rough Sets and Knowledge Technology, Springer, 2013, pp. 16–27.
[30]
H. Yu, G. Wang, B. Hu, X. Jia, H. Li, T. Li, D. Liang, J. Liang, B. Liu, D. Liu, et al., Methods and practices of three-way decisions for complex problem solving, in: International Conference on Rough Sets and Knowledge Technology, Springer, 2015, pp. 255–265.
[31]
B. Zhou, Y. Yao, J. Luo, Cost-sensitive three-way email spam filtering, J. Intell. Inf. Syst. 42 (1) (2014) 19–45.
[32]
X. Jia, K. Zheng, W. Li, T. Liu, L. Shang, Three-way decisions solution to filter spam email: an empirical study, in: International Conference on Rough Sets and Current Trends in Computing, Springer, 2012, pp. 287–296.
[33]
X. Jia, Z. Deng, F. Min, D. Liu, Three-way decisions based feature fusion for Chinese irony detection, Int. J. Approx. Reason. 113 (2019) 324–335.
[34]
C. Xu, S. Gu, H. Tao, C. Hou, Fragmentary label distribution learning via graph regularized maximum entropy criteria, Pattern Recognit. Lett. 145 (2021) 147–156.
[35]
J.P. Herbert, J. Yao, Learning optimal parameters in decision-theoretic rough sets, in: International Conference on Rough Sets and Knowledge Technology, Springer, 2009, pp. 610–617.
[36]
J.P. Herbert, J. Yao, Game-theoretic rough sets, Fundam. Inform. 108 (3–4) (2011) 267–286.
[37]
M. Xu, Z. Zhou, Incomplete label distribution learning, in: Proceedings of the 26th International Joint Conference on Artificial Intelligence, 2017, pp. 3175–3181.
[38]
D.P. Kingma, J. Ba, Adam: a method for stochastic optimization, in: Proceedings of the International Conference for Learning Representations, 2015.
[39]
M.B. Eisen, P.T. Spellman, P.O. Brown, D. Botstein, Cluster analysis and display of genome-wide expression patterns, Proc. Natl. Acad. Sci. 95 (25) (1998) 14863–14868.
[40]
J. Yu, D. Jiang, K. Xiao, Y. Jin, J. Wang, X. Sun, Discriminate the falsely predicted protein-coding genes in Aeropyrum pernix k1 genome based on graphical representation, Match 67 (3) (2012) 845.
[41]
J. Wang, X. Geng, Theoretical analysis of label distribution learning, in: Proceedings of the AAAI Conference on Artificial Intelligence, vol. 33, 2019, pp. 5256–5263.

Cited By

View all

Index Terms

  1. Label distribution learning with noisy labels via three-way decisions
        Index terms have been assigned to the content through auto-classification.

        Recommendations

        Comments

        Please enable JavaScript to view thecomments powered by Disqus.

        Information & Contributors

        Information

        Published In

        cover image International Journal of Approximate Reasoning
        International Journal of Approximate Reasoning  Volume 150, Issue C
        Nov 2022
        337 pages

        Publisher

        Elsevier Science Inc.

        United States

        Publication History

        Published: 01 November 2022

        Author Tags

        1. Noisy data
        2. Label distribution learning
        3. Three-way decisions

        Qualifiers

        • Research-article

        Contributors

        Other Metrics

        Bibliometrics & Citations

        Bibliometrics

        Article Metrics

        • 0
          Total Citations
        • 0
          Total Downloads
        • Downloads (Last 12 months)0
        • Downloads (Last 6 weeks)0
        Reflects downloads up to 04 Oct 2024

        Other Metrics

        Citations

        Cited By

        View all

        View Options

        View options

        Get Access

        Login options

        Media

        Figures

        Other

        Tables

        Share

        Share

        Share this Publication link

        Share on social media