Document Type
Article
Publication Date
6-2024
Publisher
Springer Nature
Abstract
Using machine learning and deep learning methods to analyze text data from social media can effectively explore hidden emotional tendencies and evaluate the psychological state of social media account owners. However, the label noise caused by mislabeling may significantly influence the training and prediction results of traditional supervised models. To resolve this problem, this paper proposes a psychological evaluation method that incorporates a noisy label correction mechanism and designs an evaluation framework that consists of a primary classification model and a noisy label correction mechanism. Firstly, the social media text data are transformed into heterogeneous text graphs, and a classification model combining a pre-trained model with a graph neural network is constructed to extract semantic features and structural features, respectively. After that, the Gaussian mixture model is used to select the samples that are likely to be mislabeled. Then, soft labels are generated for them to enable noisy label correction without prior knowledge of the noise distribution information. Finally, the corrected and clean samples are composed into a new data set and re-input into the primary model for mental state classification. Results of experiments on three real data sets indicate that the proposed method outperforms current advanced models in classification accuracy and noise robustness under different noise ratio settings, and can efficiently explore the potential sentiment tendencies and users’ psychological states in social media text data.
Recommended Citation
Jin, Z., Su, R., Liu, Y., & Duan, C. (2024). A psychological evaluation method incorporating noisy label correction mechanism. Soft Computing, 28(11), 7395–7407. https://doi.org/10.1007/s00500-023-09479-w
Comments
Open Access - This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.