Nothing Special   »   [go: up one dir, main page]
Skip to main content

Advertisement

Springer Nature Link
Log in

KHACDD: a knowledge-based hybrid method for multilabel sentiment analysis on complex sentences using attentive capsule and dual structured recurrent network

  • Original Article
  • Published:
Neural Computing and Applications Aims and scope Submit manuscript

Abstract

Using a machine to mine public opinion saves money and time. Traditional sentiment analysis approaches are typically unable to handle multi-meaning phrases, syntactically complex structured statements, and a large number of characteristics. We proposed a new knowledge-based hybrid deep learning method (KHACDD) for sentiment classification that integrates a hierarchical attention-based capsule infrastructure with both the dual along with bidirectional recurrent neural network (RNN), Dilated convolutional neural network (CNN), and domain-based knowledge to fix these problems. Our innovative hybrid approach enhances the structure of feature representation as well as feature extraction as well as sentiment classification by dynamically routing capsules its hierarchy structure toward an attention capsule. The suggested hybrid neural network model is based on modified capsules and therefore can learn implicit semantics effectively. The BiGRU-BiLSTM is used all through this system to achieve proper long-distance and interdependent contextual information functioning. In addition, the capsule network may be capable of extracting rich textual information in order to improve express ability. GloVe embedding is used before the RNN layer to incorporate local context into global statistics. To improve performance, the proposed technique leveraged domain-specific information to handle misclassification. Adding adaptive domain-specific knowledge produces a margin of roughly 1% for multilabel ER(Emotion Recognition) social media data as well as 4% for multifeatured and multilabel MHER(Mental Health Emotion Recognition) clinical data, according to the experimental results. In the future, we will improve our model to handle more classes of sentiment with less complexity.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Algorithm 1
Fig. 1
Fig. 2
Algorithm 2
Algorithm 3
Algorithm 4
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15
Fig. 16

Similar content being viewed by others

Explore related subjects

Discover the latest articles, news and stories from top researchers in related subjects.

Data availability

All the data and information can be found in the GitHub repository. The relevant data can be accessed at the following location: .

References

  1. AlBadani B, Shi R, Dong J (2022) A novel machine learning approach for sentiment analysis on twitter incorporating the universal language model fine-tuning and svm. Appl Syst Innov 5:13

    Article  Google Scholar 

  2. Bilal M, Almazroi AA (2023) Effectiveness of fine-tuned bert model in classification of helpful and unhelpful online customer reviews. Electron Commer Res 23:2737–2757

    Article  Google Scholar 

  3. Chiny M, Chihab M, Bencharef O, Chihab Y (2021). Lstm, vader and tf-idf based hybrid sentiment analysis model. Int J Adv Comput Sci Appl, 121

  4. Cho K, Van Merriënboer B, Gulcehre C, Bahdanau D, Bougares F, Schwenk H, Bengio Y (2014). Learning phrase representations using rnn encoder-decoder for statistical machine translation. arXiv preprint arXiv:1406.1078

  5. Dong Y, Fu Y, Wang L, Chen Y, Dong Y, Li J (2020) A sentiment analysis method of capsule network based on bilstm. IEEE Access 8:37014–37020

    Article  Google Scholar 

  6. Du Y, Zhao X, He M, Guo W (2019) A novel capsule based hybrid neural network for sentiment classification. IEEE Access 7:39321–39328

    Article  Google Scholar 

  7. Han Y, Liu M, Jing W (2020) Aspect-level drug reviews sentiment analysis based on double bigru and knowledge transfer. IEEE Access 8:21314–21325

    Article  Google Scholar 

  8. Hasan MM, Islam MS, Bakar SA, Rahman MM, Kabir MN (2021). Applications of artificial neural networks in engine cooling system, In: 2021 international conference on software engineering & computer systems and 4th international conference on computational science and information management (ICSECS-ICOCSIM), IEEE. pp. 471–476

  9. Islam MS, Ab Ghani N (2022). A novel bigrubilstm model for multilevel sentiment analysis using deep neural network with bigru-bilstm, in: Recent Trends in Mechatronics Towards Industry 4.0. Springer, pp. 403–414

  10. Islam MS, Sultana S, Roy UK, Al Mahmud J, Jahidul S (2021) Harc-new hybrid method with hierarchical attention based bidirectional recurrent neural network with dilated convolutional neural network to recognize multilabel emotions from text. Jurnal Ilmiah Teknik Elektro Komputer dan Informatika (JITEKI) 7:142–153

    Article  Google Scholar 

  11. Islam S, Ab Ghani N, Ahmed M (2020) A review on recent advances in deep learning for sentiment analysis: performances, challenges and limitations. Compusoft 9:3775–3783

    Google Scholar 

  12. Jojoa M, Eftekhar P, Nowrouzi-Kia B, Garcia-Zapirain B (2022). Natural language processing analysis applied to covid-19 open-text opinions using a distilbert model for sentiment categorization. AI & society , 1–8

  13. Kenarang A, Farahani M, Manthouri M (2022) Bigru attention capsule neural network for persian text classification. J Ambient Intell Humanized Comput 13(8):3923–3933

    Article  Google Scholar 

  14. Khan L, Amjad A, Afaq KM, Chang HT (2022) Deep sentiment analysis using cnn-lstm architecture of english and roman urdu text shared in social media. Appl Sci 12:2694

    Article  Google Scholar 

  15. Khanday AMUD, Rabani ST, Khan QR, Rouf N, Din MMU (2020) Machine learning based approaches for detecting covid-19 using clinical text data. Int J Inf Technol 12:731–739

    Google Scholar 

  16. Lai S, Xu L, Liu K, Zhao J (2015). Recurrent convolutional neural networks for text classification, in: Twenty-ninth AAAI conference on artificial intelligence

  17. Li J, Xu Y, Shi H (2019). Bidirectional lstm with hierarchical attention for text classification, in: 2019 IEEE 4th advanced information technology, electronic and automation control conference (IAEAC), IEEE. pp. 456–459

  18. Li L, Zhou A, Liu Y, Qian S, Geng H (2019) Aspect-based sentiment analysis based on dynamic attention gru. Scientia Sinica Inf 49:1019–1030

    Google Scholar 

  19. Liu J (2010) Fuzzy modularity and fuzzy community structure in networks. Eur Phys J B 77:547–557

    Article  Google Scholar 

  20. Liu R, Shi Y, Ji C, Jia M (2019) A survey of sentiment analysis based on transfer learning. IEEE access 7:85401–85412

    Article  Google Scholar 

  21. Mewada A, Dewang RK (2023) Sa-asba: a hybrid model for aspect-based sentiment analysis using synthetic attention in pre-trained language bert model with extreme gradient boosting. J Supercomput 79:5516–5551

    Article  Google Scholar 

  22. Palomo BAB, Velarde FHV, Cantu-Ortiz FJ, Ceballos Cancino HG (2023). Sentiment analysis of imdb movie reviews using deep learning techniques, In: International congress on information and communication technology, Springer. pp. 421–434

  23. Pasupa K, Ayutthaya Seneewong Na T (2022) Hybrid deep learning models for thai sentiment analysis. Cogn Comput 14:167–193

    Article  Google Scholar 

  24. Pennington J, Socher R, Manning CD (2014). Glove: Global vectors for word representation, In: Proceedings of the 2014 conference on empirical methods in natural language processing (EMNLP), pp. 1532–1543

  25. Roy D, Dutta M (2022) Optimal hierarchical attention network-based sentiment analysis for movie recommendation. Soc Netw Anal Min 12:138

    Article  Google Scholar 

  26. Saravia E, Liu HCT, Huang YH, Wu J, Chen YS (2018). Carer: Contextualized affect representations for emotion recognition, In: Proceedings of the 2018 conference on empirical methods in natural language processing, pp. 3687–3697

  27. Schuster M, Paliwal KK (1997) Bidirectional recurrent neural networks. IEEE Trans Signal Process 45:2673–2681

    Article  Google Scholar 

  28. Shofiqul MSI, Ab Ghani N, Ahmed MM (2020). A review on recent advances in deep learning for sentiment analysis: Performances, challenges and limitations

  29. Singh M, Jakhar AK, Pandey S (2021) Sentiment analysis on the impact of coronavirus in social life using the bert model. Soc Netw Anal Min 11:33

    Article  Google Scholar 

  30. Srivastava S, Khurana P, Tewari V (2018). Identifying aggression and toxicity in comments using capsule network, In: Proceedings of the first workshop on trolling, aggression and cyberbullying (TRAC-2018), pp. 98–105

  31. Talaat AS (2023) Sentiment analysis classification system using hybrid bert models. J Big Data 10:1–18

    Article  Google Scholar 

  32. Thiengburanathum P, Charoenkwan P (2023). Setar: Stacking ensemble learning for thai sentiment analysis using roberta and hybrid feature representation. IEEE Access

  33. Wang X, Jiang W, Luo Z (2016). Combination of convolutional and recurrent neural network for sentiment analysis of short texts, In: Proceedings of COLING 2016, the 26th international conference on computational linguistics: Technical papers, pp. 2428–2437

  34. Wu F, Gao B, Pan X, Su Z, Ji Y, Liu S, Liu Z (2023) Facapsnet: fusion capsule network with congruent attention for cyberbullying detection. Neurocomputing 542:126253

    Article  Google Scholar 

  35. Xu J, Chen D, Qiu X, Huang X (2016). Cached long short-term memory neural networks for document-level sentiment classification. arXiv preprint arXiv:1610.04989

  36. Yang P, Zhang P, Li B, Ji S, Yi M (2023). Aspect-based sentiment analysis using adversarial bert with capsule networks. Neural Processing Letters , pp 1–18

  37. Zhang Y, Wallace B (2015). A sensitivity analysis of (and practitioners’ guide to) convolutional neural networks for sentence classification. arXiv preprint arXiv:1510.03820

  38. Zhang Y, Wallace B, (2015). A sensitivity analysis of (and practitioners’ guide to) convolutional neural networks for sentence classification. arXiv preprint arXiv:1510.03820

Download references

Acknowledgments

This research is supported in part by two grants, one grant (Grant no. FRGS/1/2018/ICT02/UMP /02/12) from the Fundamental Research Grant Scheme (FRGS) by the Government of Malaysia to Universiti Malaysia Pahang Al-Sultan Abdullah (UMPSA), another grant (Grant no. PGRS200394) from Post Graduate Research Scheme(PGRS) by the Government of Malaysia to Universiti Malaysia Pahang Al-Sultan Abdullah (UMPSA).

Author information

Authors and Affiliations

  1. Faculty of Computing, Universiti Malaysia Pahang Al-Sultan Abdullah(UMPSA), 26600, Pekan, Kuantan, Pahang, Malaysia

    Md Shofiqul Islam, Ngahzaifa Ab Ghani, Kamal Zuhairi Zamli, Md Munirul Hasan & Abbas Saliimi Lokman

  2. Department of Computer Science and Engineering, Military Institute of Science and Technology (MIST), Mirpur, 1216, Bangladesh

    Md Shofiqul Islam

Authors
  1. Md Shofiqul Islam
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Ngahzaifa Ab Ghani
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Kamal Zuhairi Zamli
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Md Munirul Hasan
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Abbas Saliimi Lokman
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding authors

Correspondence to Md Shofiqul Islam or Ngahzaifa Ab Ghani.

Ethics declarations

Conflict of interest

We affirm that there is no Conflict of interest present in our activities or engagements.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Islam, M.S., Ghani, N.A., Zamli, K.Z. et al. KHACDD: a knowledge-based hybrid method for multilabel sentiment analysis on complex sentences using attentive capsule and dual structured recurrent network. Neural Comput & Applic 36, 18065–18086 (2024). https://doi.org/10.1007/s00521-024-09934-1

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00521-024-09934-1

Keywords

Search

Navigation