Nothing Special   »   [go: up one dir, main page]

You seem to have javascript disabled. Please note that many of the page functionalities won't work as expected without javascript enabled.
 
 
Sign in to use this feature.

Years

Between: -

Subjects

remove_circle_outline
remove_circle_outline
remove_circle_outline
remove_circle_outline
remove_circle_outline

Journals

Article Types

Countries / Regions

Search Results (3)

Search Parameters:
Keywords = RoBERTa-wwm-ext

Order results
Result details
Results per page
Select all
Export citation of selected articles as:
15 pages, 2841 KiB  
Article
Named Entity Recognition for Equipment Fault Diagnosis Based on RoBERTa-wwm-ext and Deep Learning Integration
by Feifei Gao, Lin Zhang, Wenfeng Wang, Bo Zhang, Wei Liu, Jingyi Zhang and Le Xie
Electronics 2024, 13(19), 3935; https://doi.org/10.3390/electronics13193935 (registering DOI) - 5 Oct 2024
Viewed by 256
Abstract
Equipment fault diagnosis NER is to extract specific entities from Chinese equipment fault diagnosis text, which is the premise of constructing an equipment fault diagnosis knowledge graph. Named entity recognition for equipment fault diagnosis can also provide important data support for equipment maintenance [...] Read more.
Equipment fault diagnosis NER is to extract specific entities from Chinese equipment fault diagnosis text, which is the premise of constructing an equipment fault diagnosis knowledge graph. Named entity recognition for equipment fault diagnosis can also provide important data support for equipment maintenance support. Equipment fault diagnosis text has complex semantics, fuzzy entity boundaries, and limited data size. In order to extract entities from the equipment fault diagnosis text, this paper presents an NER model for equipment fault diagnosis based on RoBERTa-wwm-ext and Deep Learning network integration. Firstly, this model uses the RoBERTa-wwm-ext to extract context-sensitive embeddings of text sequences. Secondly, the context feature information is obtained through the BiLSTM network. Thirdly, the CRF is combined to output the label sequence with a constraint relationship, improve the accuracy of sequence labeling task, and complete the entity recognition task. Finally, experiments and predictions are carried out on the constructed dataset. The results show that the model can effectively identify five types of equipment fault diagnosis entities and has higher evaluation indexes than the traditional model. Its precision, recall, and F1 value are 94.57%, 95.39%, and 94.98%, respectively. The case study proves that the model can accurately recognize the entity of the input text. Full article
Show Figures

Figure 1

Figure 1
<p>NER model based on RoBERTa-wwm-ext-BiLSTM-CRF network.</p>
Full article ">Figure 2
<p>The structure of Transformer.</p>
Full article ">Figure 3
<p>The structure of BERT.</p>
Full article ">Figure 4
<p>Input representation of BERT.</p>
Full article ">Figure 5
<p>Input representation of RoBERTa-wwm-ext.</p>
Full article ">Figure 6
<p>The internal structure of an LSTM network unit.</p>
Full article ">Figure 7
<p>The structure of BiLSTM network.</p>
Full article ">Figure 8
<p>The structure of CRF.</p>
Full article ">Figure 9
<p>Variation of F1 value as the number of training epochs increases.</p>
Full article ">Figure 10
<p>Entity recognition of the input text by the model.</p>
Full article ">
24 pages, 12556 KiB  
Article
Evolutionary Game Strategy Research on PSC Inspection Based on Knowledge Graphs
by Chengyong Liu, Qi Wang, Banghao Xiang, Yi Xu and Langxiong Gan
J. Mar. Sci. Eng. 2024, 12(8), 1449; https://doi.org/10.3390/jmse12081449 - 21 Aug 2024
Viewed by 583
Abstract
Port state control (PSC) inspections, considered a crucial means of maritime safety supervision, are viewed by the industry as a critical line of defense ensuring the stability of the international supply chain. Due to the high level of globalization and strong regional characteristics [...] Read more.
Port state control (PSC) inspections, considered a crucial means of maritime safety supervision, are viewed by the industry as a critical line of defense ensuring the stability of the international supply chain. Due to the high level of globalization and strong regional characteristics of PSC inspections, improving the accuracy of these inspections and efficiently utilizing inspection resources have become urgent issues. The construction of a PSC inspection ontology model from top to bottom, coupled with the integration of multisource data from bottom to top, is proposed in this paper. The RoBERTa-wwm-ext model is adopted as the entity recognition model, while the XGBoost4 model serves as the knowledge fusion model to establish the PSC inspection knowledge graph. Building upon an evolutionary game model of the PSC inspection knowledge graph, this study introduces an evolutionary game method to analyze the internal evolutionary dynamics of ship populations from a microscopic perspective. Through numerical simulations and standardization diffusion evolution simulations for ship support, the evolutionary impact of each parameter on the subgraph is examined. Subsequently, based on the results of the evolutionary game analysis, recommendations for PSC inspection auxiliary decision-making and related strategic suggestions are presented. The experimental results show that the RoBERTa-wwm-ext model and the XGBoost4 model used in the PSC inspection knowledge graph achieve superior performance in both entity recognition and knowledge fusion tasks, with the model accuracies surpassing those of other compared models. In the knowledge graph-based PSC inspection evolutionary game, the reward and punishment conditions (n, f) can reduce the burden of the standardization cost for safeguarding the ship. A ship is more sensitive to changes in the detention rate β than to changes in the inspection rate α. To a certain extent, the detention cost CDC plays a role similar to that of the detention rate β. In small-scale networks, relevant parameters in the ship’s standardization game have a more pronounced effect, with detention cost CDC having a greater impact than standardization cost CS on ship strategy choice and scale-free network evolution. Based on the experimental results, PSC inspection strategies are suggested. These strategies provide port state authorities with auxiliary decision-making tools for PSC inspections, promote the informatization of maritime regulation, and offer new insights for the study of maritime traffic safety management and PSC inspections. Full article
(This article belongs to the Section Ocean Engineering)
Show Figures

Figure 1

Figure 1
<p>The construction process of knowledge graph for PSC inspection.</p>
Full article ">Figure 2
<p>Relationship between PSC inspection entities.</p>
Full article ">Figure 3
<p>PSC inspection ontology construction model.</p>
Full article ">Figure 4
<p>RoBERTa-wwm-ext-BiLSTM-CRF model structure.</p>
Full article ">Figure 5
<p>Variation in F1 values for different entity recognition models.</p>
Full article ">Figure 6
<p>Comparison of the <math display="inline"><semantics> <mrow> <mi>P</mi> </mrow> </semantics></math>, <math display="inline"><semantics> <mrow> <mi>R</mi> </mrow> </semantics></math> and <math display="inline"><semantics> <mrow> <mi>F</mi> <mn>1</mn> </mrow> </semantics></math> values of different knowledge fusion models.</p>
Full article ">Figure 7
<p>Knowledge graph of PSC inspections (partial).</p>
Full article ">Figure 8
<p>Evolutionary phase diagram.</p>
Full article ">Figure 9
<p>Effects of different factor values on Ships 1 and 2. (<b>a</b>) Evolutionary games for different values of x. (<b>b</b>) Impacts of different inspection cost on ships.</p>
Full article ">Figure 10
<p>Impact of safeguard standardization cost on ships under different reward and punishment conditions.</p>
Full article ">Figure 11
<p>Impacts of detention cost on ships for different combinations of inspection and detention rate.</p>
Full article ">Figure 11 Cont.
<p>Impacts of detention cost on ships for different combinations of inspection and detention rate.</p>
Full article ">Figure 12
<p>Scale-free network visualization with different numbers of nodes.</p>
Full article ">Figure 12 Cont.
<p>Scale-free network visualization with different numbers of nodes.</p>
Full article ">Figure 13
<p>Simulation results for each node network.</p>
Full article ">Figure 13 Cont.
<p>Simulation results for each node network.</p>
Full article ">Figure 14
<p>Impact of ship detention cost on system evolution.</p>
Full article ">Figure 15
<p>Impact of ship inspection cost on system evolution.</p>
Full article ">Figure 16
<p>Impact of ship safeguard standardization cost on system evolution.</p>
Full article ">
17 pages, 1401 KiB  
Article
A Study on the Emotional Tendency of Aquatic Product Quality and Safety Texts Based on Emotional Dictionaries and Deep Learning
by Xingxing Tong, Ming Chen and Guofu Feng
Appl. Sci. 2024, 14(5), 2119; https://doi.org/10.3390/app14052119 - 4 Mar 2024
Cited by 1 | Viewed by 925
Abstract
The issue of aquatic product quality and safety has gradually become a focal point of societal concern. Analyzing textual comments from people about aquatic products aids in promptly understanding the current sentiment landscape regarding the quality and safety of aquatic products. To address [...] Read more.
The issue of aquatic product quality and safety has gradually become a focal point of societal concern. Analyzing textual comments from people about aquatic products aids in promptly understanding the current sentiment landscape regarding the quality and safety of aquatic products. To address the challenge of the polysemy of modern network buzzwords in word vector representation, we construct a custom sentiment lexicon and employ the Roberta-wwm-ext model to extract semantic feature representations from comment texts. Subsequently, the obtained semantic features of words are put into a bidirectional LSTM model for sentiment classification. This paper validates the effectiveness of the proposed model in the sentiment analysis of aquatic product quality and safety texts by constructing two datasets, one for salmon and one for shrimp, sourced from comments on JD.com. Multiple comparative experiments were conducted to assess the performance of the model on these datasets. The experimental results demonstrate significant achievements using the proposed model, achieving a classification accuracy of 95.49%. This represents a notable improvement of 6.42 percentage points compared to using Word2Vec and a 2.06 percentage point improvement compared to using BERT as the word embedding model. Furthermore, it outperforms LSTM by 2.22 percentage points and textCNN by 2.86 percentage points in terms of semantic extraction models. The outstanding effectiveness of the proposed method is strongly validated by these results. It provides more accurate technical support for calculating the concentration of negative emotions using a risk assessment system in public opinion related to quality and safety. Full article
(This article belongs to the Special Issue Natural Language Processing (NLP) and Applications—2nd Edition)
Show Figures

Figure 1

Figure 1
<p>Based on emotional dictionary and deep learning network structure.</p>
Full article ">Figure 2
<p>BERT structure diagram.</p>
Full article ">Figure 3
<p>Input of BERT.</p>
Full article ">Figure 4
<p>LSTM module structure.</p>
Full article ">Figure 5
<p>Comparison of training accuracy curves of network models. (<b>a</b>) Training accuracy curves for different word embedding models; (<b>b</b>) training accuracy curves for training different bias analysis models in this article.</p>
Full article ">
Back to TopTop