Nothing Special   »   [go: up one dir, main page]

You seem to have javascript disabled. Please note that many of the page functionalities won't work as expected without javascript enabled.
 
 
Sign in to use this feature.

Years

Between: -

Subjects

remove_circle_outline
remove_circle_outline
remove_circle_outline
remove_circle_outline
remove_circle_outline
remove_circle_outline
remove_circle_outline
remove_circle_outline
remove_circle_outline

Journals

remove_circle_outline
remove_circle_outline
remove_circle_outline
remove_circle_outline
remove_circle_outline
remove_circle_outline
remove_circle_outline
remove_circle_outline
remove_circle_outline
remove_circle_outline
remove_circle_outline
remove_circle_outline
remove_circle_outline
remove_circle_outline
remove_circle_outline
remove_circle_outline

Article Types

Countries / Regions

remove_circle_outline
remove_circle_outline
remove_circle_outline
remove_circle_outline
remove_circle_outline
remove_circle_outline
remove_circle_outline

Search Results (3,093)

Search Parameters:
Keywords = Markov modelling

Order results
Result details
Results per page
Select all
Export citation of selected articles as:
14 pages, 2302 KiB  
Article
Predictive Model of Pedestrian Crashes Using Markov Chains in the City of Badajoz
by Alejandro Moreno-Sanfélix, F. Consuelo Gragera-Peña and Miguel A. Jaramillo-Morán
Sustainability 2024, 16(22), 10115; https://doi.org/10.3390/su162210115 (registering DOI) - 20 Nov 2024
Viewed by 82
Abstract
Driving a vehicle, whether motorized or not, is a risky activity that can lead to a traffic accident and directly or indirectly affect all road users. In particular, road crashes involving pedestrians have caused the highest number of deaths and serious injuries in [...] Read more.
Driving a vehicle, whether motorized or not, is a risky activity that can lead to a traffic accident and directly or indirectly affect all road users. In particular, road crashes involving pedestrians have caused the highest number of deaths and serious injuries in recent years. In order to prevent and reduce the occurrence of these types of traffic accidents and to optimize the use of the available resources of the administrations in charge of road safety, an updatable predictive model using Markov chains is proposed in this work. Markov chains are used in fields as diverse as hospital management or electronic engineering, but their application in the field of road safety is considered innovative. They are prediction and decision techniques that allow the estimation of the state of a given system by simulating its stochastic risk level. To carry out this study, the available information on traffic accidents involving pedestrians in the database of the Local Police of Badajoz (a medium-sized city in the southwest of Spain) in the period 2016 to 2023 were analyzed. These data were used to train a predictive model that was subsequently used to estimate the probability of occurrence of a traffic crash involving pedestrians in different areas of this city, information that could be used by the authorities to focus their efforts in those areas with the highest probability of a road crash occurring. This model can improve the identification of high-risk locations, and urban planners can optimize decision making in designing appropriate preventive measures and increase efficiency to reduce pedestrian crashes. Full article
Show Figures

Figure 1

Figure 1
<p>Sectors of the city of Badajoz for the Local Police. Source: Muñoz Garrido R., 2021 [<a href="#B24-sustainability-16-10115" class="html-bibr">24</a>].</p>
Full article ">Figure 2
<p>Results obtained of the predictive model for each sector in the city of Badajoz.</p>
Full article ">Figure 3
<p>Results obtained from the analysis of the Markov model for each sector in the city of Badajoz in percent (%).</p>
Full article ">Figure 4
<p>Victims in pedestrian crashes in each sector of the city of Badajoz in the first six months of 2024 (January–June).</p>
Full article ">Figure 5
<p>Victims in pedestrian crashes in each sector of the city of Badajoz in July, August and September, after preventive measures were applied in Sector 2.</p>
Full article ">
13 pages, 337 KiB  
Article
A Spatial–Temporal Bayesian Model for a Case-Crossover Design with Application to Extreme Heat and Claims Data
by Menglu Liang, Zheng Li, Lijun Zhang and Ming Wang
Stats 2024, 7(4), 1379-1391; https://doi.org/10.3390/stats7040080 (registering DOI) - 19 Nov 2024
Viewed by 193
Abstract
Epidemiological approaches for examining human health responses to environmental exposures in observational studies frequently address confounding by employing advanced matching techniques and statistical methods grounded in conditional likelihood. This study incorporates a recently developed Bayesian hierarchical spatiotemporal model within a conditional logistic regression [...] Read more.
Epidemiological approaches for examining human health responses to environmental exposures in observational studies frequently address confounding by employing advanced matching techniques and statistical methods grounded in conditional likelihood. This study incorporates a recently developed Bayesian hierarchical spatiotemporal model within a conditional logistic regression framework to capture the heterogeneous effects of environmental exposures in a case-crossover (CCO) design. Spatial and temporal dependencies are modeled through random effects incorporating multivariate conditional autoregressive priors. Flexible frailty structures are introduced to explore strategies for managing temporal variables. Parameter estimation and inference are conducted using a Monte Carlo Markov chain method within a Bayesian framework. Model fit and optimal model selection are evaluated using the deviance information criterion. Simulations assess and compare model performance across various scenarios. Finally, the approach is illustrated with workers’ compensation claims data from New York and Florida to examine spatiotemporal heterogeneity in hospitalization rates related to heat prostration. Full article
Show Figures

Figure 1

Figure 1
<p>Case-crossover (CCO) design in our study.</p>
Full article ">
20 pages, 3039 KiB  
Article
Bayesian and Non-Bayesian Inference to Bivariate Alpha Power Burr-XII Distribution with Engineering Application
by Dina A. Ramadan, Mustafa M. Hasaballah, Nada K. Abd-Elwaha, Arwa M. Alshangiti, Mahmoud I. Kamel, Oluwafemi Samson Balogun and Mahmoud M. El-Awady
Axioms 2024, 13(11), 796; https://doi.org/10.3390/axioms13110796 - 17 Nov 2024
Viewed by 262
Abstract
In this research, we present a new distribution, which is the bivariate alpha power Burr-XII distribution, based on the alpha power Burr-XII distribution. We thoroughly examine the key features of our newly developed bivariate model. We introduce a new class of bivariate models, [...] Read more.
In this research, we present a new distribution, which is the bivariate alpha power Burr-XII distribution, based on the alpha power Burr-XII distribution. We thoroughly examine the key features of our newly developed bivariate model. We introduce a new class of bivariate models, which are built with the copula function. The statistical properties of the proposed distribution, such as conditional distributions, conditional expectations, marginal distributions, moment-generating functions, and product moments were studied. This was accomplished with two datasets of real data that came from two distinct devices. We employed Bayesian, maximum likelihood estimation, and least squares estimation strategies to obtain estimated points and intervals. Additionally, we generated bootstrap confidence intervals and conducted numerical analyses using the Markov chain Monte Carlo method. Lastly, we compared this novel bivariate distribution’s performance to earlier bivariate models, to determine how well it fit the real data. Full article
Show Figures

Figure 1

Figure 1
<p>Surface and contour plot of joint density of <span class="html-italic">BAPB-XII</span> distribution.</p>
Full article ">Figure 2
<p>Estimated pdfs, survival curves, and <math display="inline"><semantics> <mrow> <mi>p</mi> <mi>p</mi> </mrow> </semantics></math> plot for the marginal distributions of <math display="inline"><semantics> <mrow> <mi>X</mi> <mo>.</mo> </mrow> </semantics></math></p>
Full article ">Figure 3
<p>Estimated pdfs, survival curves, and <math display="inline"><semantics> <mrow> <mi>p</mi> <mi>p</mi> </mrow> </semantics></math> plot for the marginal distributions of <math display="inline"><semantics> <mrow> <mi>Y</mi> <mo>.</mo> </mrow> </semantics></math></p>
Full article ">Figure 4
<p>Posterior densities for parameters obtained from MCMC chain.</p>
Full article ">Figure 5
<p>Trace plots for parameters obtained from MCMC chain.</p>
Full article ">Figure 6
<p>First 100 lags of autocorrelation values obtained from MCMC algorithm.</p>
Full article ">
20 pages, 9833 KiB  
Article
Reconstruction of Hourly Gap-Free Sea Surface Skin Temperature from Multi-Sensors
by Qianguang Tu, Zengzhou Hao, Dong Liu, Bangyi Tao, Liangliang Shi and Yunwei Yan
Remote Sens. 2024, 16(22), 4268; https://doi.org/10.3390/rs16224268 - 15 Nov 2024
Viewed by 292
Abstract
The sea surface skin temperature (SSTskin) is of critical importance with regard to air–sea interactions and marine carbon circulation. At present, no single remote sensor is capable of providing a gap-free SSTskin. The use of data fusion techniques is [...] Read more.
The sea surface skin temperature (SSTskin) is of critical importance with regard to air–sea interactions and marine carbon circulation. At present, no single remote sensor is capable of providing a gap-free SSTskin. The use of data fusion techniques is therefore essential for the purpose of filling these gaps. The extant fusion methodologies frequently fail to account for the influence of depth disparities and the diurnal variability of sea surface temperatures (SSTs) retrieved from multi-sensors. We have developed a novel approach that integrates depth and diurnal corrections and employs advanced data fusion techniques to generate hourly gap-free SST datasets. The General Ocean Turbulence Model (GOTM) is employed to model the diurnal variability of the SST profile, incorporating depth and diurnal corrections. Subsequently, the corrected SSTs at the same observed time and depth are blended using the Markov method and the remaining data gaps are filled with optimal interpolation. The overall precision of the hourly gap-free SSTskin generated demonstrates a mean bias of −0.14 °C and a root mean square error of 0.57 °C, which is comparable to the precision of satellite observations. The hourly gap-free SSTskin is vital for improving our comprehension of air–sea interactions and monitoring critical oceanographic processes with high-frequency variability. Full article
Show Figures

Graphical abstract

Graphical abstract
Full article ">Figure 1
<p>The overall flowchart of multi-sensors fusion for SST<sub>skin</sub>.</p>
Full article ">Figure 2
<p>The DV of SST<sub>skin</sub> modeled by GOTM on 8 May 2007.</p>
Full article ">Figure 3
<p>Histogram of the difference between MTSAT-observed DV and GOTM DV on 8 May 2007.</p>
Full article ">Figure 4
<p>GOTM of the SST at 2 p.m. on 8 May 2007. (<b>a</b>) The SST profile at 122°E and 35.25°N; (<b>b</b>) the difference in the spatial distributions between SST<sub>skin</sub> and SST<sub>subskin</sub>.</p>
Full article ">Figure 5
<p>(<b>a</b>) The original hourly MTSAT SST on 8 May 2007. (<b>b</b>) The diurnal variation-corrected (normalized) hourly MTSAT SST on 8 May 2007.</p>
Full article ">Figure 5 Cont.
<p>(<b>a</b>) The original hourly MTSAT SST on 8 May 2007. (<b>b</b>) The diurnal variation-corrected (normalized) hourly MTSAT SST on 8 May 2007.</p>
Full article ">Figure 6
<p>(<b>a</b>) Number of sensors available on 8 May 2007; (<b>b</b>) the fusion SST at 10:30 a.m. using Markov estimation.</p>
Full article ">Figure 7
<p>Covariance structure function of the East China Sea estimated from MTSAT in 2007. The spatial covariance functions at (<b>a</b>) zonal and (<b>b</b>) meridional directions for the SST variations. Temporal correlation with time lags computed using hourly SST (<b>c</b>). Red line is the fitting function. Vertical bars represent ±1 standard deviation.</p>
Full article ">Figure 8
<p>The hourly gap-free SST<sub>skin</sub> on 8 May 2007.</p>
Full article ">Figure 9
<p>The diurnal variation of SST<sub>skin</sub> at 124°E and 28°N on 8 May 2007.</p>
Full article ">Figure 10
<p>(<b>a</b>) Scatter plot between in situ SST<sub>skin</sub> and fusion SST<sub>skin</sub>. (<b>b</b>) The hourly mean bias and standard deviation during 2007.</p>
Full article ">
20 pages, 2952 KiB  
Article
Deep Q-Network-Enhanced Self-Tuning Control of Particle Swarm Optimization
by Oussama Aoun
Modelling 2024, 5(4), 1709-1728; https://doi.org/10.3390/modelling5040089 (registering DOI) - 15 Nov 2024
Viewed by 277
Abstract
Particle Swarm Optimization (PSO) is a widespread evolutionary technique that has successfully solved diverse optimization problems across various application fields. However, when dealing with more complex optimization problems, PSO can suffer from premature convergence and may become stuck in local optima. The primary [...] Read more.
Particle Swarm Optimization (PSO) is a widespread evolutionary technique that has successfully solved diverse optimization problems across various application fields. However, when dealing with more complex optimization problems, PSO can suffer from premature convergence and may become stuck in local optima. The primary goal is accelerating convergence and preventing solutions from falling into these local optima. This paper introduces a new approach to address these shortcomings and improve overall performance: utilizing a reinforcement deep learning method to carry out online adjustments of parameters in a homogeneous Particle Swarm Optimization, where all particles exhibit identical search behaviors inspired by models of social influence among uniform individuals. The present method utilizes an online parameter control to analyze and adjust each primary PSO parameter, particularly the acceleration factors and the inertia weight. Initially, a partially observed Markov decision process model at the PSO level is used to model the online parameter adaptation. Subsequently, a Hidden Markov Model classification, combined with a Deep Q-Network, is implemented to create a novel Particle Swarm Optimization named DPQ-PSO, and its parameters are adjusted according to deep reinforcement learning. Experiments on different benchmark unimodal and multimodal functions demonstrate superior results over most state-of-the-art methods regarding solution accuracy and convergence speed. Full article
Show Figures

Figure 1

Figure 1
<p>Improvement methods to enhance PSO.</p>
Full article ">Figure 2
<p>Diagram of PSO iterations.</p>
Full article ">Figure 3
<p>Markov chain on PSO states.</p>
Full article ">Figure 4
<p>Comparison of execution time in seconds across different PSO variants. Grey dots represent individual execution times, blue boxes show the interquartile range, and red lines indicate mean execution times.</p>
Full article ">Figure 5
<p>Comparison of convergence speed on benchmark functions for (<b>a</b>) Elliptic; (<b>b</b>) Step; (<b>c</b>) Sphere; (<b>d</b>) Tablet; (<b>e</b>) Quadric; (<b>f</b>) Rastrigrin; (<b>g</b>) Ackley; (<b>h</b>) Griewang; (<b>i</b>) Schewefel; and (<b>j</b>) Drop wave.</p>
Full article ">Figure 5 Cont.
<p>Comparison of convergence speed on benchmark functions for (<b>a</b>) Elliptic; (<b>b</b>) Step; (<b>c</b>) Sphere; (<b>d</b>) Tablet; (<b>e</b>) Quadric; (<b>f</b>) Rastrigrin; (<b>g</b>) Ackley; (<b>h</b>) Griewang; (<b>i</b>) Schewefel; and (<b>j</b>) Drop wave.</p>
Full article ">Figure 5 Cont.
<p>Comparison of convergence speed on benchmark functions for (<b>a</b>) Elliptic; (<b>b</b>) Step; (<b>c</b>) Sphere; (<b>d</b>) Tablet; (<b>e</b>) Quadric; (<b>f</b>) Rastrigrin; (<b>g</b>) Ackley; (<b>h</b>) Griewang; (<b>i</b>) Schewefel; and (<b>j</b>) Drop wave.</p>
Full article ">
19 pages, 4383 KiB  
Article
Classification of Ship Type from Combination of HMM–DNN–CNN Models Based on Ship Trajectory Features
by Dae-Woon Shin and Chan-Su Yang
Remote Sens. 2024, 16(22), 4245; https://doi.org/10.3390/rs16224245 - 14 Nov 2024
Viewed by 270
Abstract
This study proposes an enhanced ship-type classification model that employs a sequential processing methodology integrating hidden Markov model (HMM), deep neural network (DNN), and convolutional neural network (CNN) techniques. Four different ship types—fishing boat, passenger, container, and other ship—were classified using multiple ship [...] Read more.
This study proposes an enhanced ship-type classification model that employs a sequential processing methodology integrating hidden Markov model (HMM), deep neural network (DNN), and convolutional neural network (CNN) techniques. Four different ship types—fishing boat, passenger, container, and other ship—were classified using multiple ship trajectory features extracted from the automatic identification system (AIS) and small fishing vessel tracking system. For model optimization, both ship datasets were transformed into various formats corresponding to multiple models, incorporating data enhancement and augmentation approaches. Speed over ground, course over ground, rate of turn, rate of turn in speed, berth distance, latitude/longitude, and heading were used as input parameters. The HMM–DNN–CNN combination was obtained as the optimal model (average F-1 score: 97.54%), achieving individual classification performances of 99.03%, 97.46%, and 95.83% for fishing boats, passenger ships, and container ships, respectively. The proposed approach outperformed previous approaches in prediction accuracy, with further improvements anticipated when implemented on a large-scale real-time data collection system. Full article
(This article belongs to the Special Issue Artificial Intelligence and Big Data for Oceanography)
Show Figures

Figure 1

Figure 1
<p>Study area (red box) and trajectories of ships from 6 to 10 February 2021. The red dot indicates the location of the Korea Institute of Ocean Science and Technology, operating a monitoring station for merchant and fishing vessels. Blue and green lines depict the ship trajectories obtained from the AIS and V-Pass, respectively. Here, AIS = automatic identification system, and V-Pass = small fishing vessel tracking system.</p>
Full article ">Figure 2
<p>Trajectories of different ship types from the training dataset shown in <a href="#remotesensing-16-04245-t001" class="html-table">Table 1</a>. (<b>a</b>) Fishing boat, (<b>b</b>) passenger ship, (<b>c</b>) container ship, and (<b>d</b>) other ship.</p>
Full article ">Figure 3
<p>Overall workflow for ship type classification through combining of multiple models. Here, SOG = speed over ground, ROT = rate of turn, ROTS = rate of turn in speed, and COG = course over ground.</p>
Full article ">Figure 4
<p>Structure of hierarchical HMM model for classifying fishing boat. (<b>a</b>) The position-based probability of fishing activity was derived from two observational parameters, SOG and ROT, at each time step. (<b>b</b>) Fishing/non-fishing state estimated by the stochastic method based on SOG (<b>top</b>) and ROT (<b>bottom</b>).</p>
Full article ">Figure 5
<p>Flowchart for estimating the probability of the DNN model input values through filtering for passenger ship classification.</p>
Full article ">Figure 6
<p>Flowchart for estimating the probability of the CNN model input values by thresholding and filtering for container ship classification. Here, CP = container pier, PM = pier masking, and NCP = non-container pier.</p>
Full article ">Figure 7
<p>Case application of the HMM model and fishing boat trajectory feature analysis from the training dataset. (<b>a</b>) Labeling of classified trajectory into fishing (red circle) and non-fishing (blue circle). (<b>b</b>) Comparison of SOG and ROT distributions between fishing and non-fishing states.</p>
Full article ">Figure 8
<p>Analysis of passenger ship trajectory features from the training dataset. (<b>a</b>) Example of a passenger ship trajectory on 10 February 2021. (<b>b</b>) Comparative analysis between passenger and other ship types based on the probability of parameters: berth distance, ROTS, and heading.</p>
Full article ">Figure 9
<p>Pier masking area to classify container ships from the training dataset. Red and blue polygons display CP and NCP, respectively (left figure). A sample container ship berthed at CP on 10 February 2021 (green circle), intersecting the CP polygon and container ship trajectory points (right figure). Here, CP = container pier, and NCP = non-container pier.</p>
Full article ">Figure 10
<p>Analysis of container ship trajectory features from the training dataset. (<b>a</b>) Container ship density map in log scale and main navigating direction (black arrows). (<b>b</b>) Comparative analysis between container ships and other ship types using the three RGB inputs, composed of ship trajectories (b-1,b-2), SOG (b-3,b-4), and COG (b-5,b-6), respectively.</p>
Full article ">Figure 11
<p>Comparison of ground truth and model classification results for fishing boat (blue circle), passenger ship (green circle), and container ship (red circle).</p>
Full article ">Figure 12
<p>Confusion matrices of HMM, DNN, and CNN models applied to the test dataset. (<b>a</b>) Fishing boats and other ships. (<b>b</b>) Passenger ships and other ships. (<b>c</b>) Container ships and other ships.</p>
Full article ">
20 pages, 4970 KiB  
Article
Revealing the Next Word and Character in Arabic: An Effective Blend of Long Short-Term Memory Networks and ARABERT
by Fawaz S. Al-Anzi and S. T. Bibin Shalini
Appl. Sci. 2024, 14(22), 10498; https://doi.org/10.3390/app142210498 - 14 Nov 2024
Viewed by 351
Abstract
Arabic raw audio datasets were initially gathered to produce a corresponding signal spectrum, which was further used to extract the Mel-Frequency Cepstral Coefficients (MFCCs). The pronunciation dictionary, language model, and acoustic model were further derived from the MFCCs’ features. These output data were [...] Read more.
Arabic raw audio datasets were initially gathered to produce a corresponding signal spectrum, which was further used to extract the Mel-Frequency Cepstral Coefficients (MFCCs). The pronunciation dictionary, language model, and acoustic model were further derived from the MFCCs’ features. These output data were processed into Baidu’s Deep Speech model (ASR system) to attain the text corpus. Baidu’s Deep Speech model was implemented to precisely identify the global optimal value rapidly while preserving a low word and character discrepancy rate by attaining an excellent performance in isolated and end-to-end speech recognition. The desired outcome in this work is to forecast the next word and character in a sequential and systematic order that applies under natural language processing (NLP). This work combines the trained Arabic language model ARABERT with the potential of Long Short-Term Memory (LSTM) networks to predict the next word and character in an Arabic text. We used the pre-trained ARABERT embedding to improve the model’s capacity and, to capture semantic relationships within the language, we educated LSTM + CNN and Markov models on Arabic text data to assess the efficacy of this model. Python libraries such as TensorFlow, Pickle, Keras, and NumPy were used to effectively design our development model. We extensively assessed the model’s performance using new Arabic text, focusing on evaluation metrics like accuracy, word error rate, character error rate, BLEU score, and perplexity. The results show how well the combined LSTM + ARABERT and Markov models have outperformed the baseline models in envisaging the next word or character in the Arabic text. The accuracy rates of 64.9% for LSTM, 74.6% for ARABERT + LSTM, and 78% for Markov chain models were achieved in predicting the next word, and the accuracy rates of 72% for LSTM, 72.22% for LSTM + CNN, and 73% for ARABERET + LSTM models were achieved for the next-character prediction. This work unveils a novelty in Arabic natural language processing tasks, estimating a potential future expansion in deriving a precise next-word and next-character forecasting, which can be an efficient utility for text generation and machine translation applications. Full article
Show Figures

Figure 1

Figure 1
<p>Baidu’s Deep Speech Arabic representation.</p>
Full article ">Figure 2
<p>Block diagram representation.</p>
Full article ">Figure 3
<p>LSTM architecture.</p>
Full article ">Figure 4
<p>Block diagram representation—next-character prediction.</p>
Full article ">Figure 5
<p>Case 1: Word-based prediction.</p>
Full article ">Figure 6
<p>Case 2: character-based prediction.</p>
Full article ">
24 pages, 19787 KiB  
Article
Spatiotemporal Changes and Influencing Factors of the Coupled Production–Living–Ecological Functions in the Yellow River Basin, China
by Zidao Lu, Maomao Zhang, Chunguang Hu, Lianlong Ma, Enqing Chen, Cheng Zhang and Guozhen Xia
Land 2024, 13(11), 1909; https://doi.org/10.3390/land13111909 - 14 Nov 2024
Viewed by 283
Abstract
The imbalance in the “production–living–ecology” function (PLEF) has become a major issue for global cities due to the rapid advancement of urbanization and industrialization worldwide. The realization of PLEF coupling and coordination is crucial for a region’s sustainable development. Existing research has defined [...] Read more.
The imbalance in the “production–living–ecology” function (PLEF) has become a major issue for global cities due to the rapid advancement of urbanization and industrialization worldwide. The realization of PLEF coupling and coordination is crucial for a region’s sustainable development. Existing research has defined the concept of PLEF from the perspective of land function and measured its coupling coordination level using relevant models. However, there is still room for improvement in the indicator system, research methods, and other aspects. This work builds a PLEF coupling coordination evaluation-index system based on the perspective of human habitat using multi-source data in order to examine the spatial differences in PLEF coupling coordination level and the influencing factors in the Yellow River Basin (YRB). Using the modified coupling coordination model, the Moran index, spatial Markov chain model, and geographically weighted random forest model were introduced to analyze its spatial and temporal differentiation and influencing factors. The results found that (a) the level of PLEF coupling coordination in the YRB from 2010 to 2022 has been improving, and the number of severely imbalanced cities has been reduced from 23 to 15, but the level of downstream cities’ coupling coordination is significantly higher than that of upstream cities. The probability of cities maintaining their own level is greater than 50%, and there is basically no cross-level transfer. (b) The Moran index of the PLEF coupling coordination level has risen from 0.137 to 0.229, which shows a significant positive clustering phenomenon and is continually strengthening. The intercity polarization effect is being continually enhanced as seen in the LISA clustering diagram. (c) There is significant heterogeneity between the influencing factors in time and space. In terms of importance level, the series is per capita disposable income (0.416) > nighttime lighting index (0.370) > local general public budget expenditure (0.332) > number of beds per 1000 people (0.191) > NO2 content in the air (0.110). This study systematically investigates the dynamic evolution of the coupled coordination level of PLEF in the YRB and its influencing mechanism, which is of great practical use. Full article
Show Figures

Figure 1

Figure 1
<p>Research framework. P represents the transition probability.</p>
Full article ">Figure 2
<p>Connotation of the “production–living–ecology” function(PLEF) from the perspective of the human settlement environment.</p>
Full article ">Figure 3
<p>Overview of the research area.</p>
Full article ">Figure 4
<p>Spatial distributions of the production, living, and ecological function levels in the YRB.</p>
Full article ">Figure 5
<p>Spatial distribution of the PLEF coupling coordination level in the Yellow River Basin (YRB) from 2010 to 2022.</p>
Full article ">Figure 6
<p>LISA of the PLEF coupling coordination level in the YRB.</p>
Full article ">Figure 7
<p>Markov transition matrix of the PLEF coupling coordination level space in the YRB.</p>
Full article ">Figure 8
<p>Spatial distribution of the PLEF coupling coordination horizontal transfer characteristics of the YRB.</p>
Full article ">Figure 9
<p>Relative importance levels of the factors influencing the PLEF coupling coordination level in the YRB.</p>
Full article ">Figure 10
<p>Importance level of the factors influencing the PLEF coupling coordination level in the YRB from 2010 to 2022 under the economic level criterion layer.</p>
Full article ">Figure 11
<p>Importance level of the factors influencing the PLEF coupling coordination level in the YRB from 2010 to 2022 under the social development criterion layer.</p>
Full article ">Figure 12
<p>Importance level of the factors influencing the PLEF coupling coordination level in the YRB from 2010 to 2022 under the terrain environment criterion layer.</p>
Full article ">Figure 13
<p>Impact mechanism of the PLEF coupling coordination level in the Yellow River Basin.</p>
Full article ">
22 pages, 7608 KiB  
Article
Analysis of the Wangping Brownfield Using a Two-Step Urban Brownfield Redevelopment Model
by Zhiping Liu, Yingxue Feng, Jing Li, Haoyu Tao, Zhen Liu, Xiaodan Li and Yue Hu
Land 2024, 13(11), 1880; https://doi.org/10.3390/land13111880 - 10 Nov 2024
Viewed by 571
Abstract
With societal progress, urban brownfields have become restrictive, and redevelopment studies have become an important part of urban renewal. In this work, we developed a two-step model for urban brownfield redevelopment, while considering the Wangping brownfield as the study area. Site suitability evaluation [...] Read more.
With societal progress, urban brownfields have become restrictive, and redevelopment studies have become an important part of urban renewal. In this work, we developed a two-step model for urban brownfield redevelopment, while considering the Wangping brownfield as the study area. Site suitability evaluation models for brownfield parks, agricultural picking gardens, and creative industrial centers were developed based on the elevation, slope, and surface runoff, and the evaluation results were categorized into five levels. The redevelopment plan was formulated based on these evaluation results. To study the effect of the plan, a transition matrix of land use was assessed using satellite images and the cellular automata (CA)–Markov model; based on the analysis, we predicted the land use situation of the Wangping brownfield, with respect to natural development, for 2030. A comparison of the redevelopment planning with the forecasted results revealed that the proportions of grassland, construction, and unused land decreased by 25.68, 3.12, and 2.38% and those of plowland and forest land increased by 6.61 and 24.57%. This confirms the advantages of redevelopment planning for restoring plowland and increasing biological carbon sinks. Notably, our two-step urban brownfield redevelopment model can enrich the current research on urban brownfields and guide similar urban renewal projects. Full article
Show Figures

Figure 1

Figure 1
<p>Study framework. Abbreviations: analytic hierarchy process (AHP), cellular automata (CA), and geographic information system (GIS).</p>
Full article ">Figure 2
<p>Basic information on the current situation of the Wangping brownfield. (<b>A</b>) Surface information for Wangping: (<b>a</b>) satellite image of the current status of the surface; (<b>b</b>) function partition diagram; and (<b>c</b>) detailed plan. (<b>B</b>). Damage to the ecological environment in Wangping: (<b>a</b>) ground depression; (<b>b</b>) mountain collapse; (<b>c</b>) ground cracks; (<b>d</b>) water pollution; (<b>e</b>) landslides; and (<b>f</b>) coal gangue.</p>
Full article ">Figure 3
<p>Flow chart of the prediction model of the advantages of the redevelopment planning.</p>
Full article ">Figure 4
<p>Wangping brownfield redevelopment: (<b>a</b>) redevelopment suitability of the brownfield park; (<b>b</b>) redevelopment suitability of the agricultural picking garden; and (<b>c</b>) overall plan for the redevelopment of the area.</p>
Full article ">Figure 5
<p>Design of the Wangping brownfield redevelopment plan: (<b>a</b>) brownfield park; and (<b>b</b>) agricultural picking garden.</p>
Full article ">Figure 6
<p>Design of creative industry center: (<b>a</b>) landscape node; (<b>b</b>) functional area; and (<b>c</b>) personnel flow line designs for the study area.</p>
Full article ">Figure 7
<p>Land use change in Mentougou district during 2000–2020: (<b>a</b>) land use; and (<b>b</b>) transition trend.</p>
Full article ">Figure 8
<p>Land use prediction for the Wangping brownfield for 2030.</p>
Full article ">
13 pages, 819 KiB  
Article
Optimal Inspection and Maintenance Policy: Integrating a Continuous-Time Markov Chain into a Homing Problem
by Mario Lefebvre and Roozbeh Yaghoubi
Machines 2024, 12(11), 795; https://doi.org/10.3390/machines12110795 - 10 Nov 2024
Viewed by 296
Abstract
The state of a machine is modeled as a controlled continuous-time Markov chain. Moreover, the machine is being serviced at random times. The aim is to maximize the time until the machine must be repaired, while taking the maintenance costs into account. The [...] Read more.
The state of a machine is modeled as a controlled continuous-time Markov chain. Moreover, the machine is being serviced at random times. The aim is to maximize the time until the machine must be repaired, while taking the maintenance costs into account. The dynamic programming equation satisfied by the value function is derived, enabling optimal decision-making regarding inspection rates, and special problems are solved explicitly. This approach minimizes direct maintenance costs along with potential failure expenses, establishing a robust methodology for determining inspection frequencies in reliability-centered maintenance. The results contribute to the advancement of maintenance strategies and provide explicit solutions for particular cases, offering ideas for application in reliability engineering. Full article
Show Figures

Figure 1

Figure 1
<p>Transition diagram of the Markov chain.</p>
Full article ">Figure 2
<p>Functions <math display="inline"><semantics> <mrow> <msub> <mi>F</mi> <mn>1</mn> </msub> <mrow> <mo>(</mo> <msub> <mi>t</mi> <mn>0</mn> </msub> <mo>)</mo> </mrow> </mrow> </semantics></math> (solid line) and <math display="inline"><semantics> <mrow> <msub> <mi>F</mi> <mn>2</mn> </msub> <mrow> <mo>(</mo> <msub> <mi>t</mi> <mn>0</mn> </msub> <mo>)</mo> </mrow> </mrow> </semantics></math> defined respectively in Equation (<a href="#FD24-machines-12-00795" class="html-disp-formula">24</a>) and Equation (<a href="#FD25-machines-12-00795" class="html-disp-formula">25</a>) for <math display="inline"><semantics> <mrow> <mi>t</mi> <mo>∈</mo> <mo>[</mo> <mn>0</mn> <mo>,</mo> <mn>2</mn> <mo>]</mo> </mrow> </semantics></math>, when <math display="inline"><semantics> <mrow> <msub> <mi>t</mi> <mn>1</mn> </msub> <mo>=</mo> <mn>2</mn> </mrow> </semantics></math>.</p>
Full article ">Figure 3
<p>Optimal control <math display="inline"><semantics> <msubsup> <mi>u</mi> <mn>0</mn> <mo>*</mo> </msubsup> </semantics></math> given in Equation (<a href="#FD34-machines-12-00795" class="html-disp-formula">34</a>) when <math display="inline"><semantics> <mrow> <mi>λ</mi> <mo>=</mo> <mn>10</mn> </mrow> </semantics></math> and <math display="inline"><semantics> <mrow> <mi>c</mi> <mo>∈</mo> <mo>[</mo> <mn>5</mn> <mo>,</mo> <mn>10</mn> <mo>]</mo> </mrow> </semantics></math>.</p>
Full article ">
19 pages, 5049 KiB  
Article
Low-Carbon Dispatch Method for Active Distribution Network Based on Carbon Emission Flow Theory
by Jiang Bian, Yang Wang, Zhaoshuai Dang, Tianchun Xiang, Zhiyong Gan and Ting Yang
Energies 2024, 17(22), 5610; https://doi.org/10.3390/en17225610 - 9 Nov 2024
Viewed by 423
Abstract
In the context of integrating renewable energy sources such as wind and solar energy sources into distribution networks, this paper proposes a proactive low-carbon dispatch model for active distribution networks based on carbon flow calculation theory. This model aims to achieve accurate carbon [...] Read more.
In the context of integrating renewable energy sources such as wind and solar energy sources into distribution networks, this paper proposes a proactive low-carbon dispatch model for active distribution networks based on carbon flow calculation theory. This model aims to achieve accurate carbon measurement across all operational aspects of distribution networks, reduce their carbon emissions through controlling unit operations, and ensure stable and safe operation. First, we propose a method for measuring carbon emission intensity on the source and network sides of active distribution networks with network losses, allowing for the calculation of total carbon emissions throughout the operation of networks and their equipment. Next, based on the carbon flow distribution of distribution networks, we construct a low-carbon dispatch model and formulate its optimization problem within a Markov Decision Process framework. We improve the Soft Actor–Critic (SAC) algorithm by adopting a Gaussian-distribution-based reward function to train and deploy agents for optimal low-carbon dispatch. Finally, the effectiveness of the proposed model and the superiority of the improved algorithm are demonstrated using a modified IEEE 33-bus distribution network test case. Full article
(This article belongs to the Section B: Energy and Environment)
Show Figures

Figure 1

Figure 1
<p>Schematic diagram of the ADN and its carbon flow distribution.</p>
Full article ">Figure 2
<p>Schematic diagram of the lossless network equivalent process.</p>
Full article ">Figure 3
<p>Schematic diagram of carbon reduction of power generation equipment.</p>
Full article ">Figure 4
<p>Improved SAC algorithm structure.</p>
Full article ">Figure 5
<p>Sample topology of 33-node distribution network operation.</p>
Full article ">Figure 6
<p>Change curve of intelligent agent training reward for control group.</p>
Full article ">Figure 7
<p>Intelligent agent training reward change curve for proposed method.</p>
Full article ">Figure 8
<p>Test day electric power dispatch results.</p>
Full article ">Figure 9
<p>Operation of 1# gas-fired unit under the change in carbon potential of the main network.</p>
Full article ">Figure 10
<p>Results of energy storage device operation under carbon potential change at the connected node.</p>
Full article ">Figure 11
<p>Distribution of carbon potential at distribution network nodes for different time periods.</p>
Full article ">Figure 12
<p>Distribution of carbon potential at distribution network nodes for the proposed method.</p>
Full article ">
17 pages, 610 KiB  
Article
Sensitivity of Bayesian Networks to Noise in Their Parameters
by Agnieszka Onisko and Marek J. Druzdzel
Entropy 2024, 26(11), 963; https://doi.org/10.3390/e26110963 - 9 Nov 2024
Viewed by 405
Abstract
There is a widely spread belief in the Bayesian network (BN) community that the overall accuracy of results of BN inference is not too sensitive to the precision of their parameters. We present the results of several experiments in which we put this [...] Read more.
There is a widely spread belief in the Bayesian network (BN) community that the overall accuracy of results of BN inference is not too sensitive to the precision of their parameters. We present the results of several experiments in which we put this belief to a test in the context of medical diagnostic models. We study the deterioration of accuracy under random symmetric noise but also biased noise that represents overconfidence and underconfidence of human experts.Our results demonstrate consistently, across all models studied, that while noise leads to deterioration of accuracy, small amounts of noise have minimal effect on the diagnostic accuracy of BN models. Overconfidence, common among human experts, appears to be safer than symmetric noise and much safer than underconfidence in terms of the resulting accuracy. Noise in medical laboratory results and disease nodes as well as in nodes forming the Markov blanket of the disease nodes has the largest effect on accuracy. In light of these results, knowledge engineers should moderately worry about the overall quality of the numerical parameters of BNs and direct their effort where it is most needed, as indicated by sensitivity analysis. Full article
(This article belongs to the Special Issue Bayesian Network Modelling in Data Sparse Environments)
Show Figures

Figure 1

Figure 1
<p>The <span class="html-small-caps">Hepar II</span> network. Colors represent the role of each node: yellow are disorder nodes, blue are risk factors, history, and demographic data, and green are symptoms, signs, and laboratory tests.</p>
Full article ">Figure 2
<p>Example BN models learned from data: <span class="html-small-caps">Hepatitis</span> (<b>left</b>) and <span class="html-small-caps">Breast Cancer</span> (<b>right</b>). The yellow nodes (<span class="html-italic">Class</span> and <span class="html-italic">recurrence</span>) represent class variables.</p>
Full article ">Figure 3
<p>Scatterplots of the original (horizontal axis) vs. transformed (vertical axis) probabilities for the <span class="html-small-caps">Hepar II</span> model.</p>
Full article ">Figure 4
<p>Scatterplots of the original (horizontal axis) vs. transformed (vertical axis) probabilities for <math display="inline"><semantics> <mrow> <mi>σ</mi> <mo>=</mo> <mn>0.1</mn> </mrow> </semantics></math> and <math display="inline"><semantics> <mrow> <mi>σ</mi> <mo>=</mo> <mn>0.5</mn> </mrow> </semantics></math>. The top two plots show symmetric noise, the middle two plots show overconfidence, the bottom two plots show underconfidence.</p>
Full article ">Figure 5
<p>The average posteriors for the true diagnoses as a function of unbiased (symmetric) noise.</p>
Full article ">Figure 6
<p>The posterior probabilities of <span class="html-small-caps">Hepar II</span> disorders as a function of <math display="inline"><semantics> <mi>σ</mi> </semantics></math> on a single patient case. The lines represent posterior probabilities of the 11 disorders.</p>
Full article ">Figure 7
<p>The diagnostic accuracy of the eight models (clock-wise: <span class="html-small-caps">Hepar II</span>, <span class="html-small-caps">Lymphography</span>, <span class="html-small-caps">Primary Tumor</span>, <span class="html-small-caps">Acute Inflammation</span>, <span class="html-small-caps">Cardiotocography</span>, <span class="html-small-caps">Breast Cancer</span>, <span class="html-small-caps">Hepatitis</span>, and <span class="html-small-caps">Spect Heart</span>) as a function of the amount of unbiased (symmetric) and biased (overconfidence and underconfidence) noise.</p>
Full article ">Figure 8
<p>The diagnostic accuracy of various semantic parts (physical examinations, laboratory results, history, and disorders) of the <span class="html-small-caps">Hepar II</span> model as a function of the amount of unbiased (symmetric) noise.</p>
Full article ">Figure 9
<p>An example of a Bayesian network model with a Markov blanket of the node <span class="html-italic">X</span>. The nodes in green depict the Markov blanket of the node in red.</p>
Full article ">Figure 10
<p>The diagnostic accuracy of the four models (clock-wise: <span class="html-small-caps">Lymphography</span>, <span class="html-small-caps">Spect Heart</span>, <span class="html-small-caps">Primary Tumor</span>, and <span class="html-small-caps">Hepatitis</span>) as a function of the amount of unbiased (symmetric) noise.</p>
Full article ">Figure 11
<p>The diagnostic accuracy of the four models (clock-wise: <span class="html-small-caps">Lymphography</span>, <span class="html-small-caps">Spect Heart</span>, <span class="html-small-caps">Primary Tumor</span>, and <span class="html-small-caps">Hepatitis</span>) as a function of the amount of biased noise (overconfidence).</p>
Full article ">Figure 12
<p>The diagnostic accuracy of the four models (clock-wise: <span class="html-small-caps">Lymphography</span>, <span class="html-small-caps">Spect Heart</span>, <span class="html-small-caps">Primary Tumor</span>, and <span class="html-small-caps">Hepatitis</span>) as a function of the amount of biased (underconfidence).</p>
Full article ">
26 pages, 24941 KiB  
Article
Assessment and Dynamic Prediction of Green Space Ecological Service Value in Guangzhou City, China
by Zhefan Li, Zhaokang Zhou, Zhenhua Liu, Jiahe Si and Jiaming Ou
Remote Sens. 2024, 16(22), 4180; https://doi.org/10.3390/rs16224180 - 8 Nov 2024
Viewed by 553
Abstract
As an important part of the urban ecosystem, urban green space provides a variety of ecosystem services, including climate regulation, soil conservation, carbon sink and oxygen release, and biodiversity protection. However, existing remote sensing evaluation methods for ecological service value lack the evaluation [...] Read more.
As an important part of the urban ecosystem, urban green space provides a variety of ecosystem services, including climate regulation, soil conservation, carbon sink and oxygen release, and biodiversity protection. However, existing remote sensing evaluation methods for ecological service value lack the evaluation indicators of ecosystem service value for Guangzhou, China, and the evaluation method depends on the land cover type. Based on remote sensing technology and random forest algorithm, this study addresses these gaps by integrating remote sensing technology with a random forest algorithm to enhance the accuracy and rationality of ESV assessments. Focusing on Guangzhou, China, we improved the ecological service value evaluation system and conducted dynamic predictions based on land-use change scenarios. Our results indicate that the total ESV of Guangzhou’s green space was USD 7.323 billion in 2020, with a projected decline to USD 6.496 billion by 2030, representing a 12.37% reduction due to urbanization-driven land-use changes. This research highlights the noticeable role of green spaces in urban sustainability and provides robust, data-driven insights for policymakers to design more effective green space protection and management strategies. The improved assessment framework offers a novel approach for accurately quantifying urban ecosystem services and predicting future trends. Full article
Show Figures

Figure 1

Figure 1
<p>Geographical location and land use survey of Guangzhou.</p>
Full article ">Figure 2
<p>Flow chart depicting the research methodology.</p>
Full article ">Figure 3
<p>Demonstration of the stochastic forest model used in near-surface temperature inversion (Note: NSAT is the station temperature data obtained by the weather station as the input variable to be explained, LST is the land surface temperature, NDVI is the normalized vegetation index, MNDWI is the improved normalized water index, and Albedo is the surface reflectivity, which are all input characteristic variables. The accuracy of the final prediction is compared with that of the traditional linear method).</p>
Full article ">Figure 4
<p>Land use map of Guangzhou.</p>
Full article ">Figure 5
<p>Spatial distribution of water conservation value in Guangzhou.</p>
Full article ">Figure 6
<p>Scatterplots of measured versus estimated values of NSAT based on (<b>a</b>) 54 training samples and (<b>b</b>) 24 testing samples.</p>
Full article ">Figure 7
<p>Inversion results of near-surface air temperature in Guangzhou.</p>
Full article ">Figure 8
<p>Annual NPP total map.</p>
Full article ">Figure 9
<p>Spatial distribution of oxygen release value.</p>
Full article ">Figure 10
<p>Carbon sequestration value per unit area of Guangzhou.</p>
Full article ">Figure 11
<p>The value of SO<sub>2</sub> absorbed per unit area of Guangzhou City.</p>
Full article ">Figure 12
<p>The value of dust retention per unit area in Guangzhou.</p>
Full article ">Figure 13
<p>Soil and water conservation capacity factors and soil conservation capacity in Guangzhou (Note: (<b>a</b>–<b>e</b>) represent the spatial distribution maps of the annual rainfall erosivity index R value, the soil erosion factor K value, the slope length factor LS, the vegetation coverage factor C, the soil and water conservation measure factor P, respectively. (<b>f</b>) represents the final spatial distribution map of soil conservation capacity).</p>
Full article ">Figure 14
<p>The value of reducing land loss per unit area in Guangzhou.</p>
Full article ">Figure 15
<p>The value of reducing siltation disaster per unit area in Guangzhou.</p>
Full article ">Figure 16
<p>Conservation value of biodiversity per unit area in Guangzhou.</p>
Full article ">Figure 17
<p>The total value of ecological services per unit area in Guangzhou.</p>
Full article ">Figure 18
<p>Prediction results of land use change in Guangzhou in 2030.</p>
Full article ">Figure 19
<p>(<b>a</b>) Temperature (unit: °C) distribution map of Guangzhou based on traditional spatial interpolation method; (<b>b</b>) Temperature distribution map (unit: °C) of Guangzhou based on random forest model; (<b>c</b>) 1~4 correspond to the spatial interpolation and the detailed map of the air temperature (unit: °C) obtained by RF, respectively.</p>
Full article ">Figure 20
<p>Temperature fitting curve. (Note: Figures (1–4) are the fitting curves of Lasso regression, Ridge regression, Ordinary least squares method and Random Forest method, respectively).</p>
Full article ">
27 pages, 2575 KiB  
Article
Evade Unknown Pursuer via Pursuit Strategy Identification and Model Reference Policy Adaptation (MRPA) Algorithm
by Zitao Su, Shuang Zheng, Zhiqiang Xu, Lili Cheng, Chengyang Tao, Rongkai Qie, Weijia Feng, Zhaoxiang Zhang and Yuelei Xu
Drones 2024, 8(11), 655; https://doi.org/10.3390/drones8110655 - 8 Nov 2024
Viewed by 403
Abstract
The game of pursuit–evasion has always been a popular research subject in the field of Unmanned Aerial Vehicles (UAVs). Current evasion decision making based on reinforcement learning is generally trained only for specific pursuers, and it has limited performance for evading unknown pursuers [...] Read more.
The game of pursuit–evasion has always been a popular research subject in the field of Unmanned Aerial Vehicles (UAVs). Current evasion decision making based on reinforcement learning is generally trained only for specific pursuers, and it has limited performance for evading unknown pursuers and exhibits poor generalizability. To enhance the ability of an evasion policy learned by reinforcement learning (RL) to evade unknown pursuers, this paper proposes a pursuit UAV attitude estimation and pursuit strategy identification method and a Model Reference Policy Adaptation (MRPA) algorithm. Firstly, this paper constructs a Markov decision model for the pursuit–evasion game of UAVs that includes the pursuer’s attitude and trains an evasion policy for a specific pursuit strategy using the Soft Actor–Critic (SAC) algorithm. Secondly, this paper establishes a novel relative motion model of UAVs in pursuit–evasion games under the assumption that proportional guidance is used as the pursuit strategy, based on which the pursuit UAV attitude estimation and pursuit strategy identification algorithm is proposed to provide adequate information for decision making and policy adaptation. Furthermore, a Model Reference Policy Adaptation (MRPA) algorithm is presented to improve the generalizability of the evasion policy trained by RL in certain environments. Finally, various numerical simulations imply the precision of pursuit UAV attitude estimation and the accuracy of pursuit strategy identification. Also, the ablation experiment verifies that the MRPA algorithm can effectively enhance the performance of the evasion policy to deal with unknown pursuers. Full article
(This article belongs to the Collection Drones for Security and Defense Applications)
Show Figures

Figure 1

Figure 1
<p>Relative motion relationship between evasive and pursuit UAVs.</p>
Full article ">Figure 2
<p>Failure mechanism of optimal policy.</p>
Full article ">Figure 3
<p>Structure of MRPA algorithm.</p>
Full article ">Figure 4
<p>Trajectories of pursuit and evasive UAVs.</p>
Full article ">Figure 5
<p>Performance of relative motion mode.</p>
Full article ">Figure 6
<p>State estimation in straight-line maneuvers.</p>
Full article ">Figure 7
<p>State estimation in barrel roll maneuvers.</p>
Full article ">Figure 8
<p>Identification of <span class="html-italic">K</span> in straight-line maneuvers.</p>
Full article ">Figure 9
<p>Identification of <span class="html-italic">K</span> in barrel roll maneuvers.</p>
Full article ">Figure 10
<p>Identification of <span class="html-italic">K</span> in barrel roll maneuver with step change.</p>
Full article ">Figure 11
<p>Identification of <span class="html-italic">K</span> in barrel roll maneuver with linear change.</p>
Full article ">Figure 12
<p>Identification of <span class="html-italic">K</span> in barrel roll maneuver with sinusoidal variation.</p>
Full article ">Figure 13
<p>Identification of <span class="html-italic">K</span> in barrel roll maneuver with linear change and observational noise.</p>
Full article ">Figure 14
<p>Identification of <span class="html-italic">K</span> in barrel roll maneuver with step change and observational noise.</p>
Full article ">Figure 15
<p>Identification of <span class="html-italic">K</span> in barrel roll maneuver with sinusoidal variation with observational noise.</p>
Full article ">Figure 16
<p>Comparison of training results of three methods.</p>
Full article ">Figure 17
<p>Statistics of survival time of MRPA and Data Argument–SAC.</p>
Full article ">Figure 18
<p>Trajectories of evader and pursuer in three experiments.</p>
Full article ">Figure 19
<p>Change in relative situation of typical cases in three experiments.</p>
Full article ">Figure 20
<p>Statistics of survival time of each group in ablation experiment.</p>
Full article ">Figure 21
<p>Evasion success rate statistics.</p>
Full article ">
17 pages, 1051 KiB  
Article
Optimal Model-Free Mean-Square Consensus for Multi-Agents with Markov Switching Topology
by Ruoxun Ma, Lipo Mo and Bokang Zhou
Appl. Sci. 2024, 14(22), 10273; https://doi.org/10.3390/app142210273 - 8 Nov 2024
Viewed by 406
Abstract
Due to the real applications, optimal consensus reinforcement learning with switching topology is still challenging due to the complexity of topological changes. This paper investigates the optimal consensus control problem for discrete multi-agent systems under Markov switching topologies. The goal is to design [...] Read more.
Due to the real applications, optimal consensus reinforcement learning with switching topology is still challenging due to the complexity of topological changes. This paper investigates the optimal consensus control problem for discrete multi-agent systems under Markov switching topologies. The goal is to design an appropriate algorithm to find the optimal control policies that minimize the performance index while achieving consensus among the agents. The concept of mean-square consensus is introduced, and the relationship between consensus error and tracking error to achieve mean-square consensus is studied. A performance function for each agent under switching topologies is established and a policy iteration algorithm using system data is proposed based on the Bellman optimality principle. The theoretical analysis shows that the consensus error realizes mean-square consensus and the performance function is optimized. The efficacy of the suggested approach is confirmed by numerical simulation using an actor–critic neural network. As a result, the value function is the optimum and the mean-square consensus can be reached using this technique. Full article
Show Figures

Figure 1

Figure 1
<p>Learning process of actor–critic NNs.</p>
Full article ">Figure 2
<p>(<b>a</b>) <math display="inline"><semantics> <msub> <mi mathvariant="script">G</mi> <mn>1</mn> </msub> </semantics></math>, (<b>b</b>) <math display="inline"><semantics> <msub> <mi mathvariant="script">G</mi> <mn>2</mn> </msub> </semantics></math>, (<b>c</b>) <math display="inline"><semantics> <msub> <mi mathvariant="script">G</mi> <mrow> <mi>u</mi> <mi>n</mi> </mrow> </msub> </semantics></math>.</p>
Full article ">Figure 3
<p>Markovian switching signal.</p>
Full article ">Figure 4
<p>State trajectories of the leader and follower agents.</p>
Full article ">Figure 5
<p>Tracking errors.</p>
Full article ">Figure 6
<p>Three-dimensional phase plane plot.</p>
Full article ">
Back to TopTop