Abstract
We consider the optimal program control problem for a stochastic state- and control-nonlinear jump diffusion system with a given performance functional linear-quadratic in the state. Necessary and sufficient local optimality conditions are obtained, and a numerical procedure for the successive improvement of a given control program is developed. Examples of optimization problems for a switched system with random initial data and terminal invariance are considered as applications.
Similar content being viewed by others
REFERENCES
Khrustalev, M.M., Rumyantsev, D.S., and Tsarkov, K.A., Optimization of quasilinear stochastic control-nonlinear diffusion systems, Autom. Remote Control, 2017, vol. 78, no. 6, pp. 1028–1045.
Khrustalev, M.M. and Tsarkov, K.A., Sufficient relative minimum conditions in the optimal control problem for quasilinear stochastic systems, Autom. Remote Control, 2018, vol. 79, no. 12, pp. 2169–2185.
Khrustalev, M.M. and Tsar’kov, K.A., Moment characteristic method in the optimal control theory of diffusion-type stochastic systems, J. Comput. Syst. Sci. Int., 2019, vol. 58, no. 5, pp. 684–694.
Øksendal, B. and Sulem, A., Applied Stochastic Control of Jump Diffusions, Berlin–Heidelberg: Springer, 2005.
Platen, E. and Bruti-Liberati, N., Numerical Solution of Stochastic Differential Equations with Jumps in Finance, Berlin–Heidelberg: Springer, 2010.
Yin, G. and Zhu, C., Hybrid Switching Diffusions, New York: Springer, 2010.
Bortakovskii, A.S. and Nemychenkov, G.I., Optimal in the mean control of deterministic switchable systems given discrete inexact measurements, J. Comput. Syst. Sci. Int., 2019, vol. 58, no. 1, pp. 50–74.
Korolyuk, V.S., Portenko, N.I., Skorokhod, A.V., and Turbin, A.F., Spravochnik po teorii veroyatnostei i matematicheskoi statistike (Handbook of Probability Theory and Mathematical Statistics), Moscow: Nauka, 1985.
Miller, B.M. and Pankov, A.R., Teoriya sluchainykh protsessov v primerakh i zadachakh (Theory of Random Processes in Exercises and Problems), Moscow: Fizmatlit, 2002.
Khrustalev, M.M. and Tsarkov, K.A., Sufficient conditions for terminal invariance of stochastic jump diffusion systems, Autom. Remote Control, 2020, vol. 81, no. 11, pp. 2062–2077.
Krotov, V.F., Global methods in optimal control theory. advances in nonlinear dynamics and control: a report from Russia, in Progress in Systems and Control Theory, Boston: Birkhäuser, 1993, vol. 17.
Pontryagin, L.S., Boltyanskii, V.G., Gamkrelidze, R.V., and Mishchenko, E.F., Matematicheskaya teoriya optimal’nykh protsessov (Mathematical Theory of Optimal Processes), Moscow: Nauka, 1983.
Kelley, H.J., Gradient theory of optimal flight paths, J. Am. Rocket Soc., 1960, vol. 30, no. 10, pp. 947–954.
Bryson, A.E. and Denham, W.F., A steepest ascent method for solving optimum programming problems, J. Appl. Mech., 1962, vol. 29, no. 2, pp. 247–257.
Levitin, E.S. and Polyak, B.T., Minimization methods in the presence of constraints, Zh. Vychisl. Mat. Mat. Fiz., 1966, vol. 6, no. 5, pp. 787–823.
Bryson, A.E. and You-Chi Ho, Optimization, Estimation and Control, Waltham, MA–Toronto–London: Blaisdell, 1969. Translated under the title: Prikladnaya teoriya optimal’nogo upravleniya, Moscow: Nauka, 1972.
Alekseev, V.M., Tikhomirov, V.M., and Fomin, S.V., Optimal’noe upravlenie (OptimalControl), Moscow: Fizmatlit, 2005.
Krotov, V.F. and Gurman, V.I., Metody i zadachi optimal’nogo upravleniya (Methods and Problems of Optimal Control), Moscow: Nauka, 1973.
Khrustalev, M.M. and Tsarkov, K.A., Terminal invariance of jump diffusions, Dokl. Math., 2020, vol. 102, no. 1, pp. 353–355.
Hartman, P., Ordinary Differential Equations, New York–London–Sydney: John Wiley & Sons, 1964. Translated under the title: Obyknovennye differentsial’nye uravneniya, Moscow: Mir, 1970.
Dunford, N. and Schwartz, J.T., Linear Operators. Part I: General Theory, New York–London: Interscience, 1958. Translated under the title: Lineinye operatory. Obshchaya teoriya, Moscow: Izd. Inostr. Lit., 1962.
Funding
This work was financially supported in part by the Russian Foundation for Basic Research, project no. 20-08-00400.
Author information
Authors and Affiliations
Corresponding authors
Additional information
Translated by V. Potapchouck
Rights and permissions
About this article
Cite this article
Khrustalev, M.M., Tsarkov, K.A. Optimization of Stochastic Jump Diffusion Systems Nonlinear in the Control. Autom Remote Control 83, 1433–1451 (2022). https://doi.org/10.1134/S0005117922090077
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1134/S0005117922090077