MAXIMUM PRINCIPLE FOR STOCHASTIC OPTIMAL CONTROL PROBLEM WITH DISTRIBUTED DELAYS

doi:10.1007/s10473-021-0208-z

Abstract

Abstract: This paper is concerned with a Pontryagin's maximum principle for the stochastic optimal control problem with distributed delays given by integrals of not necessarily linear functions of state or control variables. By virtue of the duality method and the generalized anticipated backward stochastic differential equations, we establish a necessary maximum principle and a sufficient verification theorem. In particular, we deal with the controlled stochastic system where the distributed delays enter both the state and the control. To explain the theoretical results, we apply them to a dynamic advertising problem.

Key words: Distributed delay, generalized anticipated backward stochastic differential equations, optimal control, maximum principle

CLC Number:

93E20

Qixia ZHANG. MAXIMUM PRINCIPLE FOR STOCHASTIC OPTIMAL CONTROL PROBLEM WITH DISTRIBUTED DELAYS[J].Acta mathematica scientia,Series B, 2021, 41(2): 437-449.

Trendmd

References

[1] Mohammed S-E A. Stochastic differential equations with memory:theory, examples and applications//Progress in probability, stochasic analysis and related topics 6. Birkhäser:The geido workshop, 1998
[2] Arriojas M, Hu Y, Mohammed S-E A, Pap G. A delayed Black and Scholes formula. Stoch Anal Appl, 2007, 25(2):471-492
[3] Øksendal B, Sulem A. A maximum principle for optimal control of stochastic systems with delay, with applications to finance//Menaldi J M, Rofman E, Sulem A. Optimal Control and Partial Differential Equations. 64-79. Amsterdam, The Netherlands:ISO Press, 2000
[4] Larssen B. Dynamic programming in stochastic control of systems with delay. Stoch Stoch Rep, 2002, 74:651-673
[5] Peng S G, Yang Z. Anticipated backward stochastic differential equations. Ann Probab, 2009, 37(3):877-902
[6] Chen L, Wu Z. Maximum principle for the stochastic optimal control problem with delay and application. Automatica, 2010, 46:1074-1080
[7] Yu Z Y. The stochastic maximum principle for optimal control problems of delay systems involving continuous and impulse controls. Automatica, 2012, 56(6):1401-1406
[8] Chen L, Yu Z Y. Maximum principle for nonzero-sum stochastic differential game with delays. IEEE T Automat Contr, 2015, 60(5):1422-1426
[9] Gozzi F, Marinelli C. Stochastic optimal control of delay equations arising in advertising models//Stochastic Partial Differential Equations & Applications-VⅡ. Papers of the 7th meeting, Levico, Terme,Italy, January 5-10, 2004. Boca Raton, FL:Chapman and Hall/CRC. Lecture Notes in Pure and Applied Mathematics, 2006, 245:133-148
[10] Nerlove M, Arrow J K. Optimal advertising policy under dynamic conditions. Economica, 1962, 29:129-142
[11] Agram N, Haadem S, Øksendal B, Proske F. A maximum principle for infinite horizon delay equations. SIAM J Math Anal, 2013, 45:2499-522
[12] Shen Y, Meng Q X, Shi P. Maximum principle for mean-field jump-diffusion stochastic delay differential equations and its application to finance. Automatica, 2014, 50(6):1565-1579
[13] Øksendal B, Sulem A, Zhang T. Optimal control of stochastic delay equations and time-advanced backward stochastic differential equations. Adv Appl Probab, 2011, 43(2):572-596
[14] Meng Q X, Shen Y. Optimal control of mean-field jump-diffusion systems with delay:A stochastic maximum principle approach. J Comput Appl Math, 2015, 279:13-30
[15] Yang Z, Elliott R J. Some properties of generalized anticipated backward stochastic differential equations. Electro Commun Prob, 2013, 18(63):1-10
[16] Agram N, Øksendal B. Mean-field stochastic control with elephant memory in finite and infinite time horizon. Stochastics, 2019, 91(7):1041-1066
[17] Xu X M. Fully coupled forward-backward stochastic functional differential equations and applications to quadratic optimal control. 2013, arXiv:1310.6846
[18] Garzon J, Tindel S, Torres S. Euler scheme for fractional delay stochastic differential equations by rough paths techniques. Acta Mathematica Scientia, 2019, 39B(3):747-763
[19] Zhang W S, Chen Y P, Numerical analysis for Volterra integral equation with two kinds of delay. Acta Mathematica Scientia, 2019, 39B(2):602-617