Nothing Special   »   [go: up one dir, main page]
Skip to main content

Advertisement

Springer Nature Link
Log in

A policy iteration algorithm for fixed point problems with nonexpansive operators

  • Original Article
  • Published:
Mathematical Methods of Operations Research Aims and scope Submit manuscript

Abstract

The aim of this paper is to solve the fixed point problems:

$$ v = \mathcal{O}v,\quad \hbox{with}\, \mathcal{O}v(x) \mathop{=}^{\rm def} \max (Lv(x), Bv(x) ), x \in \varepsilon, \quad (1)$$

where \(\varepsilon\) is a finite set, L is contractive and B is a nonexpansive operator and

$$ v = \mathcal{O}v,\quad \hbox{with} \mathcal{O}v(x) \mathop{=}^{\rm def} \max\left(\sup_{w \in \mathcal{W}} L^{w} v(x) ,\sup_{z \in \mathcal{Z}} B^{z} v(x)\right), x \in \varepsilon, \quad (2)$$

where \(\mathcal{W}\) and \(\mathcal{Z}\) are general control sets, the operators L w are contractive and operators B z are nonexpansive. For these two problems, we give conditions which imply existence and uniqueness of a solution and provide a policy iteration algorithm which converges to the solution. The proofs are slightly different for the two problems since the set of controls is finite for (1) while it is not necessary the case for problem (2). Equation (2) typically arises in numerical analysis of quasi variational inequalities and variational inequalities associated to impulse or singular stochastic control.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  • Bertsekas DP (2001) Dynamic programming and optimal control, vol I and II. Athena Scientific, Belmont

    Google Scholar 

  • Chancelier J-Ph, Øksendal B, Sulem A (2002) Combined stochastic control and optimal stopping, and application to numerical approximation of combined stochastic and impulse control. In: Stochastic Financial Mathematics, Proceedings of Steklov Math. Inst., Moscou, vol. 237, editeur A.N. Shiryaev, pp 149 –173 2002

  • Gaubert S, Gunawardena J (privately circuled draft) Existence of the cycle time for some subtopical functions

  • Kushner HJ, Dupuis P (2001) Numerical methods for stochastic control problems in continuous time, 2nd edn. Springer, Berlin Heidelberg New York

    MATH  Google Scholar 

  • Øksendal B, Sulem A (2005) Applied stochastic control of jump diffusions. Universitext. Springer, Berlin Heidelberg New York

    Google Scholar 

  • Øksendal B, Sulem A (2002) Optimal consumption and portfolio with both fixed and proportional transaction costs. SIAM J Control Optim 40(6): 1765–1790

    Article  MathSciNet  Google Scholar 

  • Puterman ML (1994) Markov decision processes: discrete stochastics markov decision processes: Discrete Stochastics Dynamic Programming. Probability and Mathematical Statistics: applied probability and statistics section. Wiley, New York

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Ceramics, École Nationale des Ponts et Chaussées, Paritech, 6 et 8 avenue Blaise Pascal, 77455, Marne la Vallée Cedex, France

    Jean-Philippe Chancelier

  2. Inria, Mathfi project, Domaine de Voluceau, BP 105, Rocquencourt, 78153, Le Chesnay Cedex, France

    Marouen Messaoud & Agnès Sulem

Authors
  1. Jean-Philippe Chancelier
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Marouen Messaoud
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Agnès Sulem
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Jean-Philippe Chancelier.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Chancelier, JP., Messaoud, M. & Sulem, A. A policy iteration algorithm for fixed point problems with nonexpansive operators. Math Meth Oper Res 65, 239–259 (2007). https://doi.org/10.1007/s00186-006-0103-3

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00186-006-0103-3

Keywords

Search

Navigation