Hostname: page-component-78c5997874-v9fdk Total loading time: 0 Render date: 2024-11-19T23:52:41.932Z Has data issue: false hasContentIssue false

On the Bellman equations with varying control

Published online by Cambridge University Press:  17 April 2009

Shigeaki Koike
Affiliation:
Department of Mathematics, Saitama University, Urawa, Saitama 338, Japan, e-mail: [email protected]
Rights & Permissions [Opens in a new window]

Extract

Core share and HTML view are not available for this content. However, as you have access to this content, a full PDF is available via the ‘Save PDF’ action button.

The value function is presented by minimisation of a cost functional over admissible controls. The associated first order Bellman equations with varying control are treated. It turns out that the value function is a viscosity solution of the Bellman equation and the comparison principle holds, which is an essential tool in obtaining the uniqueness of the viscosity solutions.

Type
Research Article
Copyright
Copyright © Australian Mathematical Society 1996

References

[1]Cahill, A.J., James, M.R., Kieffer, J.C. and Williamson, D., ‘Optimal path timing robot manipulators via dynamic programming’, (preprint).Google Scholar
[2]Crandall, M.G., Ishii, H. and Lions, P.-L., ‘User's guide to viscosity solutions of second order partial differential equations’, Bull. Amer. Math. Soc. 27 (1992), 167.CrossRefGoogle Scholar
[3]Fleming, W.H. and Soner, H. M., Controlled Markov processes and viscosity solutions (Springer-Verlag, Berlin, Heidelberg, New York, 1992).Google Scholar
[4]Ishii, H., ‘A boundary value problem of the Dirichlet type for Hamilton-Jacobi equations’, Ann. Scoula Norm. Sup. Pisa Cl. Sci. 16 (1989), 1445.Google Scholar
[5]Ishii, H., ‘Perron's method for Hamilton-Jacobi equations’, Duke Math. J. 55 (1987), 369384.CrossRefGoogle Scholar
[6]Ishii, H. and Koike, S., ‘A new formulation of state constraint problem of first-order PDEs’, SIAM J. Control Optim. (to appear).Google Scholar
[7]Koike, S., ‘On the state constraint problem for differential games’ Indiana Univ. Math. J. (to appear).Google Scholar