Numerical Solution of Optimal Feedback Control for Finite Horizon Optimal Control Problem with Growth Condition
DOI:
https://doi.org/10.55578/jdso.2611.011Keywords:
Optimal feedback control, Hamilton-Jacobi-Bellman equation, viscosity solution, uniqueness, approximation scheme, convergenceAbstract
In this paper, we study approximation of optimal feedback control for the finite horizon optimal control problem with growth conditions for control systems and cost functionals. The optimal control problems with growth conditions are usually applied in practice. In reducing the boundedness for the dynamics function to the growth conditions, we have some difficulty in proving the convergence of the approximation scheme by the Euler scheme. First, we prove comparison principle of unbounded viscosity solution under the growth condition for the dynamics function and prove that the value function is the unique viscosity solution of the Hamilton-Jacobi-Bellman (HJB) equation. We then construct a new approximation scheme using Euler implicit scheme for the finite horizon optimal control problem and prove that the approximation value function converges to the viscosity solution of the HJB equation as the discretization step goes to zero. Based on the approximations of the viscosity solution, we construct the optimal feedback controls for the corresponding discrete control systems. We consider an example to show the efficiency of the time-space approximation algorithm by the Euler implicit scheme through computational results.
References
[1] Bardi, M., & Capuzzo Dolcetta, I. (1997). Optimal control and viscosity solutions of Hamilton-Jacobi-Bellman equations. Birkhauser.
[2] Crandall, M. G., Evans, L. C., & Lions, P. L. (1984). Some properties of viscosity solutions of Hamilton-Jacobi equations. Transactions of the American Mathematical Society, *282*, 487-502.
[3] Crandall, M. G., Evans, L. C., & Lions, P. L. (1992). Users guide to viscosity solutions of second order partial differential equations. Bulletin of the American Mathematical Society, *27*, 1-67.
[4] Crandall, M. G., & Lions, P. L. (1983). Viscosity solutions of Hamilton-Jacobi equations. Transactions of the American Mathematical Society, *277*, 1-42.
[5] Kim, U., & Hong, C. (2026). Unbounded viscosity solutions of Hamilton-Jacobi-Bellman equation for the finite horizon optimal control problem. Proceedings of the 9th International School-Seminar on Nonlinear Analysis and Extremal Problems, 96-98.
[6] Alla, A., Falcone, M., & Volkwein, S. (2015). Error analysis for POD approximations of infinite horizon problems via the dynamic programming approach. Konstanzer Schriften in Mathematik, *339*, 1-23.
[7] Bardi, M., & Falcone, M. (1990). An approximation scheme for the minimum time function. SIAM Journal on Control and Optimization, *28*, 950-965.
[8] Barles, G., & Souganidis, P. E. (1991). Convergence of approximation schemes for fully nonlinear second order equations. Journal of Asymptotic Analysis, *4*, 271-283.
[9] Camilli, F., & Falcone, M. (1997). Analysis and approximation of the infinite-horizon problem with impulsive controls. Automation and Remote Control, *58*, 1203-1215.
[10] Camilli, F., & Grune, L. (2000). Numerical approximation of the maximal solutions for a class of degenerate Hamilton-Jacobi equations. SIAM Journal on Numerical Analysis, *37*, 1540-1560.
[11] Capuzzo Dolcetta, I. (1983). On a discrete approximation of the Hamilton-Jacobi equation of dynamic programming. Applied Mathematics & Optimization, *10*, 367-377.
[12] Capuzzo Dolcetta, I., & Ishii, H. (1984). Approximate solutions of the Bellman equation of deterministic control theory. Applied Mathematics & Optimization, *11*, 161-181.
[13] Souganidis, P. E. (1985). Approximation schemes for viscosity solutions of Hamilton-Jacobi equations. Journal of Differential Equations, *59*, 1-43.
[14] Alla, A., Falcone, M., & Saluzzi, L. (2019). High-order approximation of the finite horizon optimal control problems via at tree structure algorithm. IFAC PapersOnLine, *5-12*, 19-24.
[15] Falcone, M., & Ferretti, R. (2002). Semi-Lagrangian schemes for Hamilton-Jacobi equations, discrete representation formulae and Godunov methods. Journal of Computational Physics, *175*, 559-575.
[16] Guo, B. Z., & Wu, T. T. (2010). Approximation of optimal feedback control. Journal of Global Optimization, *46*, 395-422.
[17] Guo, B. Z., & Wu, T. T. (2017). Numerical solution to optimal feedback control by dynamic programming approach. Journal of Systems Science and Complexity, *30*, 782-802.
[18] Guo, B. Z., & Sun, B. (2005). Numerical solution to the optimal birth feedback control of a population dynamics: Viscosity solution approach. Optimal Control Applications and Methods, *26*, 229-254.
[19] Sun, B., & Guo, B. Z. (2015). Convergence of an upwind finite-difference scheme for Hamilton-Jacobi-Bellman equation in optimal control. IEEE Transactions on Automatic Control, *60*(11), 3012-3017.
[20] Camilli, F., & Falcone, M. (1999). Approximation of control problems involving ordinary and impulsive controls. ESAIM: Control Optim. Calc. Var., *4*, 159-176.
[21] El Farouq, N. (2017). Deterministic impulse control problems: Two discrete approximations of the quasi-variational inequality. Journal of Computational and Applied Mathematics, *309*, 200-218.
[22] Barles, G., Dharmatti, S., & Ramaswamy, M. (2010). Unbounded viscosity solutions of hybrid control systems. ESAIM Control Optim. Calc., *16*(2-1), 176-193.
[23] Ramaswamy, M., & Dharmatti, S. (2006). Uniqueness of unbounded viscosity solutions for impulse control problem. Journal of Mathematical Analysis and Applications, *315*, 686-710.
[24] Kim, U., & Hong, C. (2025). Approximation schemes for impulse control systems with unbounded cost functional. International Journal of Chemistry, Mathematics and Physics, *9*(4), 60-67.
[25] Carrere, C., & Zidani, H. (2020). Stability and reachability analysis for a controlled heterogeneous population of cells. Optimal Control Applications and Methods, *41*, 1678-1704.
[26] Crandall, M. G., & Lions, P. L. (1984). Two approximations of solutions of Hamilton-Jacobi equations. Mathematics of Computation, *43*, 1-19.
[27] Falcone, M. (1987). A numerical approach to the infinite horizon problem of deterministic control theory. Applied Mathematics & Optimization, *15*, 1-13.
Downloads
Published
Data Availability Statement
The authors declare that all data in the paper are available.
Issue
Section
License
Copyright (c) 2026 Yunchol Jong, Gilmyong Hong, Changgil Hong (Author)
This work is licensed under a Creative Commons Attribution 4.0 International License.