Skip to main navigation Skip to search Skip to main content

An Adaptive Multi-Level Max-Plus Method for Deterministic Optimal Control Problems

  • Ecole polytechnique

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

We introduce a new numerical method to approximate the solution of a finite horizon deterministic optimal control problem. We exploit two Hamilton-Jacobi-Bellman PDE, arising by considering the dynamics in forward and backward time. This allows us to compute a neighborhood of the set of optimal trajectories, in order to reduce the search space. The solutions of both PDE are successively approximated by max-plus linear combinations of appropriate basis functions, using a hierarchy of finer and finer grids. We show that the sequence of approximate value functions obtained in this way does converge to the viscosity solution of the HJB equation in a neighborhood of optimal trajectories. Then, under certain regularity assumptions, we show that the number of arithmetic operations needed to compute an approximate optimal solution of a d-dimensional problem, up to a precision ε, is bounded by O(Cd|log ε|), for some constant C > 1, whereas ordinary grid-based methods have a complexity in O(1/εad) for some constant a > 0.

Original languageEnglish
Title of host publicationIFAC-PapersOnLine
EditorsHideaki Ishii, Yoshio Ebihara, Jun-ichi Imura, Masaki Yamakita
PublisherElsevier B.V.
Pages7448-7455
Number of pages8
Edition2
ISBN (Electronic)9781713872344
DOIs
Publication statusPublished - 1 Jul 2023
Event22nd IFAC World Congress - Yokohama, Japan
Duration: 9 Jul 202314 Jul 2023

Publication series

NameIFAC-PapersOnLine
Number2
Volume56
ISSN (Electronic)2405-8963

Conference

Conference22nd IFAC World Congress
Country/TerritoryJapan
CityYokohama
Period9/07/2314/07/23

Keywords

  • Hamilton-Jacobi-Bellman PDE
  • Optimal control
  • curse-of-dimensionality
  • dynamic programming
  • max-plus algebra

Fingerprint

Dive into the research topics of 'An Adaptive Multi-Level Max-Plus Method for Deterministic Optimal Control Problems'. Together they form a unique fingerprint.

Cite this