A new framework for the optimal control of probability density functions (PDF) of stochastic processes is reviewed. This framework is based on Fokker–Planck (FP) partial differential equations that govern the time evolution of the PDF of stochastic systems and on control objectives that may require to follow a given PDF trajectory or to minimize an expectation functional. Corresponding to different stochastic processes, different FP equations are obtained. In particular, FP equations of parabolic, fractional parabolic, integro parabolic, and hyperbolic type are discussed. The corresponding optimization problems are deterministic and can be formulated in an open-loop framework and within a closed-loop model predictive control strategy. The connection between the Dynamic Programming scheme given by the Hamilton–Jacobi–Bellman equation and the FP control framework is discussed. Under appropriate assumptions, it is shown that the two strategies are equivalent. Some applications of the FP control framework to different models are discussed and its extension in a mean-field framework is elucidated.

A Fokker–Planck control framework for stochastic systems

Annunziato Mario;
2018-01-01

Abstract

A new framework for the optimal control of probability density functions (PDF) of stochastic processes is reviewed. This framework is based on Fokker–Planck (FP) partial differential equations that govern the time evolution of the PDF of stochastic systems and on control objectives that may require to follow a given PDF trajectory or to minimize an expectation functional. Corresponding to different stochastic processes, different FP equations are obtained. In particular, FP equations of parabolic, fractional parabolic, integro parabolic, and hyperbolic type are discussed. The corresponding optimization problems are deterministic and can be formulated in an open-loop framework and within a closed-loop model predictive control strategy. The connection between the Dynamic Programming scheme given by the Hamilton–Jacobi–Bellman equation and the FP control framework is discussed. Under appropriate assumptions, it is shown that the two strategies are equivalent. Some applications of the FP control framework to different models are discussed and its extension in a mean-field framework is elucidated.
File in questo prodotto:
Non ci sono file associati a questo prodotto.

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/11386/4728558
 Attenzione

Attenzione! I dati visualizzati non sono stati sottoposti a validazione da parte dell'ateneo

Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus ND
  • ???jsp.display-item.citation.isi??? 16
social impact