Analysis and Control of Stochastic Systems Using Semidefinite Programming over Moments

Andrew Lamperski, Khem Raj Ghusinga, Abhyudai Singh

Research output: Contribution to journalArticlepeer-review

6 Scopus citations


This technical note develops a unified methodology for probabilistic analysis and optimal control design for jump diffusion processes defined by polynomials. The statistical moments of these systems can be described by a system of linear ordinary differential equations. Typically, however, the low-order moments depend on higher order moments, thus requiring an infinite system of equations to compute any moment exactly. Here, we develop a methodology for bounding statistical moments by using the higher order moments as inputs to an auxiliary convex optimal control problem with semidefinite constraints. For steady-state problems, the auxiliary optimal control problem reduces to a static semidefinite program. The method applies to both controlled and uncontrolled stochastic processes. For stochastic optimal control problems, the method gives bounds on achievable performance and can be used to compute approximately optimal solutions. For uncontrolled problems, both upper and lower bounds on desired moments can be computed. While the accuracy of most moment approximations cannot be quantitatively characterized, our method guarantees that the moment of interest is between the computed bounds.

Original languageEnglish (US)
Article number8472813
Pages (from-to)1726-1731
Number of pages6
JournalIEEE Transactions on Automatic Control
Issue number4
StatePublished - Apr 2019

Bibliographical note

Funding Information:
Manuscript received October 26, 2017; revised October 26, 2017 and June 18, 2018; accepted June 30, 2018. Date of publication September 26, 2018; date of current version March 27, 2019. The work of A. Singh was supported by the National Science Foundation under Grant ECCS-1711548. Recommended by Associate Editor U. V. Shanbhag. (Corresponding author: Andrew Lamperski.) A. Lamperski is with the University of Minnesota, Minneapolis, MN 55455 USA (e-mail:,

Publisher Copyright:
© 1963-2012 IEEE.


  • Optimal control
  • nonlinear systems
  • stochastic processes


Dive into the research topics of 'Analysis and Control of Stochastic Systems Using Semidefinite Programming over Moments'. Together they form a unique fingerprint.

Cite this