13

What is the difference between optimal control and robust control?

I know that Optimal Control have the controllers:

  • LQR - State feedback controller
  • LQG - State feedback observer controller
  • LQGI - State feedback observer integrator controller
  • LQGI/LTR - State feedback observer integrator loop transfer recovery controller (for increase robustness)

And Robust Control have:

  • $H_{2}$ controller
  • $H_{\infty}$ controller

But what are they? When are they better that LQ controllers? Have the H-contollers a Kalman filter? Is the H-controllers multivariable? Are they faster that LQ-controllers?

euraad
  • 3,052
  • 4
  • 35
  • 79

2 Answers2

17

There's a huge difference. Optimal control seeks to optimize a performance index over a span of time, while robust control seek to optimize the stability and quality of the controller (its "robustness") given uncertainty in the plant model, feedback sensors, and actuators.

Optimal control assumes your model is perfect and optimizes a functional you provide. If your model is imperfect your optimal controller is not necessarily optimal! It is also only optimal for the specific cost functional you provide! LQ optimal control is ONLY truly optimal for a completely linear plant (unlikely) and a quadratic cost index. Anything else and there's no rigorous claim to optimality.

Robust control assumes your model is imperfect. Suppose, for instance, some parameters in your model are believed to be in a certain range but are not known for sure. An $H_2$ or $H_{\infty}$ controller will decide which control signals are admissible based on the level of uncertainty in the core parameters. For example, if you have the plant $$ P(s) = \frac{1}{s+a} $$ but only know $a \in [b,c]$ for some given $b$ and $c$, a robust controller will clamp overly aggressive control signals that would risk pushing the pole at $-a$ into the right-hand plane.

JMJ
  • 4,866
  • 14
  • 31
  • Thanks for the good answer. I know that Optimal controllers requires a perfect, or at least, a very good model of the system. Or else, the Optimal Contol will be Bad Control. So Robust Control is more for nonlinear control? – euraad Jul 06 '17 at 20:35
  • If I require MIMO control with an integrator and a kalman filter. Is Robust Control good for me then? Or is Robust Control only for SISO systems or 2-DOF systems? – euraad Jul 06 '17 at 20:50
  • @DanielMårtensson nonlinear control is its own thing, although there are robust nonlinear controllers. $H_n$ control for all numbers $n$ would assume a linear, MIMO plant model. Keep in mind that both are complicated to actually implement. Robust control is typically more practical, but there's also a lot of good ways to reduce MIMO to SISO based on the timeconstants of the dynamic modes. Look up sequential loop closure in the context of MIMO autopilots to see more of what I'm talking about. – JMJ Jul 06 '17 at 21:34
  • So Robust Control is better that Optimal Control? Have Robust Control a kalman filter and MIMO? How more difficult is Robust Control compered to Optimal Control? Robust Control is most only SISO? – euraad Jul 07 '17 at 05:56
  • 1
    So What's the diffrence between H2 and Hinf? – euraad Jul 07 '17 at 09:12
  • @DanielMårtensson $H_2$ and $H_{\infty}$ are the controllers which emerge from different Hardy space inner products. See https://en.wikipedia.org/wiki/H-infinity_methods_in_control_theory. Robust control is MIMO but can take SISO as a special case. Only classical control is SISO be default. Both optimal and robust control are tough in practice. – JMJ Jul 07 '17 at 19:30
  • I'm trying to learn Optimal Control, beacuse I like the kalman filtering + MIMO-functionality. Also it's very easy. But I afraid that LQG controllers are not stable for hydraulic and basic mekanical systems, due to distrurbances and noise. The other problem is that H2 and Hinf seems to hard beacuse I cannot find a good literature who explain that with practice. I have one book in Optimal Control who explain Optimal Control very good, with pictures and showing the practice. That book says that LQG/LTR is the solution to get robustness for LQG. What do you think about LQG/LTR insted of H2, Hinf? – euraad Jul 07 '17 at 22:49
  • Robust control seems to have more math and Optimal control seems to be very easy. So how stable is a Optimal controller with LQG/LTR? – euraad Jul 08 '17 at 09:28
  • Hi again! I have a issue now! What should I learn? Optimal Control or Robust Control? My goal is of course an optimal and a robust controller for a system. The most important is that the controller are going to stand against disturbances and noise. So disturbances and noise are not going to ruin the system. So what should I learn? Which controller? I realize that Optimal Control have its roots from the 60's and Robust control have the roots from the 80's. – euraad Jul 10 '17 at 18:27
  • 1
    @DanielMårtensson the type of control you actually implement on a system has everything to do with what the system is. Generally neither optimal nor robust control are used in practice. Robust control is a better bet if you do want one of the two, since its assumptions are more realistic. Many practical systems get by with just bang-bang (your heater), proportional control, or PID. If you don't have an extensive understanding of the plant dynamics and just need to control a few signals which are not strongly coupled, go with PID. Less fancy but way more durable than anything else. – JMJ Jul 10 '17 at 18:45
  • My systems is all hydraulical and mechanical systems. So I seeking something which is robust and have a good performance. The system have not afford to fail and break. It has afford to be non optimal. But the reason I have learn Optimal Control is just because the Kalman-Bucy filter. Reducing noise was awesome. But now I need to make sure that the system han both handle disturbances and noise. So is H2 or Hinf something for me? – euraad Jul 10 '17 at 19:26
  • 1
    @DanielMårtensson all hydraulic and mechanical in the sense that all of the components are hydraulic or mechanical or in the sense that you want a single controller which will control all possible systems constructed from those sort of components? I know of no theory which can produce a single controller capable of achieving the later.

    The Kalman filter is indeed widely used, but keep in mind that it's an estimator, not a controller. If the system is observable, then you can estimate the state with a KF and use it for feedback, but the KF alone does not give you any gains.

    – JMJ Jul 10 '17 at 20:06
  • I want a controller which will control possible system of hydraulical and mechanical systems. They are not diffcult built so it's not rocket science systems. But still, they need to stand against disturbances and noise. So now I reading about H2-norm. I don't know what it is, but is that some extansions for LQG controllers, to gain robustness? – euraad Jul 10 '17 at 20:35
  • I see now that H2-controller have "no guaranteed robustness margins" http://staff.uz.zgora.pl/wpaszke/materialy/ts/L7.pdf Well...then I might going to stick to SISO systems with PID control when I want a robust system, and LQG (with integral action) when I want to have a optimal system. – euraad Jul 10 '17 at 20:41
  • 1
    Both $H_2$ and $H_\infty$ controllers are also optimal. Namely, they minimizes the $H_2$ and $H_\infty$ norms of the systems. Intuitively, $H_2$ minimizes the "average" system gain over all possible input signals while $H_\infty$ minimizes the "worst case" system gain over all possible input signals. – obareey Apr 28 '19 at 16:25
3

Optimal control requires that your dynamic model of the system be perfect, whereas in reality your model is going to be nowhere close to the actual system. An incorrect model could even result in unstable system behavior.

Robust control on the other hand renders your control law impervious to modelling uncertainties thereby allowing for a realistic margin of error. The simplest and most effective robust control strategy is sliding mode control, SMC. In SMC, denote by $s \in \mathbb{R}$ a linear combination of the system's error in state, i.e.: $$s = \sum_{r = 0}^{n-1}\sigma_re^{(r)} \tag{1}$$

$\begin{align}\text{where,}& \\ &e \in \mathbb{R} : e= x - x_d \text{ is the error in system state} \\ &x_d \text{ is the desired state} \\ &e^{(r)}\text{ represents the r}^{th}\text{ derivative wrt time of }e \\ &\sigma_r\text{ are chosen such that the monic polynomial formed using them as coefficients is Hurwitz}\end{align}$

The insensitivity of SMC to model uncertainties becomes clear if we consider the following problem:

Consider that the system in consideration is given by the following dynamics, $$x^{(n)} = f(\textbf{x}) + g(\textbf{x})u\tag{2}$$ $\begin{align}\text{where,} & \\ &\textbf{x}\in\mathbb{R}^{(n-1)}: \textbf{x} = \begin{bmatrix}x \ \dot{x} \ .... \ x^{(n-1)}\end{bmatrix}^{T} \text{ is the system state} \\ &f, g \in \mathbb{R}\text{ are scalar functions assumed smooth} \\ &u \text{ is the control input}\end{align}$

For conciseness, assume that $g(\textbf{x}) = 1$, but the derivation extends trivially to the general case, and that the following relation is known, $$\mid\text{ }f - \hat{f}\mid\text{ } \leq \text{ F} \tag{3}$$

where, $\text{ }F\text{ is a constant , }\hat{f}\text{ is our estimate on the dynamics, i.e., on f. }$

Now taking derivative of (1): $$\begin{align}&\dot{s} = x^{(n)} - x_d^{(n)} + \sigma_{n-2}e^{(n-1)}\text{ + ...} \\ \implies\text{ } & \dot{s} = f + u - v\tag{from (2)}\end{align}$$

where, $v = x_d^{(n)} - \sigma_{n-2}e^{(n-1)}\text{ + ...}$

Let u = $v - \hat{f} -Ksgn(s)$ where K is a constant whose value will be made clear further. Now consider the Lyapunov function, $$\begin{align} & V = \frac{1}{2}s^2 \\ \implies\text{ } & \dot{V} = s\dot{s} \\ \implies\text{ } &\dot{V} = s(f + u - v) \\ \implies\text{ } & \dot{V} = s(f - \hat{f} - Ksgn(s))\end{align}$$

if we chose, K = F + $\eta$, where $\eta > 0$ then, $$\dot{V} \leq -\eta\mid{s}\text{ }\mid$$

Thus, by Lyapunov theory we have finite convergence of $s$ to $0$. How does this help? When $s = 0$, from (1), $$e^{(n-1)} + \sum_{r = 0}^{n-2}\sigma_re^{(r)} = 0$$ which represents a stable error dynamics, which asymptotically dies down. Thus, we have formulated a control law that does its best to "cancel" out the dynamics (by using our estimate) and then we have also taken care of the uncertainty.

There is tons of literature on SMC and it is definitely worth a read. Rate of convergence is decided by your choice of the parameters and you cannot really compare it to optimal controllers as its a whole different ballpark.

  • So what's the reason why Optimal Control is more used that Robust Control? – euraad Jun 26 '18 at 18:23
  • As far as SMC is concerned, it has a lot of undesirable behaviour. The control law is discontinuous in $s$, and thus there is occurence of high frequency oscillations called "chattering" which can damage actuators, or even excite unmodelled dynamics. – BabaYaga Jun 26 '18 at 18:26
  • Also, as far as practical implementation is concerned, even PID can control a highly nonlinear system like the quadrotor with incorrect model parameters, but its not the "right" way to do it. But when the industry involved has the resources, its always preferred to do an extensive system identification, linearise the system, and then use linear or optimal control methods, like in aircraft, where the dynamics are linearised about every operating point. – BabaYaga Jun 26 '18 at 18:27
  • You mean that the industri using adaptive controllers? – euraad Jun 26 '18 at 18:32
  • Adaptive controllers are another class of nonlinear controllers. In the simplest case if your dynamics are in a particular form, you can use pure adaptive control. However it can also be coupled with fuzzy systems or neural networks to create truly powerful controllers. But one should remember that these are, as of now, of little practical use. If you want a better idea about adaptive control, best to read the literature or you could ask a new question. I'd be happy to answer. – BabaYaga Jun 26 '18 at 18:34
  • I already reading "Adaptive Control" by Karl Johan Åström. But sure, I will ask more questions about that soon, thank you. – euraad Jun 26 '18 at 18:44