Controllability of nonlinear control systems
From Scholarpedia
| This revision has not been approved by curators yet; It may contain inaccuracies. | |||||||||||||||||||||
Curator: Dr. Jean-Michel Coron, University Paris 6, Paris, France
In this section, we consider the controllability of nonlinear control systems modeled by nonlinear PDE's. There are no general methods to deal with this difficult problem. It is natural to first consider the problem of the controllability around an equilibrium of a nonlinear partial differential equation. Then the natural next step is to see if the linearized control system around this equilibrium is controllable. This is what we call the linear test in the following. We give an example of application below and mention methods and tools to deal with the cases where there is a problem of loss of derivatives.
Of course when the linearized control system is not controllable, one cannot say that the same non-controllability holds for the nonlinear system. Various methods can be used to deal with this case. Let us mention, in particular,
- Iterated Lie brackets. This is the most popular and powerful method for finite dimensional control system (see e.g. Section 3.2 in (Jean-Michel Coron, 2007), Chapters 1 and 2 in (Alberto Isidori, 1995), Section 3.1 in (Henk Nijmeijer and Arjan van der Schaft, 1990), (Andrei Agrachev, 1991), (Andrei Agrachev and Yuri Sachkov, 2001) as well as the papers (Rosa Maria Bianchini, 1998), (Rosa Maria Bianchini and Gianna Stefani, 1986; 1993), (Henry Hermes, 1977; 1982), (Matthias Kawski, 1990), (Héctor Sussmann, 1983; 1987), (Alexander Tret'yak, 1990). It is also useful for control of PDE; see in particular the papers (Andrei Agrachev and Andrei Sarychev, 2005; 2006) and (Armen Shirikyan, 2006), all on incompressible fluids . However, for many control PDE the iterated Lie brackets are not well defined; see, e.g. Chapter 5 in (Jean-Michel Coron, 2007).
- The return method.
- Quasi-static deformations.
- Power series expansion.
Contents |
The linear test: the regular case
When the linearized control system around an equilibrium is controllable, one can try to use the inverse mapping theorem to get a local controllability result for the nonlinear control system. We illustrate this method on the Korteweg-de Vries nonlinear control system:
(Of course this is just an example: this method can be applied to many nonlinear PDE).
The linearized control system around
is the control system
where, at time
, the control is
and the state is
. By Theorem 9, if
- (5)
then, for every time
, the control system (3)-(4) is exactly controllable in time
. Hence one may expect that the nonlinear control system (1)-(2) is at least locally controllable if (5) holds. The goal of this section is to prove that this is indeed true, a result due to Lionel Rosier (1997).
Well-posedness of the Cauchy problem
Let us first define the notion of solutions for the Cauchy problem associated with (1)-(2). Multiplying (1) by
, using (2) and performing integrations by parts lead to the following definition.
Definition. Let
,
and
be given. A solution of the Cauchy problem
is a function
such that, for every
and for every
such that
- (9)
one has
- (10)
Then one has the following theorem which is proved in Appendix A of (Coron and Crépeau, 2004).
Theorem 11. Let
. Then there exists
such that, for every
and
satisfying
the Cauchy problem (6)-(7)-(8) has a unique solution. The proof is rather lengthy and technical. We omit it.
Local controllability
The goal of this section is to prove the following local controllability result (Lionel Rosier,1997).
Theorem 12. Let
, and let us assume that
- (11)
with
- (12)
Then there exist
and
such that for every
, with
and
, there exist
and
satisfying (1)-(2) such that
- (13)
Sketch of a proof of Theorem 12. Let
,
where
is the solution to the Cauchy problem (6)-(7)-(8). It follows from the theorem in the previous subsection that
is well defined on a neighborhood of
. With some lengthy but straightforward estimates (see in particular Appendix A of (Coron and Crépeau, 2004), one can check that
is of class
on a neighborhood of
and that, as expected
, associates to
where
is the solution to the Cauchy problem:
From Theorem 9, one gets that
is onto, which by the inverse mapping theorem implies Theorem 12.
The linear test: the problem of loss of derivatives
In fact, in many situations one cannot apply directly the usual inverse mapping theorem to deduce from the controllability of the linearized control system at an equilibrium the local controllability of the nonlinear system at this equilibrium. This is due to some problem of loss of derivatives. Let us give a simple example where this problem appear. We consider the following simple nonlinear transport equation:
where
satisfies
- (16)
For this control system, at time
, the state is
and the control is
. If one wants to have a Hilbert space as a state space, one can also work with suitable Sobolev spaces (for example
is a suitable space). We are interested in the local controllability of the control system (14)-(15) at the equilibrium
. Hence we first look at the linearized control system at the equilibrium
. This linear control system is the following one:
For this linear control system, at time
, the state is
and the control is
. Concerning the well-posedness of the Cauchy problem of this linear control system, one easily gets the following proposition.
Proposition. Let
. Let
and
be such that the following compatibility conditions hold:
Then the Cauchy problem
has a unique solution
.
Of course (19) is a consequence of (22) and (23): it is a necessary condition for
the existence of a solution
to the Cauchy problem (21)-(22)-(23). Similarly (20) is a direct consequence of (21), (22) and (23): it is a necessary condition for the existence of a solution
to the Cauchy problem (21)-(22)-(23).
One has the following (easy) proposition.
Proposition. Let
. The linear control system (17)-(18) is controllable in time
. In other words, for every
and for every
, there exists
such that the solution
of the Cauchy problem (21)-(22)-(23) satisfies
- (24)
In fact one can give an explicit example of such a
. Let
be such that
Such a
exists since
. Then the solution
of the Cauchy problem (21)-(22)-(23) is given by
- (28)
(The fact that such a
is in
follows from the fact that
and
are of class
and from the compatibility conditions (26)-(27).) From (28), one has (23). From
, (25) and (28), one gets
(24). With this method, one can easily construct a continuous linear map:
such that
- The compatibility conditions
and
hold.
- The solution
of the Cauchy problem
satisfies
In order to prove the local controllability of the control system (14)-(15) at the equilibrium
, let us try to mimic what we have done for the nonlinear Korteweg-de Vries equation (1)-(2). Now the map
is the following one. Let
where
is the solution to the Cauchy problem:
One can prove that this map
is well defined and continuous in a neighborhood of
(see (Li and Yu, 1985) for much more general result). Note that, formally, the linearized control system at
is the control system (17)-(18), which by above proposition is controllable (at least if
). Unfortunately the map
is not of class
. One could think to avoid this problem by replacing
by
. Then the map
is now of class
, but
is no longer onto: there are controls
allowing to go from
to
but these controls are not of class
if
is not of class
. We have lost one derivative.
There is a general tool, namely the Nash-Moser method, which allows us to deal with this problem of loss of derivatives. There are many forms of this method. Let us mention, in particular, the ones given in Section 2.3.2 of (Mikhael Gromov,1986), (Lars Hörmander, 1985), (Richard Hamilton, 1982); see also the book (Serge Alinhac and Patrick Gérard, 1991). This approach can also be used in the context of the control system (14)-(15). See the papers (Karine Beauchard, 2005; 2008a; 2008b) and (Karine Beauchard and Jean-Michel Coron, 2006), which show the power and the flexibility of the Nash-Moser method in the context of control theory. However the Nash-Moser method has two major drawbacks
1. It does not give the optimal functional spaces for the state and the control.
2. It is more complicated to apply than the method we want to present here.
There is a more standard fixed point method which works for many control systems, in particular for the control system (17)-(18) which allows to prove for this control system the following controllability result.
Theorem 13. Let us assume that
- (32)
Then there exist
and
such that, for every
and for every
such that
there exists
such that
- (33)
and such that the solution of the Cauchy problem (29)-(30)-(31) exists, is of class
on
and satisfies
The fixed point method is the following one. Let
. One consider the following linear control system
- (34)
If the
-norm of
is small enough this system is controllable in time
and there exist
such that the Cauchy problem
has a (unique) solution
and this solution satisfies
. Of course this
is not unique. However, if one chooses it well, one can prove, using the Brouwer fixed point theorem, that, at least if the
-norm of
and
are small enough, the map
has a fixed point, which shows that the control
steers the control system (14)-(15) from
to
. See Section 4.2 in (Jean-Michel Coron, 2007) for more details.
Remark. One can find similar controllability results for much more general hyperbolic systems and with a different proof in the papers (Marco Cirinà, 1969), (Ta-tsien Li and Bing-Yu Zhang, 1998), and (Ta-tsien Li and Bo-Peng Rao, 2003). See also Section 4.2.1 in (Jean-Michel Coron, 2007) as well as the book (Ta-tsien Li, 2008).
Remark. As for the Nash-Moser method, the controllability of the linearized control system (21)-(22)-(23) at the equilibrium
is not sufficient for our proof of the above theorem: one needs a controllability result for linear control systems which are close to the linear control system
(21)-(22)-(23).
Remark. Sometimes these fixed point methods used with careful estimates can lead to global controllability results if the nonlinearity is not too strong at infinity. See in particular
- For semilinear heat equations: the paper (Caroline Fabre, Jean-Pierre Puel and Enrique Zuazua, 1995), Chapter I, Section 3 in the book (Andrei Fursikov and Oleg Imanuvilov, 1996), and the paper (Enrique Fernàndez-Cara and Enrique Zuazua, 2000).
- For wave equations: the papers (Enrique Zuazua, 1991; 1993), and (Irena Lasiecka and Roberto Triggiani, 1991).
- For a truncated Navier-Stokes equation: the paper (Caroline Fabre, 1995/96).
The return method
In order to explain this method, let us first consider the problem of local controllability of the following control system in finite dimension
where
is the state and
is the control; we assume that
is of class
and satisfies
The return method consists in reducing the local controllability of a nonlinear control system to the existence of suitable trajectories and to the controllability of linear systems. The idea is the following one: Assume that, for every positive real number
and every positive real number
, there exists a measurable bounded function
with
such that, if we denote by
the solution of
,
, then
Then, from the inverse function theorem, one gets the existence of
such that, for every
and for every
satisfying
there exists
such that
and such that, if
is the solution of the Cauchy problem
then
Since
and
are arbitrary, one gets that
is small-time locally controllable at the equilibrium
.
Example. Let us consider the nonholonomic integrator, i.e. the following control system
- (37)
where the state is
and the control is
Let us recall that this system is small-time locally controllable at
. The classical proof of this property relies on Lie brackets and on the Rashevski-Chow theorem (Petr K. Rashevski, 1938)-(Wei-Liang Chow, 1939); see e.g. Theorem 3.19 page 135 in (Jean-Michel Coron, 2007). Let us show how the return method also gives this controllability property. Take any
and any
such that
. Let
be the solution of the Cauchy problem
One easily checks that
and that the linearized control system around
is controllable if (and only if)
. Hence we recover the small-time local controllability at
. Let us point out that this new proof does not use any Lie bracket and uses only controllability of linear control systems. This is exactly what we want in order to deal with nonlinear control systems modeled by partial differential equations: For these systems, Lie brackets often do not work and one knows a lot of tools to study the controllability of linear control systems modeled by partial differential equations (see, e.g., at this link).
With this return method, in (Jean-Michel Coron, 1993; 1996) and in (Olivier Glass, 1997; 2000) the following global controllability result of the Euler equations of incompressible fluids is proved (where, for simplicity we do not specify the regularity of the functions and of the domain
):
Theorem 14. Let
. Let
be a nonempty bounded open subset of
. Let
be a nonempty open subset of the boundary
of
. We assume that
meets every connected components of
. Let
and
be such that
where
denotes the outward normal. Then, for every
, there exist
such that
Main ingredients for the proof of Theorem 14. Note that the linearized control system of the Euler control system is far from being controllable (for this linear system the vorticity cannot be modified). The proof relies on the return method. In order to use this method, one needs to construct a (good) trajectory
going from
to
. Such a trajectory is constructed using a potential flow (i.e. a flow of the form
). If the potential flow is well chosen the linearized control system around this trajectory is controllable. Using this controllability and a suitable fixed point argument one gets the local controllability of the Euler control system. The global controllability follows from this local result by a suitable scaling argument.
Remark. The return method has been introduced in (Jean-Michel Coron, 1992) for a stabilization problem. It has been used for the first time in (Jean-Michel Coron, 1993; 1996) for the controllability of a partial differential equation, namely the Euler equations of incompressible fluids. The return method has been used to study the controllability of the following partial differential equations:
1. Navier-Stokes equations of incompressible fluids: see the papers (Jean-Michel Coron, 1995/96) (with the Navier boundary condition: see the Section Examples of control systems modeled by PDE's), (Jean-Michel Coron and Andrei Fursikov, 1996) and (Andrei Fursikov and Oleg Imanuvilov, 1999).
2. Boussinesq equations: see the paper (Andrei Fursikov and Oleg Imanuvilov, 1999).
3. Burgers equation: see the papers (Thierry Horsin, 1998) and (Marianne Chapouly, 2006).
4. Shallow water equations: see the paper (Jean-Michel Coron, 2002), a paper motivated by the paper by (François Dubois, Nicolas Petit and Pierre Rouchon, 1999); see also the next section.
5. Vlasov-Poisson equations: see the paper (Olivier Glass, 2003).
6. 1-D Euler isentropic equations: see the paper (Olivier Glass, 2006).
7. Schrödinger equations: see the papers (Karine Beauchard, 2005) and (Karine Beauchard and Jean-Michel Coron, 2006). These two papers are motivated by the paper (Pierre Rouchon, 2003).
Remark. In fact, as already mentioned in the previous section, for many nonlinear partial differential equations, the fact that the linearized control system along the trajectory
is controllable is not sufficient
to get the local controllability along
. This is due to some loss of derivatives problems. To take care of this problem, one uses some suitable fixed point methods. Note that these fixed point methods rely often on the controllability
of some (and many) linear control systems which are not the linearized control system along the trajectory
. (It can also rely on some specific methods which do not use the controllability of any linear control system. This last case appears in the papers (Thierry Horsin, 1998) and (Olivier Glass, 2006).)
Remark. For the Navier-Stokes control system, the linearized control system around
is controllable, which leads to local controllability results for the Navier-Stokes control system itself; see (Oleg Imanuvilov, 1998; 2001) and (Enrique Fernàndez-Cara, Sergio Guerrero, Oleg Imanuvilov and Jean-Pierre Puel, 2004). However it is not clear how to deduce from this controllability a global controllability result for the Navier-Stokes control system. Roughly speaking, the global controllability results for the Navier-Stokes equations in (Jean-Michel Coron, 1995/96) and (Jean-Michel Coron and Andrei Fursikov, 1996) are deduced from the controllability of the Euler equations. This is possible because the Euler equations are quadratic and the Navier-Stokes equations are the Euler equations plus a linear "perturbation" (of course some technical problems appear due to the fact that this linear perturbation involves more derivatives than the Euler equations: One faces a problem of singular perturbations). See also the Section 3.5.2 in (Jean-Michel Coron, 2007).
Quasi-static deformations
Let us explain how this method can be used on a specific example. We consider the water-tank control system
This is a control system, denoted
, where, at time
,
- the state is
,
- the control is
.
Of course, the total mass of the fluid is conserved so that, for every solution of (38) to (40),
- (43)
(One gets (43) by integrating (38) on
and by using (40) together with an integration by parts.) Moreover, if
and
are of class
, it follows from (39) and (40) that
- (44)
which is also
. Therefore we introduce the vector space
of functions
such that
and we consider the affine subspace
consisting of elements
satisfying
- (47)
The vector space
is equipped with the natural norm
One has the following local controllability theorem (Jean-Michel Coron, 2002).
Theorem 15. There exist
,
and
such that, for every
, and for every
such that
there exists
satisfying the compatibility condition
such that the solution
to the Cauchy problem (38) to (42) with the initial condition
satisfies
and, for every
,
- (48)
As a corollary of this theorem, any steady state
can be reached from any other
steady state
.
Main ideas of the proof of Theorem 15. For simplicity, let us forget around the variables
and
. Without loss of generality, we may assume that
. Again the linearized control system around
is not controllable. Indeed, this linearized control system is
and, if we let
one gets
Hence the control has no effect on
, which shows that
is far from being controllable (it misses an infinite dimensional space).
Again, one tries to use the return method (see the previous section). For this method one needs to find trajectories such that the linearized control system around this trajectory is controllable. One can check that this is the case for the trajectory given by the following equilibrium point
where
is small but not
. However this trajectory does not go from
to
: From the controllability of the linearized control system around
one gets only the local controllability around
, i.e., there exists an open neighborhood
of
such that, given two states in
, there exists a trajectory of the control system
going from the first state to the secund one. This does not imply the local controllability around
. However, let us assume that
(i) There exists a trajectory of the control system
going from
to
,
(ii) There exists a trajectory of the control system
going from some point in
to
.
Then it is not hard to prove the desired local controllability around
. In order to get the trajectory mentioned in (i) and (ii), one uses quasi-static deformations: For example, for (i), one fixes some functions
such that
and consider for
the control
defined by
Let us now start from
and use the control
. Then one can check that, uniformly in
,
In particular
in
for
small enough. This proves
. The proof of
is similar.
Remark. There is in fact a problem of loss of derivatives and it is not easy to deduce the local controllability around
from the controllability of the linearized control system around
. To avoid the Nash-Moser method, a suitable fixed point method is used. This method requires the controllability "many" (essentially a family of codimension 4)) linear control systems which are close to the linear control system
.
Remark. The quasi-static deformations work easily here since
are stable equilibriums. When the equilibriums are not stable, one can first stabilize them by using suitable feedback laws (see, in particular, (Jean-Michel Coron and Emmanuel Trélat, 2004) for semilinear heat equations and (Jean-Michel Coron and Emmanuel Trélat, 2006) for semilinear wave equations.
Remark. Note that, due to the finite speed of propagation, it is natural that only large-time local controllability holds.
However, for a Schrödinger analog of control system
, it is proved in (Jean-Michel Coron, 2006) (see also Remark 9.20, pages 269-270 in (Jean-Michel Coron, 2007)) that the small-time local controllability also does not hold, even if the Schrödinger equation has an infinite speed of propagation. (The proof of the large-time local controllability for this Schrödinger control system is in (Karine Beauchard, 2005); see also (Karine Beauchard and Jean-Michel Coron, 2006) if one deals also with the variables
and
.)
Power series expansion
Again, we present this method on an example. Let
. Let us consider the following Korteweg-de Vries control system
where, at time
, the control is
and the state is
.
We are interested in the local controllability of the control system (49)-(50) around the equilibrium
. Lionel Rosier has proved in (Rosier, 1997) that this local controllability holds if
- (51)
Lionel Rosier has got his result by first proving that, if
, then the linearized control system around
is controllable. Note that
(take
) and, as shown also by Lionel Rosier, if
, then the linearized control system around
is not controllable. However the nonlinear term
helps to recover the local controllability: One has the following theorem (Jean-Michel Coron and Emmanuelle Crépeau, 2004).
Theorem 16. Let
and let
. (Thus, in particular,
.) Then there exist
and
such that for any
, with
and
, there exist
and
satisfying (49)-(50), such that
Main ideas of the proof of Theorem 16. The proof relies on some kind of power series expansion. Let us just explain the method on the control system of finite dimension
- (55)
where the state is
and the control is
. Here
is a function of class
on a neighborhood of
and we assume that
is an equilibrium of the control system (55), i.e
. Let
with
If
, the linearized control system around
is controllable and therefore the nonlinear control system (55) is small-time locally controllable at
. Let us look at the case where the dimension of
is
. Let us make a (formal) power series expansion of the
control system (55) in
around the constant trajectory
. We write
The order 1 is given by
; the order 2 is given by
and so on. The dynamics of these different orders are given by
and so on. Let
. Let
. Let us assume that there are controls
and
, both in
, such that, if
and
are solutions of
then
Let
be a basis of
. By the definition of
and a classical result about the controllable part of a linear system (see e.g. Section 3.3 in (Sontag, 1998)), there are
, all in
, such that, if
are the solutions of
then, for every
,
Now let
be a point in
. Let
be defined by the following
- If
then
and
.
- If
then
and
.
Then, let
be defined by
Let
be the solution of
Then one has, as
,
- (58)
Hence, using the Brouwer fixed-point theorem and standard estimates on ordinary differential equations, one gets the local controllability of
(around
) in time
,
that is, for every
, there exists
such that, for every
with
and
, there exists a trajectory
of the control system (55) such that
We use this power series expansion method to prove the theorem. In fact, for this theorem, an expansion to order 2 is not sufficient: we obtain the local controllability by means of an expansion up to order 3 (which makes the computations very lengthy).
Remark. The power series expansion method has been used in the context of partial differential equations for the first time in (Jean-Michel Coron and Emmanuelle Crépeau, 2003). It has then been used
- For the above Korteweg-de Vries control system (49)-(50) and for the other values of
in (Eduardo Cerpa, 2007) and in (Eduardo Cerpa and Emmanuelle Crépeau, 2008), the last paper showing that the conclusion of Theorem 16 holds for every
provided that
is large enough.
- For a Schrödinger equation in (Karine Beauchard and Jean-Michel Coron, 2006).
| Invited by: | Dr. Jean-Jacques Slotine, Nonlinear Systems Lab, MIT, Cambridge, MA |
| Action editor: | Dr. Jean-Jacques Slotine, Nonlinear Systems Lab, MIT, Cambridge, MA |
| Assistant editor: | Mr. Leo Trottier, PhD student; University of California, San Diego |
| Assistant editor: | Dr. Elias August, ETH, Zurich, CH |
