Hamilton-Jacobi equation
From Scholarpedia
| This article is undergoing 2 initial reviews; It may contain inaccuracies and unapproved changes made by anonymous reviewers. | ||||||||||||||||||||
The Hamilton-Jacobi Equation is a first order nonlinear partial differential equation of the form
with independent variables
and parameters
. It has wide applications in optics, mechanics, and
semi-classical quantum theory. Its solutions determine infinite families of solutions
of Hamilton's ordinary differential equations, which are the equations
of motion of a mechanical system or an optical system in the ray approximation.
Contents |
History
Sir William Rowan Hamilton (1805-1865) carried out one of the earliest studies of geometrical optics in an arbitrary medium with varying index of refraction (Hamilton (1830-1832), Synge (1937), Carathéodory (1937)). He found an eloquent expression of the topic in a characteristic function, which is the optical path length of a ray, regarded as a function of initial and final positions and times of the ray. This and related functions satisfy partial differential equations, and directly determine infinite families of rays. Following an analogy between rays and trajectories of a mechanical system, Hamilton soon extended his concepts to mechanics, incorporating ideas of Lagrange and others concerning generalized coordinates. The resulting Hamiltonian mechanics, notable for its invariance under coordinate transformations, is a cornerstone of theoretical physics.
With an emphasis on mechanics, Carl Gustav Jacob Jacobi (1804-1851) sharpened Hamilton's formulation, clarified mathematical issues, and made significant applications (Jacobi (1842-1843)). The resultant Hamilton-Jacobi theory and later developments are presented in several famous texts: Arnol'd (1974), Landau & Lifshitz (1969), Gantmacher (1970), Born & Wolf (1965), Lanczos (1949), Carathéodory (1982), Courant & Hilbert (1962). For studies using modern PDE theory see Lions (1982), Evans (2008), and Benton (1977). The theory embodies a wave-particle duality, which figured in the advent of the de Broglie - Schrödinger wave mechanics (Butterfield (2005)).
In a view broader than that of the original work, a solution of the Hamilton-Jacobi equation is the generator of a canonical transformation, a symplectic change of variables intended to simplify the equations of motion. In this framework (as applied to mechanics) there are solutions of a type different from that of Hamilton, which determine not only orbits but also invariant tori in phase space on which the orbits lie. These solutions, which are known to exist only under special circumstances, are the subject of the celebrated work of Kolmogorov, Arnol'd, and Moser; see Gallavotti (1983). Even approximate invariants, constructed by approximate solutions of the Hamilton-Jacobi equation, have implications for stability of motion over finite times (Nekhoroshev (1977), Warnock & Ruth (1992)). Approximate invariants also find applications in the Einstein-Brillouin-Keller quantization of semi-classical quantum theory (Percival (1977), Chapman et al. (1976), Martens & Ezra (1987)). Various forms and generalizations of the Hamilton-Jacobi equation occur widely in contemporary applied mathematics, for instance in optimal control theory (Fleming & Rishel (1975)).
Canonical Transformation
Canonical transformations (equivalently, symplectic transformations) are of crucial importance in classical mechanics, as they are the chief means of solving a mechanical system or clarifying the structure of the system when it cannot be solved. The Hamilton-Jacobi equation is used to generate particular canonical transformations that simplify the equations of motion.
A mechanical system with
degrees of freedom is described
by generalized coordinates
and
corresponding generalized momenta
; we
write
. The motion of the system is governed by
Hamilton's canonical equations of motion, i.e., the ordinary differential equations
- (1)
where
denotes the time derivative and subscripts
indicate vectors of partial derivatives; thus
. The Hamiltonian
function
is
here assumed to be
in
and continuous in
. The solution of the initial value problem for the
Hamiltonian system (1) is denoted by
for initial
value
. This solution, denoted by
the bold faced letter
to distinguish it from a
general point
in phase space, will be called an orbit.
If
depends on the time, specification of an orbit
requires the initial time
(not just the elapsed time)
as well as the initial condition
; for convenience the
origin of time is chosen so that
.
One seeks a transformation of coordinates,
, so that the equations of motion retain their form but
with a new Hamiltonian
, namely
- (2)
If
can be made independent of
, then
is constant and the solution of
(2) is given simply as
- (3)
The solution of (1) is retrieved by the inverse
transformation
.
Write
for an orbit in the new
coordinates, where
. Reference to
initial conditions will often be suppressed. A canonical transformation will be determined
through the equation
- (4)
where
indicates the scalar product and the given
function
is
in its first two
arguments,
in
, and such that
- (5)
in some open region
of
-space.
This function
is called the generator or generating function of the transformation.
By writing out
, one sees that (4) is satisfied if
This suggests defining the canonical transformation by the equations
Owing to condition (5) and the inverse function theorem,
(9) can be solved for
(at least
locally in
). Substitution of the solution in
(7) gives
as well.
To get the inverse transformation
,
solve (10) for
, then substitute
in (9) to find
. Then the new
Hamiltonian is defined by
- (11)
Textbooks usually apply a variational principle to show that the equations of motion are invariant in form under the transformation just defined. The advantage of the variational argument lies in its geometrical foundation, which motivates the starting equation (4), but is too long a story for this brief account; see Arnol'd (1974) for the geometric viewpoint. By generalizing an idea in Jacobi's 20th lecture (Jacobi (1842-1843), pp.158-159), the proof may be carried out instead by direct calculation. Substitution of (9) and (10) in (11) gives
- (12)
Take
of (12), evaluate
along orbits, and then subtract
of (7).
Similarly, take
of
(12), evaluate on orbits, and add
of
(6). This leads to the informative equations
In view of (5), this shows that (1) implies (2)
and vice versa, as long as
lies in
.
There are other possible choices of the old and new variables on which the generator may depend.
In general the condition (5) on
will not hold globally,
in which case one might try to use a function
with
. Then the equations analogous to (4), (9),
10), and (11) are
- (15)
One can show that the transformation induced by any generator with requisite smoothness is symplectic, which means that its
Jacobian matrix
is symplectic for all
.
Written in terms of
blocks this condition is
- (16)
where
denotes transpose. For
the symplectic condition reduces to
. To prove (16), differentiate (9)
and (10) with respect to
and
. Thanks to (5),
the resulting equations can be solved for
; some calculation then shows that the solution
obeys (16). An alternative
viewpoint is to take symplecticity as the defining property of a canonical transformation (Meyer & Hall,1991).
Hamilton-Jacobi Equation and Invariant Tori
To produce a useful transformation the generator
must be determined so that
is indeed independent of
, thus giving
(3) as the solution of the transformed equations.
With this form of
, substitution of
(9) in (11) yields
- (17)
which is the Hamilton-Jacobi equation for the type-2 generator. Here
is regarded as a (vector) parameter; the independent variables of the PDE are
and
. A solution of (17) depending on
parameters
and such that
was called a
complete solution (Vollständige Lösung) by Jacobi (in his case
,
and the
are parameters with no particular interpretation). As
was shown above, it determines a canonical transformation.
Equation (17) is clearly a necessary condition on the
generator of a transformation for which the new Hamiltonian is
independent of
. But can it be used to construct
such a generator? For this a first question is the status of the
function
. Can it be chosen arbitrarily or is it
somehow determined in the course of the solution of (17)?
There is one choice of
which can be made freely at the
start, and which leads to an important solution, namely
. This is the case considered by Hamilton and Jacobi, to
be discussed in the following section.
To illustrate the situation with non-zero
, take the case
of a time-independent Hamiltonian
and look for a
solution in which
and
are also
time-independent. Take polar coordinates
where
. Also,
define
so that
, where the first term on the right gives the identity
transformation. Then the Hamilton-Jacobi equation to solve for
is
- (18)
and the equations (9) and (10) defining the transformation are
If
satisfies (18) for some function
, then
is constant and (19)
represents an invariant torus in phase space. The new angle variable
advances linearly in time, according to (3).
Now consider a perturbed integrable system with Hamiltonian
- (21)
which satisfies a condition of non-degeneracy
- (22)
Next rearrange (18) to subtract the first terms of the Taylor series of
:
- (23)
The sum of the terms in the first square bracket is
and therefore small if the transformation (19,20) is close to the identity. Introduce the (multiple)
Fourier series
- (24)
so that
- (25)
and take the Fourier transform of (23) to obtain
- (26)
Since
does not contain the zero mode, the
set of equations (25) and (26) is a closed system for
the Fourier coefficients
. If a solution of this system
is known for some
, then the projection of (18) onto
every mode except the zero mode has been solved. The zero mode projection
is solved as well simply by defining
as the average of the left-hand side:
- (27)
This gives some understanding of how
the PDE (18) could be solved without prior knowledge of its right-hand side.
The zero mode amplitude
can be chosen arbitrarily,
for instance put equal to zero.
At first sight Eq.(26) would seem to be a straightforward fixed point problem that might be solved by some kind of iteration, provided that
the divisor
could be bounded away from zero through an appropriate
choice of
. Thanks to (22) the value of
can
be controlled by varying
. The iteration might be started by keeping only the term
, which
gives lowest order perturbation theory. If the series (24) is truncated, then the problem
can indeed be approached in that way, and (26) provides a practical
method for computing approximate invariant tori (Warnock & Ruth (1987)). The exact
problem requires the refined method of KAM theory to control small divisors
for large
(Gallavotti (1983), Pöschel (1982)). The theory ensures the existence of invariant tori for sufficiently
small
, but they are not continuous functions of
. Rather, they exist only
on a Cantor set in
-space, and the concept of complete solution does not apply
in the classical sense (it is nevertheless possible to construct a smooth function which solves
the Hamilton-Jacobi equation on the above-mentioned Cantor set; see Pöschel (1982)).
Action as a Solution of the Hamilton-Jacobi Equation
The following discussion is mostly an interpretation of Jacobi's 19th lecture.
For a geometric approach see Arnol'd (1974), Section 46C.
The goal is to solve the Hamilton-Jacobi equation for a Type-1 generator with the new
Hamiltonian
. Write
so that the equation is
- (28)
Using the method of characteristics, suppose that the characteristic (orbit)
which solves (1) is known.
Let us try to determine
from its values for
by
means of an ODE for
. Since
, equations () and (28) suggest putting
- (29)
whence by integration the proposal
- (30)
From this one would like to get
for general
,
but that can be done only if
can be deduced from the
numbers
. In general
this is not possible for all
; since orbits projected onto
space can cross,
there can be more than one
giving the same
. The locus of such crossings is called a caustic. To rule out caustics,
the equation
must be solvable uniquely for
.
For that suppose
and
- (31)
Under these conditions the proposed generator is defined through (30) as
- (32)
This was Hamilton's essential idea, to view the action (integral of the Lagrangian) as a function of initial and final coordinates and times.
To show that
satisfies (28), first
make a variation of the orbit,
,
where
is an arbitrary
function. After integration by parts
the corresponding variation of (30) is
- (33)
Since the integral is zero by (1), it follows that
- (34)
and since the variations are arbitrary
Next take
of (30) and apply (35) to obtain
- (37)
Now this shows that
satisfies the Hamilton-Jacobi equation (28)
since for any
there is a
such that
, by
condition (31).
Recalling the equations () that define the canonical transformation,
it is seen from (35) and (36) that the transformation from
new to old variables is just the time evolution
, with the new variables
being just the initial conditions
, which are constant because the new Hamiltonian is zero. The condition
is implied by (31) and (36),
as may be seen by differentiating the latter with respect to
, then taking
determinants.
If it is not possible to solve
for
, it may instead
be possible to solve for
. Then we can use a
generator of Type 2, easily constructed by a Legendre transformation of
(Goldstein (1981)).
Namely,
- (38)
.
By again applying the variational argument, it is easy to check that
satisfies
all the required equations.
The discussion above proves existence of a solution of (28) in terms of the more elementary existence theory for (1), and also suggests methods of numerical solution of (28).
Solution of classical problems by separation of variables
Hamilton's principal function (32) solves the Hamilton-Jacobi equation (28) and
determines an infinite family of orbits, but in order to construct it one needs to know this family
of orbits at the start. Gantmacher (1970, Chap.4, Sect.26) refers to this as a ``vicious circle", and states
that ``Jacobi's contribution
consists in the fact that he continued Hamilton's investigation and broke the vicious circle".
He showed that any solution
of
- (39)
depending on real parameters
and complete in the sense that
, determines the orbits of the system.
It is instructive to illustrate Jacobi's program in a soluble example. Gantmacher (1970, Chap.4, Sect.27)
describes three structures of the Hamiltonian, labeled
for which
(28) is explicitly soluble, each embodying the idea of ``separation of variables".
Type
includes some basic systems. For this case in two degrees of freedom the Hamiltonian
has the form
- (40)
and similarly for
degrees of freedom,
- (41)
Each
is required to be
in all arguments and to satisfy
- (42)
Considering now two degrees of freedom, notice that because of (42)
there exist functions
such that
- (43)
for any constants
. Identification of
with
gives a solution of (39) in the form
- (44)
Indeed, after substitution of this function and application of (43) the
l.h.s. of (39) reads
.
Moreover, this solution is complete, as is seen by differentiating the first equation
of (43) with respect to
and the second with
respect to
. Because of (42) that shows that
and
hence
, where
means partial derivative with
respect to the
-th argument.
Jacobi's crucial point is that the solution
of the equations
is exactly the solution of Hamilton's equations, if
is a constant. To prove this take
of (39) and subtract
of (45). Also
take
of (39) and subtract
of (46). Thus
- (47)
Since
is a complete solution, the first equation implies
, and
the second then implies
. It was a generalization of this argument that provided
Eqs. (13) and (14). The values of
to impose
an arbitrary initial condition
are obtained by solving
(45), (46) at
, again using completeness.
An example is planar motion in a central potential
(Goldstein, 1981). In polar
coordinates the Hamiltonian for a particle of mass
is
- (48)
Since
is independent of
, the conjugate momentum
is constant in time; it is the conserved angular momentum. To
apply the above scheme put
- (49)
Notice that
satisfies (42) if and only if
.
Now the
defined by (43) are
In physicist's notation
angular momentum,
energy, and the
formula (44) reads
- (52)
Here
must be such that the argument of the square root is non-negative in the region of integration.
The motion
is obtained by solving (46). To that end compute
For initial conditions
the parameters are
. Now (54) gives
,
which must be inverted to give
; then (53) gives
.
This is the standard solution derived less elegantly in elementary treatments without the Hamilton-Jacobi
method. The choice of sign in front of the integrals depends on
and initial conditions.
Suppose that the potential is attractive and
is such that there is oscillatory motion in
the effective one-dimensional potential with
(Goldstein, 1981). During
the first half-period
the integral (54) runs from
to
,
with the plus sign. During the second half-period the integral is defined as
plus
the integral from
to
with the minus sign, and so on. Within any
half-period the integral is monotonic in
so that the inversion of
is always
possible.
Applications and Numerical Methods
There is a large literature on numerical solution of the Hamilton-Jacobi equation and similar equations, often applied
to the special case of eikonal equations (Goldstein (1981), p.489), and ranging from classical approaches to
generalized solutions of viscosity type (Lions (1982), Evans (2008)). For invariant tori in mechanics an extremely efficient method
is to fit a Fourier series to orbits with non-resonant frequencies (Warnock & Ruth (1992)). Hamilton's
Principal Function offers a way to construct the generator of symplectic time evolution maps for long time intervals,
a valuable tool for modeling particle accelerators and other systems. For large
one can evaluate
for
on a finite mesh
and then interpolate by
B-splines of at least cubic degree, thereby getting a
generator that will induce an
exactly symplectic map. This approach, encouraged by the success of earlier similar work (Warnock & Berg (1997)), is under study.
Bibliography
Arnol'd, V. I., "Mathematical Methods of Classical Mechanics", (Springer, New York, 1974).
Benton, S. H., "The Hamilton-Jacobi Equation: A Global Appraoch", (Academic Press, New York, 1977).
Born, M. and Wolf, E., "Principles of Optics", (Pergamon Press, Oxford, 1965)
Butterfield, J., "On Hamilton-Jacobi Theory as a Classical Root of Quantum Theory", in ``Quo Vadis Quantum Mechanics?", A. Elitzov et al., Eds. (Springer, New York, 2005).
Carathéodory, C., "Geometrische Optik", (Springer, Berlin, 1937).
Carathéodory, C., "Calculus of Variations and Partial Differential Equations of the First Order", (Chelsea, New York, 1982).
Chapman, S., Garrett, B. C., and Miller, W. H., "Semiclassical Eigenvalues for Nonseparable Systems: Nonperturbative Solution of the Hamilton-Jacobi Equation in Action-Angle Variables", J. Chem. Phys. 64, 502-509 (1976).
Courant, R. and Hilbert, D., "Methods of Mathematical Physics, Vol. II", (Interscience, New York, 1962.
Evans, L., "Weak KAM theory and partial differential equations", in Calculus of Variations and Nonlinear Partial Differential Equations, pp. 123-154, Lecture Notes in Math. 1927 (Springer, Berlin, 2008).
Fleming, W. H. and Rishel, R. "Deterministic and Stochastic Optimal Control", (Springer, Berlin, 1975)
Gallavotti, G., "The Elements of Mechanics", (Springer, New York, 1983).
Gantmacher, F., "Lectures in Analytical Mechanics", (MIR Publishers, Moscow, 1970).
Goldstein, H., "Classical Mechanics", (Addison-Wesley, Menlo Park, 1981).
Hamilton, W. R., "The Mathematical Papers of William Rowan Hamilton, Vol. I, Geometrical Optics, Vol.II, Dynamics" (Cambridge University Press, 1931), especially three Supplements (1830-1832) to the "Theory of Systems of Rays" (1827) in Vol.I, and "On a General Method in Dynamics" (1832) in Vol.II.
Jacobi, C. G. J., "Vorlesungen über Dynamik", Königsberg lectures of 1842-1843, (reprinted by Chelsea Publishing Co., New York, 1969).
Lanczos, C., "The Variational Principles of Mechanics", (U. Toronto Press, Toronto, 1949).
Landau, L. D. and Lifshitz, E. M., "Mechanics", (Pergamon Press, Oxford, 1969).
Lions, P.-L., "Generalized Solutions of Hamilton-Jacobi Equations", (Pitman, Boston, 1982)
Martens, C. C. and Ezra, G. S., "Semi-classical Mechanics of Strongly Resonant Systems: a Fourier Transform Approach", J. Chem. Phys. 86, 279-307 (1987).
K. Meyer and G. Hall, "Introduction to Hamiltonian Dynamical Systems and the N-Body Problem", (Springer, New York, 1991).
Nekhoroshev, N. N., "An Exponential Estimate of the Time of Stability of Nearly Integrable Hamiltonian Systems", Russ. Math. Surveys 32, 6, 1-65 (1977).
Percival, I. C., "Semiclassical Theory of Bound States", in Advances in Chemical Physics 36 (Wiley, New York, 1977).
Pöschel, J., "Integrability of Hamiltonian Systems on Cantor Sets", Comm. Pure Appl. Math. 35, 653-695 (1982).
Synge, J. L., "Geometrical Optics, an Introduction to Hamilton's Method", (Cambridge University Press, 1937).
Warnock, R. and Ruth, R. D., "Long Term Bounds on Nonlinear Hamiltonian Motion", Physica D 56 188-215 (1992).
Warnock, R. and Ruth, R. D., "Invariant Tori through Direct Solution of the Hamilton-Jacobi Equation", Physica D 26, 1-36 (1987).
Warnock, R. and Berg, J. S., "Fast Symplectic Mapping and Long-term Stability Near Broad Resonances", AIP Conf. Proc. 395 (Amer. Inst. Phys., 1997).
==See also==</ref>
