On The Exponential Solution of Differential Equations For A Linear Operator PDF
On The Exponential Solution of Differential Equations For A Linear Operator PDF
has derived a solution of (1) in the infinite series form obtained when (1) is
solved by iteration. The expression for fl obtained in the present paper is also
an infinite series but it satisfies the condition that the partial sums of this series
become Hermitian after multiplication by i if iA is a Hermitian operator. This
formula for t2 is the continuous analogue of the Baker-HausdorfT formula. All
of these results are essentially algebraic; they are supplemented in Section IV
by a proof of Zassenhaus’ formula, which may be described as the dual of
Hausdorff’s formula.
The simplest instance of an equation of type (1) is given by a finite system
of linear differential equations. In this case, A ( t ) is the matrix of the coefficients
of the system, and the convergence of the infinite series for D(t) can be discussed.
*This research was supported in part by the United States Air Force, through the
Office of Scientific Research of the Air Research and Development Command.
649
650 WILHELM MAGNUS
This is done in Section VI. In a special case, which is treated in Section VII,
necessary and sufficient conditions are derived for the existence and regularity
of Q(t) for all values of t. Section V supplements a recent investigation by H. B.
Keller and J. B. Keller [3], who resumed and continued the work by H. F.
Baker [4]on systems of ordinary linear differential equations. I n [3], the investi-
gation starts with the assumption that the matrix A ( t ) can be diagonalized.
In Section V we show that the continuous analogue of the Baker-Hausdorff
formula provides non-trivial sufficient conditions for the existence of elementary
solutions of (1) in cases where A ( t ) cannot be diagonalized. Here the term
“elementary” refers to algebraic operations and applications of a finite number
of quadratures to A(t).
It follows from the axioms (a)-(d) that the identity 1 and the products
of any number of “factors” i.e., the products
(1.1) x.,x,:a am
x,, , (a1 , Q 2 , - . -, ff, = 1, 2 , 3 , * * * ) ,
with
(1.2) ~ ~ # ~ ~ # v ~ ~ ~ ~ v , ~ ~ # v ~ , v I~ , .=. . l , ,m 2 , ~ ~ ~ n f o r
form a basis of linearly independent elements of R, with respect to fo .
We may extend R, to a ring R, which consists of all the formal power
-
series with coefficientsco , c(vl , - . , Y, , al , . . . , a,) in .fo , the generic element
A of R being
(1.3) A = CO + Cc(v1, 1 vrn ;a1 1 . * . , a&;: * * * x;: .
The sum in (1.3) is taken over all possible combinations of integers v 1 , . . . ,
-
v, , a1 , * . , a, satisfying (1.1) and (1.2) for m = 1, 2, 3, . . A power series - a
C n!xT
n-0
and its square
(1.4) ez = C zn/n!
n-0
and we have
m
(1 5) ezev = C
n.m-0
xnym/(n!m!).
and
(1 -7) 2 = u- +u2 + gu3 ... ,
where
x2 xy y2
(1 4 u=(ezev- 1) = x + y + z + - +1!1!
z+ - 4 . .
If we substitute for u its value from (1.8), it is easily shown that the series in
(1.7) leads to an element of R. For this purpose, we shall call
ff1 + + +
ff2 * * * ffn
the degree (in x, , . , 2,) of the basis element (1.1); in (1.5) the terms of degree
I (in x, y) will then consist of the sum
ring @ is generated by x , y, x', y', where the generators are not entirely free but
satisfy the relation
(2.1) xx' = 2'2, yy' = y'y, xy' = y'x, x'y = yx'.
We may consider any element of R as an element of l?, which contains R. Now
we can state Friedrichs' theorem:
THEOREM I: Let F ( x , y) be a function of x and y. Then F i s a Lie-element
of R i f and only i f
(2.2) F(z + x', Y + Y') = F(x, Y) + F W , Y').
To prove this theorem, we may confine ourselves to the case where F is
homogeneous in x , y, that is where F is a sum of terms of a fixed degree. It is
easily seen that (2.2) holds if F is a Lie-element. In this case, F must be a sum
of terms which have been derived from the generators by a repeated application
of Lie-multiplication. Consider a term w involved in F , which has been obtained
from two Lie-elements u and v of R by Lie-multiplication:
w = [u, v ] .
Then u and v are of lesser degree than w and we may assume that, as functions
of x and y, they satisfy (2.2). Since it follows from (2.1) that the bracket product
of a factor depending on x,y and a factor depending on x', y' is always zero, we
find that w also satisfies (2.2).
To show that only Lie-elements satisfy (2.2) we introduce first the following
definition:
ilny r elements (r = 1, 2, 3, . .) of R are called algebraically independent
if they generate a subring of R which is isomorphic with a free ring of r free
-
generators. More specifically, let u,, * , u,be the r elements of R and let
1
YP-fUP (P = 1, * . * ,TI
(2.3)
(2.4)
The right hand side in (3) i s the result of a n 1-fold bracket multiplicalion of up by v
from the right. Then all the u:" are algebraically independent (for 1 = 0, 1,2, . -). -
654 WILHELM MAGNUS
I, 2 I, 2
2 I, 2 1 0 , ’ a -
where the uj’)’ are derived from the u;” by the transition from x, y to x’, y‘.
Now condition (2.2) gives I
W u , + u: 1 * ’ 1 u, + u: , v + v’)
(2.11)
(2.18)
(3.3)
where
(3.9)
(3.10) = (u&
On the other hand, we have from the definition of 2 and from (3.5)
(3.11) ax X
658 WILHELM MAGNUS
Similarly, if we put
(3.12) f* = (9;) z
(3.15)
This is a partial differential equation for z which can be solved by the method
of power series expansion and coefficientcomparison. Indeed, if we write
(3.16) z = x + + + + ... .
21 22 23
where z,, contains exactly these terms of z which are of degree n with respect to
y, we find first (y.d/ay) z, = nz, and then from (3.15)
z1 , - .. , znCl= --
1
n + l
(w $) 2, , .. *
since w is linear in y. It is obvious that (3.17) gives recurrence formulas for the
computation of z in terms of Lie-elements. The first terms are
(3.19)
where
(3.20)
EXPONENTIAL SOLUTIONS 659
where the terms on the right hand side of (3.10) are in R and where their sums
are to be defined in R. We shall define dA/dt to be A , ( t ) .
(b) The formal laws of differentiation for a sum and a product hold.
(c) If P ( x ) is a power series in x and if P ( A ( t ) )= B(t) exists in R, then
(3.22) dB dA x = A(t).
dt '
(d) Given A @ ) , there exists in R a uniquely determined function A*(t)
such that
dA*
- - - A(t),
(3.23) A*(O) = 0.
dt
We shall write
rt
(3.24) j0 A(.) d r = A*(t).
The second type of property, which is more difficult to describe, concerns
problems of convergence. For the present purposes it will be necessary to
assume that exp A exists for all functions under considerationand is differentiable
in the sense described under (a). Also, it will be necessary to assume that certain
repeated integrals (where integration is defined by (3.23), (3.24)) exist.
Furthermore, we must be able to define certain infinite sums. If the
elements of R are linear operators acting on a Hilbert space, definitions are
readily available. A different type of example of a ring R in which the con-
structions of this section are permissible can be obtained as follows: Let u,
be a sequence of elements of a free associative ring of the type defined in Section
I. Let p,, be the minimum of the degrees of terms involved in u, ;if u, = 0, we
define ,L,~ to be - 0 3 . We shall call the sequence of the u, a null sequence if
lim p,' = 0.
n-00
Now we define R as the ring of all power series in a real variable t of the type
m
A(t) = C u,tn
n-0
660 WILHELM MAGNUS
where the u,form a null sequence and where t commutes with all other quantities.
The case where the A ( t ) are finite matrices with elements depending on t
will be considered in Sections V and VI.
We can state
THEOREM 111: Let A(t) be a known function of t in a n associative ring R ,
and let U ( t ) be a n unknown function satisfying
(3.27)
The p,, vanish for n = 3, 5, 7, . . , and PBrn= (- l)"'-' B2,/(2m) !, where the
BPm(for m = 1, 2, 3, a ) are the Bernoulli numbers. Integration of (3.27) by
iteration leads to a n inJinite series for R the first terms of which ( u p to terms involving
three integrations) are
(3.28)
+ * * - .
Formula (3.28) is the continuous analogue of the Baker-Hausdorff formula by
which z is expressed in (3.19) as a Lie-element of 2, y. We can prove Theorem
I11 in the following manner: If U = exp 0, then, according to (3.22) and (3.5),
(3.29)
(3.30)
EXPONENTIAL SOLUTIONS 66 1
and putting D = lim n+mQ,, . In the case where A ( T ) is a finite matrix with
bounded elements it can be shown by standard methods that (3.31) actually
leads to a function D satisfying (3.26) for sufficiently small values of t.
A different method of deriving (3.28) can be based on (3.19). If we set
t = n6, A(v8) = A , (Y = 1, 2, * . a , n)
and if we integrate (3.25) by substituting for A ( r ) ,0 5 r 5 t a piecewise constant
function with values A , , we find for U(t) the approximate value
(3.20) exp A,6 exp An-,8 exp A,6 exp A16.
Repeated application of (3.19) and passage to the limit n -+a gives easily the
first two terms of the right hand side of (3.28). But the complexity of the
calculations increases rapidly with the number of terms, and the convergence
difficulties involved in the application of (3.19) are considerable even if x, y
are finite matrices.
=x+y
+
since { (x y)"} = 0 if n > 1. In the same manner we find for the right hand
side in (1)
= x: +y + (ZYI + {C,) + 7
{XY'I
+ (.GI + {YCZ) + + -.* ?
where the omitted terms are of a degree greater than three. By comparing
terms of the same degree in (7) and (8) we find
+ = 0,
(C21 IZYl
(5.3) (Y = 1, 2, * * . , n)
subject to the initial conditions
(5.4) yy(0) = 0 if v # le, 0 )1.
~ ~ (=
The u V , #are, of course, the elements of A , and they are functions of t. The
determinant of Y is always different from zero; its value is given by
(5.5)
determines Q for all values of t, namely, when the series in the right hand side
of (3.28) terminates. This will happen, for instance, if
where , ---
, 9oare written as functions of the independent variable s.
Apparently, the terms involving 1, 2, , n integrations in (3.28) are
functionals of the type described above; we shall call them the Baker-Hausdorg
functionals B,'of A ( t ) (for c = 0), and we shall write (3.28) in the form
(5.11) Q = B, + B, + B, + ,
where the B, will be written as
(5.13) n= c B,(A,
a
"-1
t , 0).
(5.17)
666 WILHELM MAGNUS
- -
where \kl , \k2 , . are Lie-integral functionals. Therefore, the right hand side
of (5.17) vanishes since the individual terms are derivatives of Lie-integral
+
functionals of a weight k (n 1 Ik 5 2n - 1). The inequalities for k follow
from the fact that the weight of GVequals n and the weight of P is less than n
and a t least, equal to unity.
This finishes the proof of Lemma 6. Probably, a better result could be
obtained for any given n; for example, for n = 2 it is easily shown that the
vanishing of all functionals of weight 3 implies the vanishing of all functionals
of weight 4. For n = 1, it is trivial that all functionals of a weight 2 2 vanish
if those of weight 2 vanish.
To prove Theorem IV we observe that all steps in the formal proof of
(3.28) now involve only a finite number of terms. First, the solution of (3.27)
by iteration gives a finite sum of functionals which we denote by B , (v = 1,
-
. ., n) in accordance with (5.11). Secondly, it follows directly that the Lie-
product
(5.18)
This formula makes sense for any differentiable finite matrix Q(t) since it can
be shown to be an absolutely and uniformly convergent rearrangement of the
series obtained by differentiating exp Q directly term by term and multiplying
by exp (-0) afterwards. From (5.18) it follows that the right hand side in
(5.19) is a terminating series. Calling its sum B,we find directly from (5.18),
(5.19) that
(5.20)
where the 8. are explained in Theorem 111. On the other hand, Q could also
have been derived from
(5.21)
(5.22)
EXPONENTIAL SOLUTIONS 667
cannot have a solution C which does not vanish identically and which is such
that { C , Q'"} = 0 if m 2 n. This can be shown by applying bracket multiplica-
tion to (5.22) k = n - 1, n - 2, - . , 1 times. Then we find that
6
"-0
Q2r+k) = 0,
(5.25)
Clearly,
(5.26)
techhique based on (3.27) and (3.28) will work for sufficiently small values of
I t 1. Also, it is well known that any preassigned constant matrix Y can be
written in the form exp D, if the determinant I Y I of Y is different from zero.
From Section V we know that Y is finite and I Y I f 0 everywhere. Neverthe-
less, if the function Q(t) is assumed to be differentiable, it may not exist every-
where. This can be shown by the following considerations. We may start
from t = 0 and arrive a t the value for the solution of (6.1) for t = to :
(6.2) Y o = Y(t,) = exp 9, , Qo = (to).
Let us consider Y o and fl, as points of 2n2-dimensional spaces S, and S , , re-
spectively, where the Cartesian coordinates qy and w , of these spaces consist of
the real and imaginary parts of the n2 elements of an arbitrary matrix Y or R.
The formula
(6.3) Y = exp D
with respect to dQ/dt. If this is possible for any A in the neighborhood (in S,)
of a point fl = Q0 , and if the result is of the type
(6.6) dR/dt = F ( A , D),
where the right-hand side in (6.6) is a matrix depending analytically on the
elements of Q , then (1) has a solution of type (63) in the neighborhood of
Y o = exp Ro = exp R(t,,). We shall prove the following result:
THEOREM V: The functional determinant A dejned by (6.4) does not vanish,
and (6.5) can be solved by an expression (6.6) in the neighborhood of any point
R, in S , for an arbitrary A if and only if none'of the differences between any two
of the eigenvalues of 9, equals 2 m 4 where m = rt 1, f . 2 , . . . , m # 0.
Proof: If (6.3) holds, the determinant I Y 1 of Y is different from zero.
Setting
(6 -7) dY * Y-' = dZ,
EXPONENTIAL SOLUTIONS 669
we may compute the determinant which connects the elements of dZ and dQ.
It will differ from A only by a power of 1 Y I-' since the elements of each row of
dZ are obtained from the corresponding row of dY by a linear substitution, the
matrix of which is the transpose of Y-'. From (3.24) we have
(6 3) dZ = dQ -
1
[dQ, Q ] + 31 [[dQ, Q]Q]=F - . * *
Let
(6.9)
and assume that
(6.10) Q = A = (A1 , ,A, 1
is a diagonal matrix with the numbers A, , . a , A, in the main diagonal. In
this case we have from (6.8), (6.9), and (6.10)
(6.11)
The n2 quantities dz,,, are linear functions of the n' quantities dw,,,, , and the
determinant of (6.11) is
(6.12)
[dQ*, A] + j j
1 1
(6.16) dZ* = dQ* --
2!
[[dQ*,A]A] F
(6.17)
670 WILHELM MAGNUS
Now
(dzf,,J = c*(dz,, A, (dw?,,I = c*(&, A ,
where C* = C-’ 0C’ is the Kronecker product of C-’ and the transpose C’ of C
and where (dzf,,) stands for the vector with n2 components dxf,, . Since the
determinant of C* equals 1, the dz,,, are again linear functions of the dw,,,,
where the determinant of the relation is A*. This shows that
(6.18) A* = I 1
whenever Q can be transformed into diagonal form. Now A* in (G.12) is a
function of the s, , which are the coefficients of the characteristic equation for
Q. Since A* must be a continuous function of the w v , , , we shall write A* as a
function of the s, . This gives an expression for A* which is valid if D has different
eigenvalues. But in S , the neighborhood of every point Q, contains points
corresponding to matrices which have different eigenvalues. Therefore the A*
in (6.18) is given by (6.12) for all Q . This proves Theorem V, since A* will
vanish if and only if the conditions of Theorem V are satisfied.
(7 -5)
If we introduce
= t -:).
(7.6) A = du2 + @P,
we find after some calculation
(7.7) y = -(sinh A) Q
A
+ (cosh A ) I .
Let
(78 = y1 + t12
(7.13)
672 WILHELM MAGNUS
+
Therefore, if Q > 0, then 8‘ < 4 for t = to e if e is positive and sufficiently small.
Next, we observe that 8’ # 0 and A’ # 0 in any interval to < t < tl in
which 8’ < 4. Since I Y J = y i d - y:r), = 1 we find for 8’ = 0 from (7.13)
+
that, y,d = 1 Q$ . Therefore, y, and d have the same sign and are different
from zero. However,
(7.14) (yl - ?:)’ = 8’ - 4yl.rl: = e2 - 4 - Q ~ <: o
if 8’ - 4 < 0, and this is a contradiction. Therefore 8‘ # 0. We find from (7.9)
by differentiation that A’ can vanish only if 8’ = 0 or if sin h A = 0; but then
6’ = 4 which had been excluded.
We consider now the behaviour of 8(t) and A(t) for t > 0, starting a t t = 0.
We have shown that there exists a smallest positive number t, (which may be
Q) ) such that 8’ < 4 in 0 < t < t , . For 0 < t < tl , A must be purely imaginary
according to (7.9). We put A = iD. We find from (7.9) that
(7.15) 8’ = -2D’sin D.
Therefore, D either increases in 0 < t < t, or decreases monotonically, and if
-
tl is finite and 8(t,) = 2, then D(tJ = A or - A. If tl = a,we see from (7.10)
and (7.9) that Theorem VI is true. Therefore, assume that t, is finite. Then
+
beyond this point, say for t = t L E , 8(t) must increase again since it follows
from (7.10) that Y(tl) = -
I . If we differentiate (7.9) two times, we find
for t = tl from sin D(tJ = 0 and from (7.13) that
(7.16) +Or’ = - D r 2 cos D = DI2(tJ > 0.
Therefore, D’cannot even vanish at t = t, . Going from t = t , to the next.point
t2 > t, for which 8’ = 4, etc., we find that D‘ must be always real and positive
or always real and negative since we shall never come back to D = 0 for t > 0.
Therefore, D(t) is a monotonic function of t for t > 0, and this proves that
e’ < 4 is a necessary condition for the existence of Q. That it is also a sufficient
condition can be seen as follows: If A Z f in^, n = 1, 2, 3, then $2 is
completely determined by postulating that D(t) is monotonic and by using
(7.9) and (7.10). In order to fmd Q ( t ) for the exceptional values t = t,, for which
A = ina (or A = - inn, consistently with the same sign), we multiply both
sides of (7.10) by do2- 4 and then differentiate with respect to t. We h d
(7.17) 2(A’ cosh A)Q + 2(sinh A)Q’ = (2Y - 201)A’ + (2Y’ - 8’I)A.
Since sinh A = 0, cosh A = (- 1)“and 2Y - 81 = 0, 8’ = 0, Y’ = A Y for
t = t, , (7.17) becomes
(7.18) (- l)”A’(t,)Q(t,) = A Y A = A ( - l ) ” A ( t , ) .
Since A(tn) = e in* where t is independent of n and e = f 1, it is easily seen
that (7.18), (7.6), (7.5) and (7.3) suffice to determine Q uniquely for t = t,, .
The result is independent of e if we define consistently d F 4 = 2 sinhA.
Also, it is easily seen that the condition (7.11) will not be satisfied generally
EXPONENTIAL SOLUTIONS 673
where J , , Yodenote the Bessel functions of the first and second kind respectively.
The asymptotic expansions for the Bessel functions and their derivatives show
that Oa > 4 for infinitely many values of t.
BIBLIOGRAPHY
[I] K. 0. Friedrichs. Mathematieal aspects of the quantum uleory of fields, Part V., Com-
munications on Pure and Applied Mathematics, Vol. 6, 1953, pp. 1-72.
[2] R. P. Feynman, An operator calculus having applications in quantum ekctrodynamks,
Physical Review, Vol. 84, No. 1, 1951, pp. 108-128.
[3] Herbert B. Keller and Joseph B. Keller, On system of linear ordinary diferential equations,
Research Report EM-33, New York University, Washington Square College of
Arts and Science, Mathematics Research group.
[4] H. F. Baker, On the integration of linear diferential equations, Proceedings of the London
Mathematical Society, Vol. 35, 1903, pp. 333374; Vol. 34, 1902, pp. 347360;
Seeond Series, Vol. 2, 1904,pp. 293-296.
(51 H. F. Baker, Alternants and continuous p-oups, Proceedings of the London Mathematical
Society, Second Series, Vol. 3, 1904, pp. 2447.
[6] F. Hausdorff, Die symbolische Exponentialformel in der Gruppentheorie, Berichte der
Sachsischen Akademie der Wissenschaften (Math. Phys. Klasse), Leipzig, Vol. 58,
1906, pp..19-48.
[7] W. Magnus, fiber Beziehungen zwisehen hoheren Kmmutatoren, Journal f. d. Reine u.
Angewandte Mathematik, Vol. 177, 1937, pp. 105-115.
f8l E. Witt, Treue Ourstellung Liescher Ringe, Jourml f. d. Reine u. Angewandte Mathematik,
Vol. 177, 1937, pp. 152-160.
[9] W. Magnus, A connection between the Baker-Hausdorff formula and a problem of Uurn.de,
Annals of Mathematics, Vol. 52, 1950, pp. 111-126.
[ lOf G . Falk, Konstanzekmente in Ringen mit Differentiation, Mathematische Annalen, Vol.
124, 1952, pp. 182-186.
[ l l ] H. Zassenhaus, Unpublished.
[I21 E. B. Dynkin, Calculation of the coefiients in the Campbell-Hausdorffformula, Doktady
Akad, Nauk USSR (N.S.), Vol. 57, 1947, pp. 323-326 (Russian).
1131 W. Specht, Die tinearen Beziehungen zvtischen hbheren K m m u ~ t m e n Mathematische
,
Zeitschrift, Vol. 51, 1948, pp. 367376.
(141 F. Wever, Operatmen in Liesehen Ringen, Journal f. d. Reine u. Angewandte mathematik,
Vol. 187, 1947, pp. 4455.