Linear Equations With Constant Coefficients: THEOREM 1. The Operator L
Linear Equations With Constant Coefficients: THEOREM 1. The Operator L
where a , b , and c are constants. We will assume throughout this section that a ! 0 .
The function f (t) on the right-hand side of equation (8.1) depends only on t and not on
y because all of the allowed y-dependence is already expressed on the left-hand side of
the equation. Corresponding to any equation of the form (8.1) we define the linear
differential operator
L = aD 2 + bD + c (8.2)
Ly = f (t) (8.3)
ar 2 + br + c = 0 (8.4)
The roots of the characteristic polynomial will be important when we solve (8.1).
Proof. To prove linearity we must show that for any constants c1, c2 and for any
©2005 BE Shapiro [Math 351 Spring 2005 Revised 5 May 2005] Page 8.1
Because equation (8.1) involves a second-order derivative the solution will in general
include two constants of integration rather than the single arbitrary constant that we had
when we were solving first order equations. Determining these constants will require two
constraints upon the solution; we will limit ourselves to the study of initial conditions,
where both the solution y(t) and its derivative y!(t) are specified at the same point t 0 .
The second order linear initial value problem with constant coefficients is then
Equation (8.6) is sometimes called the Cauchy initial value problem. We refer to the
solution of equation (8.1), which involves two arbitrary constants as the general solution
of the differential equation, to distinguish it from the solution of the initial value problem
Instead of constraining the solution and its derivative at the same point t 0 , it is also
possible to specify that value of the solution at two points as in the Dirichlet Problem or
or to specify the value of the derivative of the solution at two points as in the Neumann
to constrain the solution and its derivative at two different points, as in the initial-
©2005 BE Shapiro [Math 351 Spring 2005 Revised 5 May 2005] Page 8.2
where a11, a12 , a21, a22 are constants. We will only study the initial value problem
(equation (8.6)) and will not consider any of the boundary value problems, which are
or in terms of the operator notation, Ly = 0 . We use the notation yH (t) to denote the
general solution of (8.10), and yP (t) to denote any particular solution of (8.1) that is not
a solution of (8.10). We will see that there may be many different solutions to the
where y1 (t) and y2 (t) are each by themselves solutions of (8.10), then we call (8.11) the
general solution of the homogeneous equation, and call the pair of functions
{y1 (t),!y2 (t)} and fundamental set of solutions to the homogeneous equation. Then the
We will see that the functions y1 (t) and y2 (t) must not only both be solutions of (8.10),
i.e., Ly1 = Ly2 = 0 , but they must both be linearly independent (in the sense that it is
impossible to find any pair of constants c1 and c2 , both non-zero, such that
c1 y1 (t) + c2 y2 (t) = 0 for all t) for the pair of functions {y1 (t),!y2 (t)} to be considered a
©2005 BE Shapiro [Math 351 Spring 2005 Revised 5 May 2005] Page 8.3
THEOREM 2. Principle of Superposition. If y1,H (t) and y2,H (t) are both solutions
is also a solution of Ly = 0 .
are y1 (t) = e 4t and y2 (t) = e3t . To set this we let L = D 2 ! 7D + 12 and calculate that
Hence
THEOREM 3. Subtraction Principle. If y1,P (t) and y2,P (t) are two different particular
solutions of Ly = f (t) then yH (t) = y1,P (t) ! y2,P (t) is a solution of the homogeneous
equation Ly = 0 .
Proof. Since Ly1,P = f (t) and Ly2,P = f (t) , LyH = L(y1,P ! y2,P ) = Ly1,P ! Ly2,P = 0 .
©2005 BE Shapiro [Math 351 Spring 2005 Revised 5 May 2005] Page 8.4
THEOREM 4. Existence and Uniqueness. The second order linear initial value
problem
COROLLARY 1. The second order linear initial value problem with constant
coefficients
Proof. This follows immediately from theorem 4 with a(t) = a,!b(t) = b,!c(t) = c .
where p(t) = b(t) / a(t) , q(t) = c(t) / a(t) , and r(t) = f (t) / a(t) . Define
Then
v! = y!! = " p(t) y! " q(t)y " r(t) = "q(t)u " p(t)v " r(t) (8.23)
and therefore
d ! u$ ! 0 1 $ ! u$ ! 0 $
= + (8.24)
dt #" v &% #" 'q(t) ' p(t)&% #" v &% #" 'r(t)&%
©2005 BE Shapiro [Math 351 Spring 2005 Revised 5 May 2005] Page 8.5
! u(t)$ ! y0 $ ! 0 $ ! 0 1 $
y(t) = # & ,!!y 0 = # & , !w(t) = # & , A(t) = # (8.25)
" v(t)% " y1 % " 'r(t)% " 'q(t) ' p(t)&%
Then the initial value problem is equivalent to the first order system
dy
y! = = f(t, y), !y(t 0 ) = y 0 (8.26)
dt
Where f(t, y) = A(t)y + w(t) . We have already proven the existence (e.g., the Peano
(8.26).
Proof. Pick any numbers ! , " . Then by Theorem 4 the initial value problem Ly = 0 ,
In this case it is possible to solve the equation by making the change of variables z = y! ,
Example 2. Find the general solution of the homogeneous linear equation y!! + 6 y! = 0 .
integrating gives y! = z = Ce"6t . Separating variables and integrating a second time gives
1
y = " Ce!6t dt = ! Ce!6t + C2 = C1e!6t + C2 (8.28)
6
©2005 BE Shapiro [Math 351 Spring 2005 Revised 5 May 2005] Page 8.6
where C1 = !C / 6 .
z! + 6z = t (8.29)
d
! ze6t # = e6t ( z% + 6t ) = e6t t (8.30)
dt " $
and therefore
z = e!6t ( " te 6t
) #1
dt + C1 = e!6t % te6t !
$6
1 6t
36
& 1
e + C1 ( = t !
' 6
1
36
+ C1e!6t (8.31)
1 1
y! = t" + C1e"6t (8.32)
6 36
Integrating gives
1 2 1 1
y= t ! t ! C1e!6t + C2 (8.33)
12 36 6
It is customary to combine the (!1 / 6)C1 into a single unknown constant, which we again
name C1 ,
1 2 1
y= t ! t + C1e!6t + C2 . (8.34)
12 36
Example 4. Separate the solution of y!! + 6 y! = t found in the previous example into its
©2005 BE Shapiro [Math 351 Spring 2005 Revised 5 May 2005] Page 8.7
homogeneous and particular parts.
Comparing equations (8.34) and (8.28) we see that y(t) = yP (t) + yH (t) , where
and
1 2 1
yP (t) = t ! t (8.36)
12 36
Two interesting observations can be made from this. First, both arbitrary constants are
part of the homogeneous solution, and not the particular solution. Second, the
where r1 and r2 are the roots of the characteristic equation r 2 + 6r = 0 . We will see that
both of these properties hold more generally for linear equations with constant
coefficients.
equation to a first order equation. However, the following factorization property of the
linear operator L suggests an alternate substitution that is not very much more difficult.
!b ± b 2 ! 4ac
r1,2 = (8.39)
2a
©2005 BE Shapiro [Math 351 Spring 2005 Revised 5 May 2005] Page 8.8
Proof. The roots of the characteristic polynomial satisfy the following identities,
!b + b 2 ! 4ac !b ! b 2 ! 4ac b
r1 + r2 = + =! (8.40)
2a 2a a
and
Ly = ay!! + by! + cy
= ay!! " a(r1 + r2 ) y! + ar1r2 y
= a[ y!! " (r1 + r2 ) y! + r1r2 y] (8.42)
= a(D " r1 )( y! " r2 y)
= a(D " r1 )(D " r2 )y
Theorem 5 provides us with the following simple algorithm for solving any second order
1
(4) Solve the resulting differential equation z! " r1z = f (t) for z(t) .
a
(5) Substitute the initial condition z(t 0 ) = y!(t 0 ) " r2 y(t 0 ) to determine the arbitrary
constant in z(t) .
©2005 BE Shapiro [Math 351 Spring 2005 Revised 5 May 2005] Page 8.9
(6) Solve the first order differential equation y! " r2 y = z(t) where z(t) is the solution
(7) Solve for the remaining arbitrary constant in y(t) using the initial condition
y(t 0 ) = y0
Example 5. Use the factorization of theorem 5 to solve the initial value problem
To solve equation (8.44) we can make the substitution z = (D ! 7)y = y" ! 7y . Then
d
" ze!3t $ = 3e!3t sin t (8.46)
dt # %
Integrating,
The boundary conditions tell us that z(0) = y!(0) " 7y(0) = "7 , so C = !6.7 .
Hence
3
y! " 7y = z = " (3sin t + cost) " 6.7e 3t (8.48)
10
©2005 BE Shapiro [Math 351 Spring 2005 Revised 5 May 2005] Page 8.10
Substituting back for z = y! " 7y , and therefore
3
y! " 7y = " (3sin t + cost) + C1e3t (8.49)
10
The integrating factor for this equation is µ = e!7t ; multiplying through and integrating,
" 9 3 %
ye!7t = ( $ ! e!7t sin t ! e!7t cost ! 6.7e!4t 'dt
# 10 10 &
(8.50)
9e!7t (!7 sin t ! cost) 3e!7t (!7 cost + sin t) 6.7 !4 x
=! ! + e +C
10(50) 10(50) 4
Simplifying,
60 sin t + 30 cost
y= + 1.675e3t + Ce7t (8.51)
500
From the first initial condition y(0) = 1 and thus C = !0.735 so that
60 sin t + 30 cost
y= + 1.675e 3t ! 0.735e 7t . (8.52)
500
The following properties of the linear operator will prove useful in developing a more
precise formulation of algorithm 1. Our goal will be to find a general closed form
Ly = P(D)y (8.53)
Le zt = P(z)e zt (8.54)
©2005 BE Shapiro [Math 351 Spring 2005 Revised 5 May 2005] Page 8.11
Proof. For (8.53),
To derive (8.55) we apply the differential operator to e zt and expand all of the
derivatives:
Factoring out the common exponential and substituting back the D operator,
To solve
©2005 BE Shapiro [Math 351 Spring 2005 Revised 5 May 2005] Page 8.12
using algorithm 1, we let r1 and r2 be the roots of the characteristic
1
z! " r1z = f (t) (8.62)
a
This is a first order linear differential equation for z; an integrating factor is µ = e!r1t , so
# 1 &
z(t) = er1t %C1 + " e!r1s f (s)ds ( (8.63)
$ a t '
where
# 1 &
F(t) = er1t %C1 + " e!r1s f (s)ds ( (8.65)
$ a t '
!r2 u #
(r !r2 )u 1 !r1s &
"t e F(u)du = "t e 1 %$C1 + a "u e f (s)ds (' du
(8.67)
1
= C1 " e(r1 !r2 )u du + " e(r1 !r2 )u " e!r1s f (s)dsdu
t a t u
Hence
©2005 BE Shapiro [Math 351 Spring 2005 Revised 5 May 2005] Page 8.13
# 1 &
y = er2 t %C2 + C1 " e(r1 !r2 )u du + " e(r1 !r2 )u " e!r1s f (s)dsdu (
$ t a t u '
er2 t
= er2 t C2 + C1er2 t " e(r1 !r2 )u du + (r !r2 )u
"t e 1 "u e
!r1s
f (s)dsdu (8.68)
t a
= y H + yP
If r1 ! r2 then
C1 r2 t r1 !r2 t
yH = er2 t C2 + e e = c1er1t + c2 er2 t (8.71)
r1 ! r2
where c1 = C2 and c2 = C1 .
of
is
"$C1er1t + C2 er2 t , if r1 ! r2
y=# (8.74)
%$(C1t + C2 )e , if r1 = r2 = r
rt
©2005 BE Shapiro [Math 351 Spring 2005 Revised 5 May 2005] Page 8.14
Proof. We have already proven that (8.74) is a solution of ay!! + by! + cy = 0 . To
complete the proof we need to show that every solution has the form (8.74).
Suppose that r1 ! r2 and that u(t) is a solution of (8.73) that is not a linear combination
of the two functions er1t and er2 t . Then u(t) is a solution of some initial value problem
where we define the constants ! = u(t 0 ), " = u #(t 0 ) . We ask the following question: can
Hence
©2005 BE Shapiro [Math 351 Spring 2005 Revised 5 May 2005] Page 8.15
! " # r2 " r1t0 ! " # r1 " r2 t 0
C1 = e ,!!C2 = e (8.83)
r1 " r2 r2 " r1
and C2 given by (8.83). But we already said that u(t) is also a solution of the same
initial value problem. By the uniqueness theorem they must both be identical. But this
means that our assumption that u(t) was not a linear combination of er1t and er2 t must be
false. Therefore er1t and er2 t must be a fundamental set of solutions when r1 ! r2 . A
r1 = µ + i! , r2 = µ ! i" , where µ, ! "! (this will occur when b 2 < 4ac ), then
Proof.
©2005 BE Shapiro [Math 351 Spring 2005 Revised 5 May 2005] Page 8.16
COMPLEX NUMBERS
A complex number z is an ordered pair of real numbers (u, v) that we write as z = u + iv
where the symbol i has the special property that i 2 = !1 . We denote the field of all
complex numbers by the symbol ! .
If z = u + iv we call u the real part of z, v the imaginary part of z, and write u = Re z ,
v = Im z . We call the number z* = u ! iv the complex conjugate of z.
The absolute value z = u 2 + v 2 is the distance of the point (u, v) from the origin.
The phase ph z = tan !1 (v / u) is the angle between the vector from the origin to (u, v) .
If z = u + iv then in polar coordinates r = z and ! = ph z , and
z = z * z = (u ! iv)(u + iv) = u 2 + v 2
2
©2005 BE Shapiro [Math 351 Spring 2005 Revised 5 May 2005] Page 8.17
ALGORITHM 2. To solve the initial value problem
d. Set the two formulas for z found in previous two steps equal to each other.
(6) Use the initial conditions to determine the values of the constants C1 and C2 .
©2005 BE Shapiro [Math 351 Spring 2005 Revised 5 May 2005] Page 8.18
Example 7. Solve the initial value problem y !! " 6y ! + 9y = 0, y(0) = 4, y !(0) = 17 .
By the first initial condition, we have 4 = y(0) = A . Substituting A=4 into (8.89) and
differentiating,
y = (4 + 5t)e3t . (8.91)
!6 ± !64 !6 ± 8i
r= = = !3 ± 4i (8.92)
2 2
©2005 BE Shapiro [Math 351 Spring 2005 Revised 5 May 2005] Page 8.19
From equation (8.88) with a = 1 and f (t) = e2t , a particular solution is
yP = e!3t " e6u " e!3s e2s dsdu = e!3t " e6u " e!s dsdu
t u t u
(8.95)
#1 & 1
= !e!3t " e6u e!u du = !e!3t % e5t ( = ! e2t
t $5 ' 5
1 2t
y = C1e 3t + C2 e!3t ! e (8.96)
5
1 2
1 = C1 + C2 ! ,!!2 = 3C1 ! 3C2 ! (8.97)
5 5
1 !3t 1 2t
y = e 3t + e ! e (8.98)
5 5
Because equation (8.88) provides a closed form expression, we can always derive a
particular solution from it; in fact, some forms of f (t) occur so frequently that the
$ C "t
& a( µ ! r )( µ ! r ) e , if ! µ # r1 !# r2
& 1 2
& C
yP = % teµt , !!!!!!!!!!if !( µ = r1 !or! µ = r2 )!and!r1 # r2 (8.99)
a(r
& 1 2 ! r )
& K 2 µt
& t e , !!!!!!!!!!!!!if ! µ = r1 = r2
' 2a
©2005 BE Shapiro [Math 351 Spring 2005 Revised 5 May 2005] Page 8.20
where r1 and r2 are the roots of ar 2 + br + c = 0 . The fact that these solutions are
The success of this method hinges on being able to make a good "guess" for the form of
yP . For example, (8.99) suggests that for ay!! + by! + by = Ke" t would be Ct n e! t where
Since r = 2, 3 are roots of the characteristic equation this means that 3 is a single root. So
y! = Ke3t + 3Kte 3t
(8.100)
y!! = 6Ke3t + 9Kte 3t
( ) (
4e3t = 6Ke3t + 9Kte3t ! 5 Ke3t + 3Kte3t + 6Kte3t ) (8.101)
= Ke 3t
( 6 + 9t ! 5 ! 15t + 6t ) = Ke 3t
©2005 BE Shapiro [Math 351 Spring 2005 Revised 5 May 2005] Page 8.21
THEOREM 9. Let r1 and r2 are the roots of ar 2 + br + c = 0 . Then
yP (t) = t k "#(a0 + a1t + ! + ant n )sin ! t + (b0 + b1t + ! + bnt n )cos ! t $% (8.103)
where
k=# (8.104)
$%1,!±i! !are!roots!of !ar + br + c = 0
2
and the a0 , a1 ,..., an and b0 ,b1 ,...,bn can be determined by the method of undetermined
coefficients.
(3) A particular solution of ay!! + by! + cy = t n eµt [ Asin " t + B cos " t ] is
yP (t) = t k eµt "#(a0 + a1t + ! + ant n )sin ! t + (b0 + b1t + ! + bnt n )cos ! t $% (8.105)
where
and the a0 , a1 ,..., an and b0 ,b1 ,...,bn can be determined by the method of undetermined
coefficients.
©2005 BE Shapiro [Math 351 Spring 2005 Revised 5 May 2005] Page 8.22
yP = !
n
y (8.107)
i=1 Pi
homogeneous solution is
Therefore we try
Differentiating twice
or
C + 4D = 0,!0 = D ! 4C + 3
©2005 BE Shapiro [Math 351 Spring 2005 Revised 5 May 2005] Page 8.23
Solving these simultaneously for C and D give C = !12 / 17,!D = 3 / 17 . Hence
12 3
yP = ! cos2t + sin 2t (8.113)
17 17
12 3
y = yH + yP = e!t [ C1 cos 2t + C2 sin 2t ] ! cos 2t + sin 2t (8.114)
17 17
where LyP1 = e2t and LyP 2 = 5e 3t . Since µ = 2 is not a root of the characteristic equation
we try
try
yP 2 = cte3t
yP! 2 = c(e3t + 3te3t ) = ce3t (1 + 3t)! (8.118)
yP!!2 = c(6e3t + 9te3t ) = 3ce3t (2 + 3t)
in LyP 2 = 5e 3t , giving
©2005 BE Shapiro [Math 351 Spring 2005 Revised 5 May 2005] Page 8.24
1 2t
!! " 9y P2 = e 2t , while from
rom example 9, yP2 = ! e is a particular solution to yP2
5
5 3t
example 10, yP3 = !! " 9yP3 = 5e 3t .
te is a particular solution to yP3 A quick
6
equation:
1 5
y = y H + y P2 + yP3 = Ae 3t + Be !3t ! e2t + te3t (8.121)
5 6
then a restoring force, opposite in direction from but proportional to the displacement will
attempt to pull the spring back; the subsequent motion of an object of mass m attached to
The characteristic equation is r 2 + ! 2 = 0 , and since the roots are purely imaginary
©2005 BE Shapiro [Math 351 Spring 2005 Revised 5 May 2005] Page 8.25
y = C1 cos ! t + C2 sin ! t (8.124)
where ! = tan "1 (C1 / C2 ) is known as the phase of the oscillations. It can be easily shown
In fact, equation (8.122) is not such a good model because it predicts the system will
oscillate indefinitely, and not slowly damp out to zero. A good approximation to the
damping is a force that acts linearly against the motion: the faster the mass moves, the
stronger the damping force. Its direction is negative, since it acts against the velocity y!
!b ± b 2 ! 4" 2
r= (8.128)
2
The resulting system is said to be underdamped when b < 2! , critically damped when
b = 2! , and overdamped when b > 2! . In the underdamped system ( b < 2! ) the roots
are a complex conjugate pair with negative real part, r = µ ± i! where
©2005 BE Shapiro [Math 351 Spring 2005 Revised 5 May 2005] Page 8.26
y = Ae! µt sin(" t + # ) (8.130)
The critically damped system has a single positive real repeated root r = µ = b / 2 , so
that
The critically damped systems decays directly to zero without crossing the y-axis. The
overdamped systems has two negative real roots ! µ ± " (where ! < µ ) and hence
(
y = e! µt C1e " t + C2 e! " t ) (8.132)
The system damps to zero without oscillations, but may cross the y-axis once. The first
term in parenthesis in (8.132) does not give an exponential increase because ! < µ .
Finally, it is possible to add a motor to the spring that produces a force f (t) . The
©2005 BE Shapiro [Math 351 Spring 2005 Revised 5 May 2005] Page 8.27
Thus any second order linear differential equation with positive constant coefficients
Then
F0
= er2 t # e! r2 u (" cos " u + r1 sin " u)du (8.137)
" + r12
2 t
F0
= 2 2 %
$ !" (r1 + r2 )cos " t + (" 2 ! r1r2 )sin " t &'
(" + r1 )(" + r2 )
2 2
As with the unforced case, we can define the amplitude and phase angle by
F0 Asin(! t + " )
yP = (8.138)
(! 2 + r12 )(! 2 + r22 )
where
and therefore
©2005 BE Shapiro [Math 351 Spring 2005 Revised 5 May 2005] Page 8.28
F0 sin(! t + " )
yP = (8.141)
! 2b 2 + (! 2 # $ 2 )2
Forcing the oscillator pumps energy into the system; it has a maximum at ! = " , which
magnitude of the oscillations is maximized when the system is driven at its natural
solutions decay to zero and all that remains is the particular solution – so the resulting
system will eventually be strongly dominated by (8.141), oscillating in synch with the
F0 sin(# t + $ )
y = C sin(! t + " ) + (8.142)
#2 %!2
where C is the natural magnitude of the system, determined by its initial conditions.
©2005 BE Shapiro [Math 351 Spring 2005 Revised 5 May 2005] Page 8.29
Exercises.
Find a fundamental set of solutions to the following homogeneous equations.
(1) y!! " y! " 2y = 0
(2) y!! + 6 y! + 9y = 0
(3) 5 y!! " 20 y! + 30y = 0
(4) y!! + 5 y! = 0
(5) y!! + 8 y! + 16y = 0
(6) y!! = "36y
Find general solutions to the following differential equations
(7) y!! + 2 y! + y = 2e"t
et
(8) y!! " 2 y! + y =
1+ t2
(9) y!! " 5 y! + 6y = sin 3t
©2005 BE Shapiro [Math 351 Spring 2005 Revised 5 May 2005] Page 8.30
(25) For the differential equation t 2 y!! + ty! + y = 0
(a) Find a solution by using the substitution z = ln t ,
(b) Find a by the method of undetermined coefficients with y = t a .
(c) Prove that the solutions are equivalent
(26) Rewrite the simple harmonic oscillator equation y!! + " 2 y = 0 as a system of two
first order equations.
(27) Letting dy / dx = y! / x ! find a closed form expression for the trajectories, in the xy
plane, of the system you found in the previous exercise.
©2005 BE Shapiro [Math 351 Spring 2005 Revised 5 May 2005] Page 8.31