Project-2 MSc
Project-2 MSc
Differential Equation
By
Muhammad Ahsan Maqsood
2017-ag-1814
By
Muhammad Ahsan Maqsood
2017-ag-1814
April, 2019
Differential Equation
By
Muhammad Ahsan Maqsood
2017-ag-1814
Technical Report is submitted to faculty of sciences in partial fullfilment of the requirements for the degree
of
MASTER OF SCIENCES IN MATHEMATICS
Dissertation Committee
Member
Member
Coordinator,
MSc Mathematics (WP)
UAF Community College
Faisalabad
Declaration
This is to certify that this technical report has not been submitted for obtaining similar degree from any
other institute.
1
Dedicated
To
My Father
Maqsood Ahmad
2
Abstract
In mathematics, an abstract differential equation is a differential equation in which the unknown function
and its derivatives take values in some generic abstract space (a Hilbert space, a Banach space, etc.).
Equations of this kind arise e.g. in the study of partial differential equations: if to one of the variables
is given a privilegiate position (e.g. time, in heat or wave equations) and all the others are put together,
an ordinary ”differential” equation with respect to the variable which was put in evidence is obtained.
Adding boundary conditions can often be translated in terms of considering solutions in some convenient
function spaces.
Contents
1 Differential Equation 2
1.1 History . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3
1.2 Example . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 4
1.3 Types . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 4
1.4 Ordinary Differential Equation . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 5
1.5 Partial Differential Equation . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 5
1.6 Non-Linear Differential Equation . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 6
1.7 Equation Order . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 6
1.8 Examples . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 7
3 WAVE EQUATION 12
3.1 INTRODUCTION TO WAVE EQUATION . . . . . . . . . . . . . . . . . . . . . . . . . . 12
3.2 1-D WAVE EQUATION . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 12
3.2.1 INITIAL CONDITIONS . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 13
3.2.2 BOUNDARY CONDITIONS . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 13
3.2.3 D’ALEMBERT’S SOLUTION OF 1-D WAVE EQUATION . . . . . . . . . . . . . 13
3.2.4 SEPARATION OF VARIABLES . . . . . . . . . . . . . . . . . . . . . . . . . . . . 16
3.2.5 EXAMPLE . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 17
3.3 2-D WAVE EQUATION . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 18
3.3.1 The Heat Equation . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 19
3.3.2 The Wave Equation . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 19
3.3.3 Separation of Variables . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 19
3.3.4 Solving the Heat Equation . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 19
3.3.5 Heat Equation with Non-Zero Temperature Boundaries . . . . . . . . . . . . . . . 20
3.3.6 Laplace’s Equation . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 20
3.3.7 Vibrating String . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 20
3.4 Existence of Solutions . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 20
3.5 Connection to Difference Equations . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 21
3.6 Applications . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 21
3.6.1 Physics . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 22
3.6.2 Biology . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 23
3.6.3 Chemistry . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 23
3.6.4 Economics . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 23
3.7 Black-Scholes Model . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 23
3.8 The Black-Scholes World . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 25
3.9 Black-Scholes Equation . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 26
3.10 Black-Scholes Formula . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 26
3.10.1 Alternative Formulation . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 27
3.11 Interpretation . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 28
1
Chapter 1
Differential Equation
2
1.1 History
Differential equations first came into existence with the invention of cal-
culus by Newton and Leibniz. In Chapter 2 of his 1671 work ”Methodus
fluxionum et Serierum Infinitarum”, Isaac Newton listed three kinds of
differential equations:
dy
= f (x)
dx
dy
= f (x, y)
dx
∂y ∂y
x1 + x2 =y
∂x1 ∂x2
He solves these examples and others using infinite series and discusses the
non-uniqueness of solutions.
Jacob Bernoulli proposed the Bernoulli differential equation in 1695.
This is an ordinary differential equation of theform
y 0 + P (x)y = Q(x)y n
for which the following year Leibniz obtained solutions by simplifying it.
Historically, the problem of a vibrating string such as that of a musi-
cal instrument was studied by Jean le Rond d’Alembert, Leonhard Euler,
Daniel Bernoulli, and Joseph-Louis Lagrange. In 1746, d’Alembert dis-
covered the one-dimensional wave equation, and within ten years Euler
discovered the three-dimensional wave equation.
3
In 1822, Fourier published his work on heat flow in Théorie analytique
de la chaleur (The Analytic Theory of Heat), in which he based his rea-
soning on Newton’s law of cooling, namely, that the flow of heat between
two adjacent molecules is proportional to the extremely small difference
of their temperatures. Contained in this book was Fourier’s proposal of
his heat equation for conductive diffusion of heat. This partial differential
equation is now taught to every student of mathematical physics.
1.2 Example
This means that the ball’s acceleration, which is a derivative of its velocity,
depends on the velocity (and the velocity depends on time). Finding the
velocity as a function of time involves solving a differential equation and
verifying its validity.
1.3 Types
Differential equations can be divided into several types. Apart from de-
scribing the properties of the equation itself, these classes of differential
equations can help inform the choice of approach to a solution. Com-
monly used distinctions include whether the equation is: Ordinary/Partial,
4
Linear/Non-linear, and Homogeneous/Inhomogeneous. This list is far
from exhaustive; there are many other properties and subclasses of dif-
ferential equations which can be very useful in specific contexts.
Linear differential equations are the differential equations that are linear
in the unknown function and its derivatives. Their theory is well developed,
and, in many cases, one may express their solutions in terms of integrals.
Most ODEs that are encountered in physics are linear, and, therefore,
most special functions may be defined as solutions of linear differential
equations (see Holonomic function).
5
PDEs can be used to describe a wide variety of phenomena in nature
such as sound, heat, electrostatics, electrodynamics, fluid flow, elasticity,
or quantum mechanics. These seemingly distinct physical phenomena can
be formalised similarly in terms of PDEs. Just as ordinary differential
equations often model one-dimensional dynamical systems, partial differ-
ential equations often model multidimensional systems. PDEs find their
generalisation in stochastic partial differential equations.
6
is a first-order differential equation, an equation containing the second
derivative is a second-order differential equation, and so on. Differential
equations that describe natural phenomena almost always have only first
and second order derivatives in them, but there are some exceptions, such
as the thin film equation, which is a fourth order partial differential equa-
tion.
1.8 Examples
∂ 2u ∂ 2u
+ = 0.
∂x2 ∂y 2
∂u ∂u ∂ 3 u
= 6u − .
∂t ∂x ∂x3
8
Chapter 2
In this chapter we are going to take a very brief look at one of the more
common methods for solving simple partial differential equations. The
method we’ll be taking a look at is that of Separation of Variables.
We need to make it very clear before we even start this chapter that we
are going to be doing nothing more than barely scratching the surface of
not only partial differential equations but also of the method of separation
of variables. It would take several classes to cover most of the basic tech-
niques for solving partial differential equations. The intent of this chapter
is to do nothing more than to give you a feel for the subject and if you’d
like to know more taking a class on partial differential equations should
probably be your next step.
Also note that in several sections we are going to be making heavy use
of some of the results from the previous chapter. That in fact was the
point of doing some of the examples that we did there. Having done them
will, in some cases, significantly reduce the amount of work required in
some of the examples we’ll be working in this chapter. When we do make
use of a previous result we will make it very clear where the result is com-
ing from.
Here is a brief listing of the topics covered in this chapter.
1-Cauchy-Riemen equation:
∂u ∂v
= ,
∂x ∂y
∂v ∂u
=− .
∂x ∂y
2-Heat equation:
∂T
= k 52 ψ.
∂t
3-Laplace equation:
52 ψ = 0.
4-Tricomi equation:
Uyy = yUxx .
5-Wave equation:
1 ∂ 2ψ
52 ψ = .
v 2 ∂t2
For example
∂u ∂u
− = 0,
∂x ∂y
10
∂u 3 ∂u
( ) + + u4 = 0.
∂x1 ∂x2
1.Elliptic:
AC > B 2
For example,Laplace’s equation
Uxx + Uyy = 0
where
A = C = 1, B = 0
2.Hyperbolic:
AC < B 2
For example, the one dimensional wave equation:
1
Uxx = Utt
c2
where
1
A = 1, C = − 2 , B = 0
c
3.Parabolic:
AC = B 2
For example,the heat and difusion equation
Ut = βUxx
11
Chapter 3
WAVE EQUATION
The wave equation is a 2nd order linear hyperbolic partial differential equa-
tion that describes the variety of waves,which are sound waves or water
waves.The wave equation specify function U = U (r, t), r ∈ Rn which sat-
isfies:
∂ 2u
2
= c2 52 U (3.1)
∂t
here 52 denotes the Laplacian in Rn and c is a constant speed of the wave
propagation.Eq 2.1 is given
D2u = o
2 1 ∂2
2
where D = 5 − 2 2 is the d’Alemberitian.
c ∂t
12
.The above equation can be solved by d’Alembert’s method and by using
separation of variables.
U (x, o) = f (x)
Ut (x, t) = g(x)
U (0, t) = 0
U (L, t) = 0
ξ = x − ct, η = x + ct
Utt − c2 Uxx = 0
2U ξη + 2Uξη = 0
Uξη = 0
∂ 2u
=0 (3.3)
∂ξ∂η
13
∂u
characteristic curves of the wave equation (2.3).The derivative does
∂ξ
not depend on η,i.e.
∂ ∂u ∂u
( )=0⇔ = f (ξ)
∂η ∂ξ ∂ξ
Now integrating the above equation w.r.t ξ,we get
R
U= f (ξ)dξ + f (η)
U = φ(ξ) + ψ(η)
adding eq.(2.6)and(2.7)
Subtracting eq.(2.6)and(2.7)
1 1
ψ 0 (x) = f 0 (x) − g(x)
2 2c
Integrate with respect to x
Z
1 1
ψ(x) = f (x) − g(x)dx + k4 (3.9)
2 2c
Adding eq.(2.8)and(2.9)
Comparing eq.(2.5)and(2.6)
f (x) = f (x) + k3 + k4
k3 + k4 = 0
k3 = k4 = k(say)
By x = z eq.(8)become
1 1 Rx
φ(x) = f (x) + g(z)dz + k
2 2c 0
By x = z eq.(9) become
1 1 Rx
ψ(x) = f (x) − g(z)dz + k
2 2c 0
U (x, t) = φ(x + ct) + ψ(x − ct) put in above eq.
15
Z x+ct
1 1
φ(x) = (x + ct) + g(z)dz + k (3.11)
2 2c 0
Z x+ct
1 1
ψ(x) = (x + ct) − g(z)dz − k (3.12)
2 2c 0
Adding eq.(2.11)and(2.12)
1 1 R x+ct 1 1 R x+ct
φ(x) + ψ(x) = (x + ct) + g(z)dz + (x + ct) − g(z)dz
2 2c 0 2 2c 0
then divide by XT ⇒
T 00 X 00
= c2 = −ω 2 (constant)
T X
ω
Solving X 00 = −k 2 X,where k = f orX(x) gives:
c
X = Asin(kx) + Bcos(kx)
16
Similarly if we solve T 00 = −ωn2 T (whereωn = ckn ) we find the general
solution
T (t) = C sin(ωn t) + D cos(ωn t)
∂u
U (x, o) = Uo (x),(x, t) = Vo (x)
∂t
P P
⇒ Uo = n bn sin(kn x),Vo = n an ωn sin(kn x)
RL
Using orthogonality of sin functions: 0 sin(km x) sin(kn x)dx = δnm ⇒
2 RL
bm = Uo (x) sin(km x)dx
L 0
2 RL
am = V0 (x) sin(km x)dx
ωm L 0
nπ mπ
Where kn = and km =
L L
3.2.5 EXAMPLE
∂ 2u 2
2∂ u
(x, t) = c (x, t) for all 0 < x < 1 and t > 0
∂t2 ∂x2
U (x, t) = U (1, t) = 0 for all t > 0
Solution:
17
R1
Where αk = 2 0 x(1 − x) sin(kπx)dx
Z 1
αk = 2 (x − x2 ) sin(kπx)dx (3.15)
0
R1
βk = 2 0 0 sin(kπx)dx = 0
Consider
R1 1 d
R1
0 x sin(kπx)dx =0 −
cos(kπx)dx
π dk
1 R1 d
=− 0 cos(kπx)dx
π dk
1
= − cos(kπ)
kπ
R1 2 R 1 1 d2
0 x sin(kπx)dx = 0 − π 2 dk 2 sin(kπx)dx
2 − k2π2 2
= cos(kπ) 3 3 − 3 3
k π k π
We have
R1
αk = 2 0 (x − x2 ) sin(kπx)dx
1 2 − k2π2 2
= 2[− cos(kπ) − cos(kπ) 3 3 − 3 3 ]
kπ k π k π
4
= 3 3 [1 − cos(kπ)]
k π
eq.(2.14) becomes
P∞ 8
U (x, y) = k=1 3 3 sin(kπx) cos(ckπt)
k π
18
0 ≤ x ≤ a,0 ≤ y ≤ b,0 ≤ t ≤ T
In this section we will do a partial derivation of the heat equation that can
be solved to give the temperature in a one dimensional bar of lengt.
In addition, we give several possible boundary conditions that can be used
in this situation. We also define the Laplacian in this section and give a
version of the heat equation for two or three dimensional situations.
19
3.3.5 Heat Equation with Non-Zero Temperature Boundaries
In this section we take a quick look at solving the heat equation in which
the boundary conditions are fixed, non-zero temperature. Note that this is
in contrast to the previous section when we generally required the bound-
ary conditions to be both fixed and zero.
In this section we solve the one dimensional wave equation to get the
displacement of a vibrating string.
For first order initial value problems, the Peano existence theorem gives
one set of circumstances in which a solution exists.
Given any point (a, b) in the xy-plane, define some rectangular region Z,
such that Z = [l, m] × [n, p] and (a, b) is in the interior of Z. If we are
dy
given a differential equation = g(x, y) and the condition that y = b
dx
when x = a , then there is locally a solution to this problem if g(x, y) and
∂g
are both continuous on Z. This solution exists on some interval with
∂x
its center at a. The solution may not be unique.
However, this only helps us with first order initial value problems. Suppose
we had a linear initial value problem of the nth order:
20
dn y dy
fn (x) n + · · · + f1 (x) + f0 (x)y = g(x)
dx dx
such that
For any nonzero fn (x), if {f0 , f1 , · · · } and g are continuous on some inter-
val containing x0 , y is unique and exists.
3.6 Applications
21
Many fundamental laws of physics and chemistry can be formulated
as differential equations. In biology and economics, differential equations
are used to model the behavior of complex systems. The mathematical
theory of differential equations first developed together with the sciences
where the equations had originated and where the results found applica-
tion. However, diverse problems, sometimes originating in quite distinct
scientific fields, may give rise to identical differential equations.
3.6.1 Physics
22
The Lorenz equations whose solutions exhibit chaotic flow.
3.6.2 Biology
3.6.3 Chemistry
The rate law or rate equation for a chemical reaction is a differential equa-
tion that links the reaction rate with concentrations or pressures of re-
actants and constant parameters (normally rate coefficients and partial
reaction orders). To determine the rate equation for a particular system
one combines the reaction rate with a mass balance for the system. In
addition, a range of differential equations are present in the study of ther-
modynamics and quantum mechanics.
3.6.4 Economics
23
and shows that the option has a unique price regardless of the risk of
the security and its expected return (instead replacing the security’s ex-
pected return with the risk-neutral rate). The formula led to a boom in
options trading and provided mathematical legitimacy to the activities of
the Chicago Board Options Exchange and other options markets around
the world. It is widely used, although often with adjustments and correc-
tions, by options market participants.
The key idea behind the model is to hedge the option by buying and
selling the underlying asset in just the right way and, as a consequence, to
eliminate risk. This type of hedging is called ”continuously revised delta
hedging” and is the basis of more complicated hedging strategies such as
those engaged in by investment banks and hedge funds.
The model’s assumptions have been relaxed and generalized in many di-
rections, leading to a plethora of models that are currently used in deriva-
tive pricing and risk management. It is the insights of the model, as exem-
plified in the Black–Scholes formula, that are frequently used by market
24
participants, as distinguished from the actual prices. These insights in-
clude no-arbitrage bounds and risk-neutral pricing (thanks to continuous
revision). Further, the Black–Scholes equation, a partial differential equa-
tion that governs the price of the option, enables pricing using numerical
methods when an explicit formula is not possible.
The Black–Scholes formula has only one parameter that cannot be di-
rectly observed in the market: the average future volatility of the underly-
ing asset, though it can be found from the price of other options. Since the
option value (whether put or call) is increasing in this parameter, it can
be inverted to produce a ”volatility surface” that is then used to calibrate
other models, e.g. for OTC derivatives.
The Black–Scholes model assumes that the market consists of at least one
risky asset, usually called the stock, and one riskless asset, usually called
the money market, cash, or bond.
25
market).
∂V 1 ∂ 2V ∂V
+ σ 2 S 2 2 + rS − rV = 0
∂t 2 ∂S ∂S
The key financial insight behind the equation is that one can perfectly
hedge the option by buying and selling the underlying asset in just the
right way and consequently ”eliminate risk”. This hedge, in turn, im-
plies that there is only one right price for the option, as returned by the
Black–Scholes formula.
The Black–Scholes formula calculates the price of European put and call
options. This price is consistent with the Black–Scholes equation as above;
26
this follows since the formula can be obtained by solving the equation for
the corresponding terminal and boundary conditions.
The value of a call option for a non-dividend-paying underlying stock
in terms of the Black–Scholes parameters is:
C(St , t) = N (d1 )St − N (d2 )Ke−r(T −t)
σ2
1 St
d1 = √ ln + r+ (T − t)
σ T −t K 2
√
d2 = d1 − σ T − t
27
Given put–call parity, which is expressed in these terms as:
C − P = D(F − K) = S − DK
the price of a put option is:
3.11 Interpretation
The Black–Scholes formula can be interpreted fairly handily, with the main
subtlety the interpretation of the N (d± ) (and a fortiori d± terms, partic-
ularly d+ and why there are two different terms.
breaks up as:
C = DN (d+ )F − DN (d− )K
28
a cash-or-nothing call. In risk-neutral terms, these are the expected value
of the asset and the expected value of the cash in the risk-neutral measure.
The naive, and not quite correct, interpretation of these terms is that
N (d+ )F is the probability of the option expiring in the money N (d+ ),
times the value of the underlying at expiry F, while N (d− )K is the prob-
ability of the option expiring in the money N (d− ), , times the value of the
cash at expiry K. This is obviously incorrect, as either both binaries expire
in the money or both expire out of the money (either cash is exchanged
for asset or it is not), but the probabilities N (d+ ) and N (d− ) are not equal.
In detail, the terms are the probabilities of the option expiring in-the-
money under the equivalent exponential martingale probability measure
(numéraire=stock) and the equivalent martingale probability measure (numéraire=risk
free asset), respectively. The risk neutral probability density
for the stock price ST ∈ (0, ∞) is is defined as above.
Specifically, N (d2 ) is the probability that the call will be exercised provided
one assumes that the asset drift is the risk-free rate. N (d1 ), however, does
not lend itself to a simple probability interpretation. SN (d1 ) is correctly
interpreted as the present value, using the risk-free interest rate, of the
expected asset price at expiration, given that the asset price at expiration
is above the exercise price. For related discussion – and graphical repre-
sentation – see section ”Interpretation” under Datar–Mathews method for
real option valuation.
29
neutral probability measure. Note that both of these are probabilities
in a measure theoretic sense, and neither of these is the true probability
of expiring in-the-money under the real probability measure. To calculate
the probability under the real (”physical”) probability measure, additional
information is required—the drift term in the physical measure, or equiv-
alently, the market price of risk.
30
Bibliography
31
[12] Campbell, S. L., Campbell, S. L. (1980). Singular systems of differen-
tial equations (Vol. 1). London: Pitman.
[13] Kaleva, O. (1987). Fuzzy differential equations. Fuzzy sets and sys-
tems, 24(3), 301-317.
[14] Lindgren, F., Rue, H., Lindström, J. (2011). An explicit link between
Gaussian fields and Gaussian Markov random fields: the stochastic
partial differential equation approach. Journal of the Royal Statistical
Society: Series B (Statistical Methodology), 73(4), 423-498.
[15] Lindgren, F., Rue, H., Lindström, J. (2011). An explicit link between
Gaussian fields and Gaussian Markov random fields: the stochastic
partial differential equation approach. Journal of the Royal Statistical
Society: Series B (Statistical Methodology), 73(4), 423-498.
32