math15
math15
y = f(x1 , . . . , xm )
y5 − 5xy + 4x2 = 0
does not have an explicit solution, although we can say that (x, y) = (1, 1)
is a solution, as is (1/4, 1), suggesting that y(1) = 1 and y(1/4) = 1. It’s
also clear that y(0) = 0. There are hints of a function here, but we can’t
solve for it.
When the equation implicitly defines y in terms of x, but we cannot
write an expression for y(x), we might still be able to determine the
derivatives. The Implicit Function Theorem gives conditions for finding
local functions for y and their derivatives.
2 MATH METHODS
b (3, 4)
3 x
b
(3, −4)
Figure 15.1.2: The circle is the graph of x2 +y2 = 25, which tries to implicitly
define y as a function of x. As you can see, there are two solutions y(x) for
most values of x. This is illustrated at x = 3.
For every value of x ∈ (−5, +5), there are two values of y(x), not one.
Only at x = ±5 do we have a function. This is illustrated in Figure
15.2.2. ◭
15. IMPLICIT FUNCTIONS AND THEIR DERIVATIVES 3
b b b
(3, −4)
Figure 15.2.2: The circle is the graph of x2 +y2 = 25, which tries to implicitly
define y as a function√ of x. We can define such a function on the upper half
= 25 − x2 for −5 < x < 5. This contains the point (3, 4).
of the circle by y √
The function − 25 − x2 does the same thing for the lower half of the circle.
◭
4 MATH METHODS
(−5, 0) (5, 0)
b b b
x
Figure 15.3.2: The circle is the graph of x2 +y2 = 25, which tries to implicitly
define y as a function of x. The points (5, 0) and (−5, 0) pose particular
problems as we are unable to write y as a function of x on a neighborhood
of x = ±5 due to the verticality of the graph of y at x = ±5.
◭
15. IMPLICIT FUNCTIONS AND THEIR DERIVATIVES 5
∂G
(x0 , y0) 6= 0,
∂y
∂G (x , y )
∂x 0 0
y′ (x0 ) = − . (15.4.2)
∂G (x , y )
∂y 0 0
1
The basic idea is already present in Newton in 1669. Leibniz’s work includes an
example of implicit differentiation in 1684. The theorem is generally attributed to
Cauchy, who provided a rigorous statement and proof in two dimensions in his first
Turin Memoir (1831).
2
The history of the Implicit Function Theorem and more is covered in Steven G.
Krantz and Harold R. Parks (2002), The Implicit Function Theorem: History, Theory, and
Applications, Birkhäuser, Boston, Basel & Berlin.
6 MATH METHODS
◮ Example 15.6.1: The Implicit Function Theorem and the Circle. How
does this apply to the circle x2 + y2 = 25 we studied in Example 15.3.1?
Here we set G(x, y) = x2 + y2 and c = 25. Let’s try (x0, y0 ) = (3, −4)
and see what happens.
Here
∂G
(3, −4) = −8 6= 0,
∂y
so we can apply the Implicit Function Theorem to find y(x) solving x2 +
[y(x)]2 = 25 with y(3) = −4 and y′ (3) = −2(3)/2(−4) = 3/4. Compare
to the solution y1 given by y1(x) = −(25 − x2 )1/2. Then
x
y′1(x) = −(1/2)(25 − x2)−1/2(2x) = √ .
25 − x2
∂G ∂G
(x0, y0 ) 6= 0 or (x0, y0 ) 6= 0.
∂x ∂y
3
The term “manifold” is a direct translation of Riemann’s term Mannigfaltigkeit, intro-
duced in his Göttingen lecture of 1854, Über die Hypothesen, welche der Geometrie
zu Grundeliegen, (On the hypotheses that underlie geometry). The lecture founded the
field of differential geometry.
The German mathematician Bernhard Riemann (1826–1866) was one of the all-time
greatest mathematicians. Only 39 when he died, he founded the field of differential
geometry (later used by Einstein in his theory of General Relativity), proposed the Rie-
mann Hypothesis, which is still being investigated and remains unproven after over 150
years. Some of his other accomplishments are developing the first rigorous definition
of the integral, which he used to prove some results concerning Fourier series, and
introducing Riemann surfaces in complex analysis.
15. IMPLICIT FUNCTIONS AND THEIR DERIVATIVES 9
We compute DG(0, 0) = (0, 0), showing that the curve is not regular
at the origin. In fact, there is no way to describe this curve that makes it
regular at the origin.5
4
This lemniscate is that of the Swiss mathematician Jacob (aka James or Jacques)
Bernoulli (1655–1705 NS), one of the mathematicians in the Bernoulli family. He made
a number of important contributions to mathematics. He discovered the constant e,
base of the natural logarithms. He also provided the original formulation of the Law
of Large Numbers. Finally, he and his brother Johann (1667–1748 NS) founded the
Calculus of Variations, a method of optimization where the optimal point is a function
rather than a number.
5
The only possibility is to be a one-dimensional manifold. If U is a neighborhood of
the origin that is homeomorphic to an open interval, removing the origin breaks U into
four components, but removing the corresponding point in the interval breaks it into
two. The number of components of a set must be preserved under homeomorphism,
so this is impossible.
10 MATH METHODS
∂G (x , y ) ∂G (x , y )
∂x 0 0 ∂y 0 0
y′ (x0) = − or x′ (y0) = − ,
∂G (x , y ) ∂G (x , y )
∂y 0 0 ∂x 0 0
respectively.
When the curve defined by G is regular, we can strengthen this as
follows.
Corollary 15.9.2. Let G : R2 → R be a C1 function. It the curve C =
{(x, y) : G(x, y) = c} is regular, at every point (x0, y0 ) on the curve C,
we can parameterize the curve by a C1 curve defined on an open set
containing (x0 , y0 ): either as x, y(x) or x(y), y .
The manifold C is considered one-dimensional since it can be locally
described by a single parameter. It is differentiable because there are in-
vertible differentiable functions that describe it locally, in a neighborhood
of each point.
15. IMPLICIT FUNCTIONS AND THEIR DERIVATIVES 11
M = {(x, y) ∈ R2 : G(x, y) = c}
6
This will be easier to see once we introduce coordinate charts.
12 MATH METHODS
G(x, y) ∇G
b
TM
Figure 15.11.1: Here ∇G is the gradient and the tangent line to G(x, y) = 0,
labelled T M, is shown by the heavy line perpendicular to the gradient vector.
The function on the graph is 0 = G(x, y) = y + 3(x3 − x).
15. IMPLICIT FUNCTIONS AND THEIR DERIVATIVES 13
7
See page 1-1 of Michael Spivak, A Comprehensive Introduction to Differential Ge-
ometry, vol. I, 1970. Also see page 1 of Morris Hirsch, Differential Topology, 1976.
This definition can be extended to topological spaces, but that ideally involves para-
compactness, which takes us too far afield.
14 MATH METHODS
describe C as a manifold.
p
g1(x) = x, 25 − x2 for x ∈ V1 = (−5, 5)
p
g2(x) = x, − 25 − x2 for x ∈ V2 = (−5, 5)
p
g3(y) = 25 − y2, y for y ∈ V3 = (−5, 5)
p
g4(y) = − 25 − y2, y for y ∈ V4 = (−5, 5)
The functions g1 and g2 describe the top and bottom halves of the circle,
respectively. The functions for the right and left sides of the circle are g3
and g4 , respectively. I’ve labeled the domains Vi , which happen to be
identical here, but need not be.
Every point except (0, 5), (0, −5), (5, 0), and (−5, 0) is in the range of
exactly two of the gi . Those points are in the range of only one of the
gi , with the points listed in the same order as g1, . . . , g4 .
The inverses of the gi are the projections ϕ1 (x, y) = ϕ2 (x, y) = x and
ϕ3 (x, y) = ϕ4 (x, y) = y. That means that when (x, y) ∈ C, ϕ1 can be
written p
ϕ1 (x, 25 − x2) = x,
with similar definitions for the other ϕu = i. This guarantees that each of
the four open half-circles is homeomorphic to the interval (−5, 5). This
shows that the circle C is a manifold.
The mappings g1 and ϕ1 are illustrated in Figure 15.15.1.
16 MATH METHODS
U1
g1 ϕ1
bc bc
V1 x
Figure 15.15.1: The vertical lines illustrate the bijection between U1 (in red)
and V1 = {(x, 0) : |x| < 5} (green) created by projection ϕ1 onto the x-axis
and g1 , mapping back to the circle. Two examples are highlighted. One
showing ϕ1 mapping down to the x-axis, the other showing g1 mapping up
to the circle.
Here V1 is embedded in R2 using the map ψ(x) = (x, 0), with image
{(x, 0) : x ∈ (−5, 5)}. The subspace topology ensures ψ is a homeomorphism.
8
Although the functions gi can be defined on the closures of the intervals Vi , we
would no longer have an open set as the range, and the functions cannot be C1 there.
15. IMPLICIT FUNCTIONS AND THEIR DERIVATIVES 17
9
The use of local coordinates such as these dates back at least to Gauss in 1827.
18 MATH METHODS
R2
ϕ
U ϕ(U)
ϕ−1 ϕj
Vi −−i→ Ui ∩ Uj −→ Vj .
20 MATH METHODS
ϕj ◦ ϕ−1
i : ϕi (Ui ∩ Uj ) ⊂ Vi → ϕj (Ui ∩ Uj ) ⊂ Vj . (15.19.3)
ϕ3 U1
V3
ϕ−1
1
bc
V1 x
Wαβ = Uα ∩ Uβ
M
ϕα ϕβ
ϕβ ◦ ϕ−1
α
ϕα (Uα) ϕβ (V)
ϕα (Wαβ) ϕβ (Wαβ )
ϕα ◦ ϕ−1
β
Figure 15.21.1: Here (ϕα , U) and (ϕβ , V) are charts with non-empty com-
mon domain Wβ = Uα ∩ Uβ . The transition maps ϕα ◦ ϕ−1 β and ϕβ ◦ ϕα
−1
ϕβ (W). The darker regions indicate the sets ϕα (W) ⊂ ϕα (U) and ϕβ (W) ⊂
ϕβ (V).
15. IMPLICIT FUNCTIONS AND THEIR DERIVATIVES 23
10
This definition, using transition maps, dates to O. Veblen and J.H.C. Whitehead
(1931) “A set of axioms for differential geometry”, Proc. Nat. Acad. Sci. 17, 551–561.
Oswald Veblen (1880–1960) was an American mathematician who specialized in
topology, differential geometry, and projective geometry. His uncle was the sociologist
Thorstein Veblen (Theory of the Leisure Class).
J.H.C. Whitehead (1904–1960) was a British mathematician. During World War II, he
applied operations research to submarine warfare, and later joined the codebreakers
at Bletchley Park. In algebraic topology, he defined CW complexes and developed
simple homotopy theory. The British mathematician and philosopher Alfred North
Whitehead was his uncle, who is best known in mathematics for the three-volume
Principia Mathematica, written with Bertrand Russell.
24 MATH METHODS
ψ−1 ϕ
→ ϕ(U ∩ V) ⊂ Rk .
ψ(U ∩ V) −−→ U ∩ V −
The set M is an m dimensional manifold. Define F(x) = x, f(x) . Here
F maps Rm onto the graph of f. We only need one chart for this manifold.
Let π(x, y) = x, which projects the graph onto its first m coordinates, x .
The chart is (M, π) and π−1 = F. The atlas is also (M, π). There are no
transition maps to worry about. ◭
15. IMPLICIT FUNCTIONS AND THEIR DERIVATIVES 27
∂f ∂f
∆x1 + ∆xi = 0.
∂x1 ∂xi
It follows that
∆xi f1
= − = − MRTS1i .
∆x1 fi
The slopes of the isoquant in various directions is given by the marginal
rate of technical substitution. ◭
15. IMPLICIT FUNCTIONS AND THEIR DERIVATIVES 29
ϕ−1 f ψ
ϕ(U) −−→ U ⊂ M −
→V ⊂ N −
→ ψ(V).
which is defined on
ϕ U ∩ f−1(V) .
By using transition functions and the Chain Rule, it is easy to see that all
charts containing x and f(x) agree on the differentiability of f. We can
similarly define Ck functions for any k.
As a sanity check, suppose M and N are open subsets U ⊂ Rk and
V ⊂ Rm . The only charts are the respective identity maps, so if f : M →
N, we need only check whether id ◦(f ◦ id−1) = f is differentiable as a
function from U to V. I.e., it must be differentiable in the ordinary sense.
30 MATH METHODS
id ◦f ◦ ϕ−1 2 4 2 2 2
i (x) = gi1 (x) + gi2 (x) = x + (25 − x ) ,
while for i = 3, 4,
id ◦f ◦ ϕ−1 2 4 2 4
i (y) = gi1 (y) + gi2 (y) = 25 − y + y .
It is easy to see that these functions are not only differentiable, but C∞ ,
showing that f is a C∞ function from C to R. ◭
15. IMPLICIT FUNCTIONS AND THEIR DERIVATIVES 31
g(x, y) = c.
Moreover,
−1
Dŷ(x∗ ) = − Dy g (x∗, y∗ ) Dx g (x∗, y∗ ).
(15.30.5)
11
The Italian mathematician Ulisse Dini (1845–1918) generalized the Implicit Function
Theorem to m dimensions. Dini worked primarily in real analysis. Among other things,
he developed a criterion for the pointwise convergence of Fourier series.
32 MATH METHODS
12
The earliest version of the Inverse Function Theorem seems to be that of Joseph Louis
Lagrange in 1770. It was later proved by Picard and Goursat via iteration. For us, the
iteration is replaced by the Contraction Mapping Theorem.
The French mathematician Édouard Jean-Baptiste Goursat (1858–1936) is probably
best known today for the Cauchy-Goursat Theorem of complex analysis. He was also
one of the 19th century mathematicians who explored geometry in more than three
dimensions. In his own day he was best known for his Cours d’analyse mathématique.
15. IMPLICIT FUNCTIONS AND THEIR DERIVATIVES 33
x = f(y∗) + T (y − y∗ ).
y = y∗ + T −1 x − f(y∗) .
1
T − Dyf(y) = Dy f(y∗) − Dy f(y) <
2kT −1k
Putting it together,
Fx(y1 ) − Fx(y2 ) = Dy Fx (ȳ) (y1 − y2 )
= T −1 T − Dyf(ȳ)
y1 − y2
≤ T −1 T − Dy f(ȳ) y1 − y2
1
< ky1 − y2 k.
2
yx = Fx(yx )
= yx + T −1 f(yx ) − x .
This implies
f(yx) = x. Define the function ŷ by ŷ(x) = yx . Then
f ŷ(x) = x, so ŷ is the inverse of f.
By Invariance of Domain, the inverse of f is continuous on V =
f Br (y ) , which is open and contains x∗. Finally, since f is C1 and
∗
−1
I 0
DG = .
−(Dy g)−1Dx g I
13
All of the arguments to g, G, and H in this proof are vectors, not covectors. I’ve
sometimes written them horizontally to save space.
15. IMPLICIT FUNCTIONS AND THEIR DERIVATIVES 37
Since both ϕ−1 and ψ are C1 , the Chain Rule tells us that the transition
maps are C1 , showing that we have a C1 atlas.
40 MATH METHODS
p p
ϕ1 ◦ ϕ−1
3 (y) = ϕ1 (x0 + 25 − y2 , y) = x0 + 25 − y2 .
This is C1 on {y : 5 > y > 0}. Similarly, the other transition maps are C1.
This atlas makes C a C1 manifold. In fact, it makes C a C∞ manifold.
This same technique can be used to define an atlas for any circle.
In fact the technique can also be used on spheres, although it requires
more charts, 2(m + 1) for the unit m-sphere, which is Sm = {x ∈ Rm+1 :
kxk2 = 1}. ◭
15. IMPLICIT FUNCTIONS AND THEIR DERIVATIVES 41
x1
November 3, 2022