AnalysisI Lecture Notes
AnalysisI Lecture Notes
Vicky Neale
Contents
1 Introduction 4
3 Properties of arithmetic in R 8
11 Existence of roots 27
1
12 More consequences of completeness 29
13 Countability 31
14 More on countability 34
15 Introduction to sequences 37
16 Convergence of a sequence 40
20 Complex sequences 58
21 Subsequences 59
24 Orders of magnitude 68
25 Monotonic sequences 69
26 Convergent subsequences 74
27 Cauchy sequences 76
2
30 Series: more results and another test for convergence 85
32 Ratio Test 91
33 Integral Test 95
3
1 Introduction
This course is a first introduction to real analysis. We’ll set the scene with
exploring basic properties of real numbers. Then we’ll go on to define what
it means for a sequence to converge, and for a series to converge, and we’ll
explore these ideas in detail, allowing us to give careful justifications of some
familiar results, as well as proving some that you might not have seen before.
There are several resources that will help you as you study the course:
- these notes
- each other
When I made the lecture videos, I used a mix of slides and handwriting,
but everything handwritten also appears on a typed slide. I’m making the
slides available alongside the videos, in case you would like a copy of these to
view or annotate. These notes (the document you’re reading now!) include
everything in the slides. You are encouraged to read them alongside the
notes by Dr Hilary Priestley.
4
Acknowledgements
These notes, and the lectures they accompany, are extremely closely based on
the notes produced by Dr Hilary Priestley. The same applies to the problems
sheets.
I would like these notes to be as useful as possible. If you (whether
student or tutor) think that you’ve noticed a typo, or mistake, or part that
is unclear, please check the current, up-to-date, notes on the website, to see
whether I’ve already fixed it. If not, please email me (vicky.neale@maths)
or put a note in the Moodle discussion, and I’ll do something about it, and
(with your permission) thank you here.
Thanks to Kendall De, Orson Hart, Aidan Strong and another (a student
who preferred not to be named) for helping to fix glitches in these notes and
the accompanying problems sheets.
We are going to work with the real numbers in this course. What is a real
number? We are not, in this course, going to define the real numbers — we
aren’t going to say what they are. Instead, we’ll focus on how they behave —
what they do. We’ll identify the key properties of the real numbers, and the
goal is to deduce everything from these properties. That leaves the task of
showing that there is a set with the required properties (that is, constructing
the real numbers), but that is not a task for this course.
So what are these key properties? They are all properties that will prob-
ably feel ‘obvious’. For us, they are assumptions. We assume that the real
5
numbers have these properties. You might feel surprised that there aren’t
more assumptions, but, as we’ll see, we can deduce the other familiar (and
not so familiar) properties from these assumptions. The goal is to avoid
assuming more than we have to.
One question to have in the back of your mind through this section is
“What other structures also have these properties?” We know that the ra-
tional numbers share some properties with the real numbers, and also the
complex numbers share some properties with the real numbers. But we also
know that in some way the rational numbers are definitely different from
the real numbers, and similarly for complex numbers, and we should see this
come up. If the rational numbers share all of our key properties of the real
numbers, then we haven’t assumed enough properties of the real numbers!
The flavour of this section will be about deducing basic properties, one
careful step at a time. Some people enjoy this way of working; others, well,
not so much. If you’re in the latter category, don’t worry: most of this
course will have quite a different flavour (although it will still be about giving
careful, rigorous proofs of results that might feel ‘obvious’). But, at its heart,
mathematics is built on the sort of axiomatic reasoning that we’ll see in this
section, so it’s good to have a sense of how that works.
Notation. We write R for the set of real numbers. We write Q for the set
of rational numbers, and C for the set of complex numbers.
6
For every a, b ∈ R there is a unique real number a + b, called their sum.
a+b=b+a (+ is commutative)
a + (b + c) = (a + b) + c (+ is associative)
a·b=b·a (· is commutative)
a · (b · c) = (a · b) · c (· is associative)
if a ̸= 0 then a · 1
a
=1 (multiplicative inverses)
a · (b + c) = a · b + a · c (· distributes over +)
7
0 ̸= 1 (to avoid total collapse)
Definition. Let F be a set with operations + and · that satisfy the axioms
above. Then we say that F is a field.
Example. We’ve just said that R is a field. The rational numbers Q form a
field. The complex numbers C form a field. You’ll meet other fields too, in
other courses. The integers Z do not form a field.
In the next section, we’ll use these axioms to deduce the basic properties
of arithmetic in R. This reasoning would apply equally to any field. We’ll
need to make further assumptions about R, but we’ll postpone this till we’ve
studied basic arithmetic.
3 Properties of arithmetic in R
In the last section, we saw the arithmetic axioms for R. Now we’ll deduce
some properties of arithmetic in R.
8
Proposition 1. Let a, b, c, x, y be real numbers.
(iii) −0 = 0.
(iv) −(−a) = a.
1
(viii) If a ̸= 0 then 1 = a.
a
(ix) (a + b) · c = a · c + b · c.
(x) a · 0 = 0.
1 1
(xiii) If a · b = 0 then a = 0 or b = 0. If a ̸= 0 and b ̸= 0 then a·b
= a
· 1b .
As we’ll see shortly, (i)–(v) can be proved using only the four axioms
about +.
Similarly, (vi)–(viii) can be proved using only the four axioms about ·.
9
(ix)–(xiii) between them use all the axioms.
It’s worth proving results like this in a sensible order! Once we’ve
proved a property, we can add it to the list of properties we can assume
in subsequent parts. You’ll see that we prove some later parts using
earlier parts.
x = x + 0 (additive identity)
= 0 + x (+ is commutative)
y = y + 0 (additive identity)
= (y + a) + (−a) (+ is associative)
= (a + y) + (−a) (+ is commutative)
= (a + x) + (−a) (hypothesis)
= (x + a) + (−a) (+ is commutative)
= x + (a + (−a)) (+ is associative)
= x + 0 (additive inverses)
= x (additive identity).
10
(iv) We have
= 0 (additive inverses)
(ix) (This is another form of distributivity, similar to the axiom but differ-
ent!)
We have
(a + b) · c = c · (a + b) (+ is commutative)
= c · a + c · b (· distributes over +)
= a · c + b · c (· is commutative – twice).
and also
a · (0 + 0) = a · 0 (additive identity)
= a · 0 + 0 (additive identity)
11
(xi) We have
= a · 0 (additive inverses)
(xii) We have
= 1 ((iv)).
12
and this is a contradiction (0 ̸= 1).
So if a · b = 0 then a = 0 or b = 0.
From now on, we can use all of these properties. We shan’t give such
detailed, one-axiom-at-a-time, derivations in the remainder of the course —
but we could, if we needed to!
Remark. (This remark is not part of the course!) You might be concerned
that if we don’t go back to the axioms every time then we might overlook an
unproved step, or might make a mistake. But going back to the axioms every
time is not practical: a research paper might take tens of pages to give a proof,
referring back to other results, which themselves build on results, which build
on results, . . . . This is where proof verification comes in: computers can take
care of this detailed checking, leaving humans to focus on things that humans
are good at (like having creative ideas for proofs).
One interesting project in this area (there are others, not just this one) is
Xena https://xenaproject.wordpress.com/what-is-the-xena-project/
— this is aimed at undergraduates, which is why I’m mentioning it. Some of
you might find it interesting. There’s an article about proof verification and
Xena in the London Mathematical Society Newsletter, pages 32–36 of https:
//www.lms.ac.uk/sites/lms.ac.uk/files/files/NLMS_484-forweb2.pdf.
Now back to the course . . . .
13
Notation. From now on, we use more familiar notation. We write
a − b for a + (−b)
ab for a · b
a 1
for a ·
b b
1
a−1 sometimes for .
a
The associativity of addition and multiplication means that we can write
expressions like a + b + c and xyz, without needing to write brackets.
14
the left, getting smaller as we move left away from 0. Even in writing that
description, I have made assumptions about R: I have assumed that we have
notions of ‘positive’ and ‘negative’, and that we can compare the sizes of two
real numbers. This section is about formalising those assumptions.
Here are our axioms for the usual ordering on R.
There is a subset P of R such that for a, b ∈ R
The elements of P are called the positive numbers. The elements of P∪{0}
are called the non-negative numbers.
We write a < b, or b > a, exactly when b − a ∈ P.
We write a ⩽ b, or b ⩾ a, exactly when b − a ∈ P ∪ {0}.
Now, just as with the axioms for arithmetic, we can infer useful properties
from these axioms. First, some important properties of the ordering.
(i) a ⩽ a; (reflexivity)
15
(ii) Suppose that a ⩽ b and b ⩽ a.
In the next section, we’ll explore the interaction between the ordering
and basic arithmetic.
Proposition 4. Take a, b, c ∈ R.
(i) 0 < 1.
(ii) a < b if and only if −b < −a. In particular, a > 0 if and only if
−a < 0.
16
(iii) If a < b then a + c < b + c.
1
(vi) a > 0 if and only if a
> 0.
1 1
(vii) If a, b > 0 and a < b then < .
b a
Furthermore, (ii), (iii) and (iv) hold with ⩽ in place of <.
So 0 < 1.
a<b⇔b−a∈P
⇔ (−a) − (−b) ∈ P
⇔ −a > −b.
17
(v) Certainly a2 = 0 if and only if a = 0 (Proposition 1 (x) and (xiii)).
1
(vi) Suppose, for a contradiction, that a > 0 and a
< 0, so a > 0 and
− a1 > 0.
1 1
Then −1 = − a · =a· − > 0. But this contradicts (i).
a a
1
Similarly if a < 0 and a
> 0.
Then a1 , 1
b
> 0 by (vi),
1 1 1 1
so a · · < b · · by (iv),
a b a b
1
so b
< a1 .
18
Then
Remark. The modulus is well defined (that is, this is a legitimate definition)
thanks to the ‘positive, negative or 0’ property (essentially trichotomy).
(i) | − a| = |a|;
(ii) |a| ⩾ 0;
19
(iii) |a|2 = a2 ;
Proof.(i), (ii) Immediate from the definition, since a > 0 if and only if −a < 0.
(iii) Check using the definition and trichotomy – go through the cases and
also use (−a)(−a) = a2 .
20
Remark. (ii) is called the Reverse Triangle Inequality.
so |a + b| ⩾ |a| − |b|.
As you saw in the Complex Numbers course, the Triangle Inequality holds
in C, and so does the Reverse Triangle Inequality.
21
So far, we know that R is an ordered field. But we still haven’t captured
everything that’s important about R. The rational numbers Q also form
an ordered field, but there are fundamental differences between Q and R.
√
Intuitively, in Q there are ‘gaps’ in the number line (such as at 2), whereas
this is not the case in R. In the next chunk of the course, we’ll explore this
in detail, to try to identify what additional property or properties we need
to assume hold in R.
22
Example. I could have put various examples and non-examples here, but
instead I’ve put them in a short Moodle quiz for you to try. You’ll get
immediate feedback on your answers, to help you explore and check your
understanding of the definitions. Please go to the Moodle course page for
Analysis I, and try quiz 8.1, before you read on to the next section.
Remark. If S has a supremum, then sup S is unique. (Check you can show
this!)
Now that we have defined the supremum, we can state our final key
property of R (in addition to the properties that make it an ordered field).
23
Remark. There are two conditions on S here: non-empty, and bounded
above. They are both crucial!
It is easy to forget the non-empty condition, but it has to be there: the
empty set does not have a supremum, because every real number is an upper
bound for the empty set — there is no least upper bound.
The condition that S is bounded above is also necessary: a set with no
upper bound certainly has no supremum.
Let S = (1, 2]. Then we again have sup S = 2, and this time sup S ∈ S.
24
Remark. (ii) and a similar result with sup and inf swapped essentially tell
us that we can pass between sups and infs. Any result we prove about sup
will have an analogue for inf. Also, we could have phrased the Completeness
Axiom in terms of inf instead of sup. Proposition 8(ii) tells us that we don’t
need separate axioms for sup and inf.
Note that sup T is an upper bound for T and hence also for S, so
sup T ⩾ sup S (since sup S is the least upper bound for S).
so b ⩽ − sup S.
25
So − sup S is the greatest lower bound.
You might be wondering how all this relates to familiar notions of maxi-
mum and minimum so let’s explore that.
(i) M ∈ S; (M is an element of S)
(Check this!)
(i) m ∈ S; (m is an element of S)
Here is a key result about the supremum, which we’ll use a lot. It is a
quick consequence of the definition, but it will be useful to have formulated
it in this way.
26
Proposition 9 (Approximation Property). Let S ⊆ R be non-empty and
bounded above. For any ε > 0, there is sε ∈ S such that sup S − ε < sε ⩽
sup S.
11 Existence of roots
Now that we have identified the completeness property of R, we are ready to
prove that R contains a square root of 2.
Theorem 10. There exists a unique positive real number α such that α2 = 2.
27
Then α2 = 2 − ε for some ε > 0.
Idea: consider α + h for a small h > 0. Later on, we’ll choose h small
enough that (α + h)2 < 2, and that will be a contradiction because α + h ∈ S
and α + h > sup S.
Note that α ⩽ 2 (we said earlier that 2 is an upper bound for S).
For h ∈ (0, 1) we have
(α + h)2 = α2 + 2αh + h2
= 2 − ε + 2αh + h2
⩽ 2 − ε + 4h + h
⩽ 2 − ε + 5h
ε 1
so let h = min( 10 , 2 ) and then (α + h)2 < 2.
Now α + h ∈ S and α + h > sup S. This is a contradiction.
So it is not the case that α2 < 2.
Case 2 Suppose, for a contradiction, that α2 > 2.
Then α2 = 2 + ε for some ε > 0.
Idea: consider α − h for a small h > 0. Later on, we’ll choose h small
enough that (α − h)2 > 2, and that will lead to a contradiction because
α − h < sup S.
For h ∈ (0, 1) we have
(α − h)2 = α2 − 2αh + h2
= 2 + ε − 2αh + h2
⩾ 2 + ε − 4h
so choose h = min( 8ε , 12 , α2 ) and then (α − h)2 > 2 (and also α − h > 0).
Now α − h < sup S, so by the Approximation property there is s ∈ S
with α − h < s.
28
But then 2 < (α − h)2 < s2 < 2, which is a contradiction.
So it is not the case that α2 > 2.
Hence, by trichotomy, α2 = 2.
Uniqueness Suppose that β is also a positive real number such that β 2 = 2.
Aim: α = β.
Then 0 = α2 − β 2 = (α − β)(α + β)
and α + β > 0, so α = β.
Proposition 11. Q is not complete (with the ordering inherited from R).
Proof. If Q were complete, then the proof of Theorem 10 would work just as
well in Q. But we know that there is not an element of Q that squares to 2.
So Q is not complete.
Theorem 12. Let n be an integer with n ⩾ 2, and take a positive real number
r. Then r has a real nth root.
Proof. Exercise. (See Sheet 2 for the case of the cube root of 2.)
Proof. Idea: if there’s an upper bound then we can find a natural number
just less than it, and add 1.
Suppose, for a contradiction, that N is bounded above.
Then N is non-empty and bounded above, so by completeness (of R) N
has a supremum.
29
By the Approximation property with ε = 21 , there is a natural number
1
n ∈ N such that sup N − 2
< n ⩽ sup N.
Now n + 1 ∈ N and n + 1 > sup N. This is a contradiction.
1
Corollary 14. Let ε > 0. Then there is n ∈ N such that 0 < n
< ε.
1
Proof. If not, then ε
would be an upper bound for N. This would contradict
Theorem 13.
but n − m is an integer, so n − m ⩾ 1.
30
(ii) Similar.
(i) there is x ∈ Q such that a < x < b (the rationals are dense in the
reals); and
(ii) there is y ∈ R \ Q such that a < y < b (the irrationals are dense in the
reals).
13 Countability
The concept of countability gives us a way to distinguish between sets by
comparing their ‘sizes’. This will be a quick introduction. You can find
more information in the supplementary notes by Dr Hilary Priestley, on the
Moodle Analysis I course.
Our main tool for comparing the ‘sizes’ of two sets is to ask whether there
is a bijection between them. In this section and the next, we’ll often be using
the notions of bijection, injection and surjection. If you don’t feel confident
with the definitions of these, then I recommend you remind yourself of the
definitions before you continue with this section.
31
Definition. Let A be a set. We say that A is finite if A = ∅ or there exists
n ∈ N such that there is a bijection f : A → {1, 2, . . . , n}. We say that A is
infinite if it is not finite
Remark. There are variations on the details of these definitions, so it’s worth
checking carefully if you’re looking at a book or other source. For example,
some people say ‘countable’ where we are using ‘countably infinite’.
32
Proposition 18. Each of the following sets is countably infinite.
(i) N
(ii) N ∪ {0}
(iii) {2k − 1 : k ∈ N}
(iv) Z
(v) N × N.
Remark. It might feel surprising that the set of odd natural numbers ‘has
the same size as’ the set of all natural numbers!
Define f : Z → N by
2k
if k ⩾ 1
f (k) =
1 − 2k
if k ⩽ 0.
This is a bijection.
Claim f is a bijection.
Proof of claim
33
so, by uniqueness of prime factorisation in N, 2m1 −1 = 2m2 −1 and 2n1 −
1 = 2n2 − 1,
so m1 = m2 and n1 = n2 .
surjective: Take k ∈ N.
Then k = f (r + 1, s + 1).
14 More on countability
We can build new countable sets from old. This is a very helpful way to
prove that a set is countable!
(ii) A × B is countable.
Remark. In (i), we don’t need the condition that A and B are disjoint, but
it makes life easier for our proof.
34
Define h : A ∪ B → N by
2f (x) − 1
if x ∈ A
h(x) =
2g(x) if x ∈ B.
35
supplementary notes on decimal expansions and the uncountability of R (on
the Moodle Analysis I page).
Fact Every real number has a decimal expansion, and if we require that we
choose a non-terminating expansion (such as 0.24999 . . . for 14 ) rather than a
terminating one (such as 0.25 for 41 ) where there is a choice, then this decimal
expansion is unique.
Remark. The proof strategy we are going to use is called Cantor’s diagonal
argument.
36
where
5
if akk = 6
bk =
6 if akk ̸= 6.
Remark. The only significance of the choice of 5 and 6 as the key digits when
defining x was that we didn’t involve 0 or 9, to avoid issues with non-unique
decimal expansions.
There are many further interesting things to say about countability, but
not in this course. We need to move on to consider sequences. Before you
continue to the next section, try to come up with a collection of examples
of sequences that you can use as your personal repertoire for testing the
definitions and results we’ll look at. Try to find some ‘typical’ and some
‘extreme’ examples of sequences that you think converge, and of sequences
that you think don’t converge.
15 Introduction to sequences
Remark. You are already familiar with the sine and cosine, exponential and
logarithm functions, and with raising a number to a non-integer power. At
the moment, though, we haven’t formally defined these. We’ll do so later in
the course (using infinite series—that’s why it needs to wait till later), and
this term and later in other Analysis courses you’ll explore and prove the
familiar properties of these function.
37
All this means that at the moment our collection of functions we’ve de-
fined is rather small, and doesn’t give the richness we’d like when exploring
examples of sequences. So for now we’ll work with these familiar functions
(trig, exponential, log)—we’ll assume that they exist and have the properties
we expect. You can do this on the problems sheets too. When we come to
defining them later on, you can watch out to see that we don’t have any
circular arguments!
Notation. When we use logarithms, these will all be to the base e. We write
log x for loge (x). We don’t write ln x.
For a > 0 and x ∈ R, we define ax = ex log a . (Of course this relies
on definitions of the exponential and logarithm functions, which will come
later.)
38
Take ε > 0. Then, by the Archimedean property, there is N ⩾ 1 such
1 1 1
that 0 < N
< ε. Now for all n ⩾ N we have 0 < n
⩽ N
< ε. We
see that apart from finitely many terms at the start, the terms of the
sequence 1, 21 , 13 , 14 , 51 , . . . all lie within distance ε of 0. This is the case
for any positive real number ε.
We write (an ) for the sequence, and an for a term of the sequence.
Much of the theory relating to sequences applies to both real and com-
plex sequences. Sometimes, though, we’ll need to focus only on real
sequences—for example if we’re using inequalities. In this case we’ll
carefully specify that we’re working with real sequences. If we don’t
39
specify, and just say ‘sequences’, then it applies equally to real and com-
plex sequences. We’ll also have a section (and corresponding video) at
the end of this block concentrating on complex sequences.
Example. Let an = (−1)n . Then the first few terms of the sequence
are −1, 1, −1, 1, −1, 1, . . . .
Let an = sin n
2n+1
. Then the first few terms of the sequence are
1 1 1
sin 1, sin 2, sin 3, . . . .
3 5 7
Let
0
if n is prime
an =
1 + 1
otherwise.
n
Definition. We can make new sequences from old. Let (an ), (bn ) be se-
quences and let c be a constant. Then we can define new sequences ‘termwise’:
(an + bn ), (−an ), (an bn ), (can ), (|an |). If bn ̸= 0 for all n, then we can also
define a sequence ( abnn ).
16 Convergence of a sequence
Before we see a formal definition of convergence, let’s consider some examples
informally. Here’s one way I like to visualise a sequence. These are examples
from the previous section. Each graph plots the points (n, an ) for 1 ⩽ n ⩽ 10.
40
an = (−1)n
0
if n is prime
an =
1 + 1
otherwise
n
41
an = sin n
2n+1
an = n
42
Here is an unofficial picture of the definition of convergence.
43
I put ‘the’ limit in the definition. We’ll see later that if it exists then
it’s unique.
(i) If (an ) converges to a limit L, then every tail of (an ) also converges,
and to this same limit L.
Proof. (i) Take a tail of (an ): take k ⩾ 1 and let bn = an+k for n ⩾ 1.
Take ε > 0.
44
Take ε > 0.
Example. We’ll see later (soon!) that there are other ways to prove con-
vergence, not only directly from the definition. But for now we’ve only got
the definition (and the Tails Lemma), so let’s get some practice using what
we’ve got so far.
1
Claim. n
→ 0 as n → ∞.
For n ⩾ N we have | n1 − 0| = 1
n
⩽ 1
N
< ε.
1
So n
→ 0 as n → ∞.
45
1 √
that is, ε
< n.
Take N = ⌈ ε12 ⌉ + 1.
If n ⩾ N , then
1
n>
ε2
√ 1
so n >
ε
1
so √ < ε
n
so |an − 1| < ε.
So an → 1 as n → ∞.
n cos(n3 + 1)
Claim. Let an = for n ⩾ 1. Then an → 0 as n → ∞.
5n2 + 1
Take N = ⌈ 1ε ⌉ + 1.
46
1
If n ⩾ N , then n > 5ε
so
n cos(n3 + 1)
|an | = ⩽ 1 < ε.
5n2 + 1 5n
So an → 0 as n → ∞.
We don’t need the smallest possible N . It’s (almost always) not even
interesting to know what it is. So make your life easier! If an inequality
(in the right direction) helps, then go for it.
Be careful to make sure that the logic flows in the right direction, and
that you’ve set out the logic explicitly. Hopefully the examples we’ve
just seen help you to have ideas of how to do this.
47
Working directly from the definition is often painful or impractical. Our
next goal is to prove a result that will give a more convenient strategy for
proving convergence in some circumstances.
Proposition 24 (Sandwiching, first version). Let (an ) and (bn ) be real se-
quences with 0 ⩽ an ⩽ bn for all n ⩾ 1. If bn → 0 as n → ∞, then an → 0
as n → ∞.
Remark. You might like to draw yourself a diagram to develop your intuition
for what this result says.
Example.
1
Claim. 2n
→ 0 as n → ∞.
48
n cos(n3 + 1)
Claim. Let an = for n ⩾ 1 (we saw this example earlier).
5n2 + 1
Then an → 0 as n → ∞.
We have
n cos(n3 + 1)
0⩽
⩽ 1 ⩽ 1
2
5n + 1 5n n
for n ⩾ 1,
1
and n
→ 0 as n → ∞,
But (looking back at the definition) we see that |an | → 0 if and only if
an → 0.
Here are two key sequences; it will be useful later to have studied them.
(You can also think of them as further worked examples.)
n
(ii) Let an = 2n
for n ⩾ 1. Then an → 0 as n → ∞.
1
Proof. (i) Write |c| = 1+y
where y > 0.
Take ε > 0.
1
Let N = ⌈ yε ⌉ + 1. (When writing this proof, we might leave this line
blank and fill it in at the end!)
Take n ⩾ N .
49
By Bernoulli’s inequality (since y > 0 and n ⩾ 1) we have (1 + y)n ⩾
1 + ny, so
1 1 1
|cn | = ⩽ ⩽ < ε.
(1 + y)n 1 + ny Ny
So cn → 0 as n → ∞.
n
(ii) Note that if n ⩾ 2 then 2n = (1 + 1)n ⩾ 2
(by the binomial theorem).
Take ε > 0.
Let N = ⌈2 + 2ε ⌉.
For n ⩾ N , we have
n n 2 2
|an − 0| = ⩽ n
= ⩽ < ε.
2n 2
n − 1 N − 1
So an → 0 as n → ∞.
As promised earlier, let’s show that if a sequence converges, then its limit
is unique.
50
Suppose, for a contradiction, that L1 ̸= L2 .
|L1 − L2 |
Let ε = > 0.
2
Since an → L1 as n → ∞, there is N1 such that if n ⩾ N1 then |an −L1 | <
ε.
Also, since an → L2 as n → ∞, there is N2 such that if n ⩾ N2 then
|an − L2 | < ε.
For n ⩾ max{N1 , N2 } we have |an − L1 | < ε and |an − L2 | < ε, so
< 2ε = |L1 − L2 |.
This is a contradiction.
So L1 = L2 .
51
Proof. Say an → L as n → ∞.
Take ε > 0.
Then there is N such that if n ⩾ N then |an − L| < ε.
Now if n ⩾ N then, by the Reverse Triangle Inequality, we have
Remark. This includes the special case where an = 0 for all n: Propo-
sition 28 says that if bn ⩾ 0 for all n, and bn → M as n → ∞, then
M ⩾ 0. (This is because the constant sequence 0, 0, 0, . . . certainly
converges to 0.)
52
Proof. Suppose, for a contradiction, that it is not the case that L ⩽ M , so
(by trichotomy) L > M .
Let ε = 21 (L − M ) > 0.
Since an → L as n → ∞, there is N1 such that if n ⩾ N1 then |an −L| < ε.
Since bn → M as n → ∞, there is N2 such that if n ⩾ N2 then |bn − M | <
ε.
Now for n ⩾ max{N1 , N2 } we have an > L − ε and bn < M + ε,
so L − ε < an ⩽ bn < M + ε,
so L − M < 2ε = L − M . This is a contradiction.
53
19 Bounded and unbounded sequences
Definition. Let (an ) be a sequence. We say that (an ) is bounded if the set
{an : n ⩾ 1} is bounded, that is, there is M such that |an | ⩽ M for all n ⩾ 1.
If (an ) is not bounded then we say that it is unbounded.
Proof.
Assume that an → L as n → ∞.
Then (taking ε = 1) there is N such that if n ⩾ N then |an − L| < 1 so
54
Proof. Suppose, for a contradiction, that (−1)n → L as n → ∞.
This is a contradiction.
Definition. Let (an ) be a real sequence. We say that (an ) tends to infinity
as n → ∞ if
55
Remark. This is a separate definition from our earlier definition of conver-
gence, and ∞ is definitely not a real number. Results about convergence to
a real number L cannot just be applied by ‘taking L = ∞’—this would be
highly illegal!
Claim. an → ∞ as n → ∞.
Proof. Fix M > 0. (It suffices to prove the result for M > 0.)
but n2 − 6n = (n − 3)2 − 9
so (n − 3)2 ⩾ M + 9,
so n2 − 6n ⩾ M .
So an → ∞ as n → ∞.
0 if n prime
Let an =
n otherwise.
Then (an ) does not tend to infinity, because there are infinitely many
primes: for any N ∈ N, there is a prime n with n > N , and then
an = 0.
56
(ii) If α > 0, then nα → ∞ as n → ∞.
nα < ε
⇔ eα log n < ε
1
so we can take N = 1 + ⌈e α log ε ⌉.
nα > M
⇔ eα log n > M
1
so we can take N = 1 + ⌈e α log M ⌉.
(ii) If c = 1, then cn → 1 as n → ∞.
57
(ii) This is clear from the definition of convergence.
(iii) Exercise. (You could adapt the argument from (i), or use logarithms.)
20 Complex sequences
A lot of the theory we have just seen applies equally to complex sequences,
but there are some differences. Let’s spell out the definition of convergence
explicitly.
Given a complex sequence (zn ), there are two associated real sequences
(Re(zn )) and (Im(zn )). The next result relates convergence of (zn ) to con-
vergence of (Re(zn )) and (Im(zn )).
58
Proof. Exercise.
in
Example. Let zn = n
. Then |zn | = 1
n
→ 0 as n → ∞ so zn → 0 as
n → ∞.
The real parts are 1, 0, −2, −4, −4, 0, 8, 16, . . . —this sequence doesn’t
converge, and hence neither does (zn ).
21 Subsequences
We can make a good informal guess as to what we mean by a subsequence.
Let (an )n⩾1 be a sequence. Then a subsequence is a sequence (br )r⩾1 ,
where each br is in (an ), and the terms are in the right order.
59
Definition. Let (an )n⩾1 be a sequence. A subsequence (br )r⩾1 of (an )n⩾1 is
defined by a function f : N → N such that f is strictly increasing (if p < q
then f (p) < f (q)), and br = af (r) for r ⩾ 1.
We often write f (r) as nr . Then n1 < n2 < n3 < · · · is a strictly
increasing sequence of natural numbers, and br = anr so the sequence (br )
has terms an1 , an2 , an3 , . . . .
60
Let (anr ) be a subsequence of (an ).
Take ε > 0.
Since an → L, there is N such that if n ⩾ N then |an − L| < ε.
If r ⩾ N , then nr ⩾ r ⩾ N (see remark before this result),
so |anr − L| < ε.
So anr → L as r → ∞.
0
if n is prime
Example. Let an = .
1 + 1
otherwise
n
61
7n5 − n sin(n2 + 5n) + 3
Let an = .
4n5 − 3n2 + n + 2
What can we say about (an )?
Intuitively...
- the numerator grows like 7n5 — the other terms are much smaller for
large n, which is all we care about;
7
so we might conjecture that an → 4
as n → ∞.
To prove this (and lots more!), we’ll prove a bunch of results that are
extremely useful in practice. Collectively, these are known as the ‘Algebra of
Limits’, and we’ll quote “by AOL” in arguments.
Theorem 35 (Algebra of Limits, part 1). Let (an ) and (bn ) be sequences
with an → L and bn → M as n → ∞. Let c be a constant.
62
(ii) If c = 0, then we’re done by (i). So assume that c ̸= 0.
Take ε > 0.
OR...
Take ε > 0.
ε
Since an → L, there is N such that if n ⩾ N then |an − L| < |c|
.
< 2ε.
So (an + bn ) converges to L + M .
63
Remark. In (iii), I ended up showing that we can make |(an +bn )−(L+M )|
less than 2ε by going far enough along the sequence. But the definition says
ε, not 2ε, so isn’t this a problem?
Well, no, it’s not a problem. We need to show that we can make |(an +
bn ) − (L + M )| less than any positive real number — and that’s what we’ve
done. The important thing is that 2 was a (positive) constant: it didn’t
depend on n.
ε
We could instead have chosen N1 and N2 corresponding to 2
(so if n ⩾ N1
ε
then |an − L| < 2
and similarly for bn ), and then we’d have got ε at the end.
But if I’d done that then it might have seemed more mysterious: you might
have wondered “how would I have known to choose 2ε ?”
In practice, sometimes I doodle on scrap paper and consequently know
what to choose at the start, and sometimes I just work through and see
what happens, and if I get 2ε or 1000ε at the end then it doesn’t matter. I
illustrated these two alternative approaches in (ii) — but really they’re the
same, and both are fine.
Example.
n cos(n3 + 1)
1 n 1
Claim. Let an = n + 1 + (−1) √ + . Then an → 1 as
2 n 5n2 + 1
n → ∞.
1 1
Proof. We showed earlier that n
→ 0 and 1 + (−1)n √ → 1 and also
2 n
n cos(n3 + 1)
→ 0 as n → ∞ (see Section 16).
5n2 + 1
So, by AOL, (an ) converges, and an → 0 + 1 + 0 = 1 as n → ∞.
Example.
n
Claim. Let an = (−1)n + 2n
for n ⩾ 1. Then (an ) does not converge.
64
Proof. Suppose, for a contradiction, that (an ) converges.
Note that 2nn converges (this was an earlier example).
n
So, by AOL, the sequence with nth term (−1)n = an − 2n
converges.
But we showed earlier that ((−1)n ) does not converge (or we could now
note that it has subsequences tending to different limits 1 and −1). This is
a contradiction.
as n → ∞.
an an L
(viii) (quotient) If M ̸= 0, then the sequence bn
converges, and bn
→ M
as n → ∞.
1 an
Remark. You might wonder whether the sequences bn
and bn
in (vii)
and (viii) are defined. This is a good question. The answer is that — as we’ll
show in the proof — if M ̸= 0 then a tail of (bn ) has all its terms nonzero,
and hence there’s a tail of b1n that exists, and similarly for abnn . When
we talk about convergence of these sequences, it’s enough to consider a tail.
65
— this use of the triangle inequality can help us to see how to proceed.
Let N = max{N1 , N2 }.
If n ⩾ N , then |an − L| < ε and |bn − M | < ε and |an | < |L| + ε, so
< (|L| + ε) · ε + |M | · ε
|M |
|bn | ⩾ ||bn + (M − bn )| − |M − bn || > > 0.
2
So the tail (bn )n⩾N1 has all terms nonzero, so we can consider the se-
quence b1n .
n⩾N1
66
Let N = max{N1 , N2 }. If n ⩾ N , then
− 1 = |M − bn | < ε · 2 .
1
bn M |M ||bn | |M | |M |
Since |M2|2 is a positive constant, this shows that b1n converges,
n⩾N1
1
and the limit is M
.
Proof. Idea: the important terms (for large n) are 7n5 and 4n5 .
We have
1 3
7− n4
sin(n2 + 5n) + n5
an = .
4 − n33 + n14 + n25
Now
1 2
1 1
0 ⩽ 4 sin(n + 5n) ⩽ 4 ⩽
n n n
1 1
and n
→ 0, so by Sandwiching n4
sin(n2 + 5n) → 0, and several other terms
also tend to 0 (eg by Sandwiching),
so, by AOL, (an ) converges, and
7−0+0 7
an → =
4−0+0+0 4
as n → ∞.
67
24 Orders of magnitude
When we’re studying a sequence (an ), it can be really useful to develop some
intuition about the behaviour of an for large n, in order to make a conjecture
about the convergence (or otherwise) of the sequence, and to select a proof
strategy. (This is what we did in the example at the end of the last section,
for example.)
8n2 + 1000000n + 1000000
Example. Let an = .
14n6 + n3 + n
Intuitively, the key term in the numerator is 8n2 , and the key term in
the denominator is 14n6 . Even with the amusingly large coefficients in
the numerator, when n is large these terms will be much smaller than
8n2 .
8
So it feels like the sequence grows roughly like 14n4
, so should tend to
0.
We can formalise this using AOL. Dividing through top and bottom by
n6 (since this is the key term), we get
8
n4
+ 1000000
n5
+ 1000000
n6 0+0+0
an = 1 1 → =0
14 + n3 + n5
14 + 0 + 0
as n → ∞.
68
We’ll show in the next section that log n
n
→ 0 as n → ∞. Intuitively,
polynomials grow faster than logarithms.
Big O and little o notation give us precise ways to make precise state-
ments about comparative rates of growth of sequences. Please use them
precisely!
Example. This example is in a Moodle quiz. Before you read on to the next
section, please go to the Moodle course page for Analysis I, and try the quiz
for section 24 (it’s a short multiple choice quiz).
25 Monotonic sequences
Definition. Let (an ) be a real sequence.
69
We say that (an ) is strictly decreasing if an > an+1 for all n.
The result applies to tails of sequences too: if (an ) has a tail that is
monotone and bounded, then it converges.
70
Idea: {an : n ⩾ 1} has a supremum, and (an ) converges to this.
Take ε > 0.
(ii) If (an ) is decreasing and bounded below, then (−an ) is increasing and
bounded above, so (ii) follows from (i).
Lemma 39. Let (an ) be a real sequence that is increasing and not bounded
above. Then an → ∞ as n → ∞.
Proof. Take M ∈ R.
Since (an ) is not bounded above, there is N such that aN > M .
Then, since (an ) is increasing, if n ⩾ N then an ⩾ aN > M .
71
n
1
Example. Let an = 1 + .
n
On Sheet 1, you proved that (an ) is increasing and that (an ) is bounded
above (by 3). So, by the Monotone Sequences Theorem, (an ) converges. Say
an → L as n → ∞. Then, since limits preserve weak inequalities, we see that
2 ⩽ L ⩽ 3.
(Secretly, we know more about L, but that’s strictly unofficial for now.)
√
Example. Let c ⩾ 0. In this example, we’ll show that c exists. (This
√
generalises earlier work on 2, and usesa different strategy.)
1 c
Define (an ) by a1 = 1 and an+1 = an + for n ⩾ 1.
2 an
This is a legitimate definition, since (by induction) an ̸= 0 for n ⩾ 1.
study a2n − c:
for n ⩾ 1, we have
2
1 c
a2n+1 −c= an + −c
4 an
c2
1 2
= an + 2c + 2 − c
4 an
c2
1 2
= an − 2c + 2
4 an
2
1 c
= an −
4 an
⩾ 0,
so a2n+1 ⩾ c for n ⩾ 1.
72
(an )n⩾2 decreasing:
for n ⩾ 2, we have
1 c 1 c 1
an+1 − an = an + − an = − an = (c − a2n ) ⩽ 0,
2 an 2 an 2an
so an+1 ⩽ an for n ⩾ 2.
So, by the Monotone Sequences Theorem, (an ) converges.
Say an → L as n → ∞.
Then also an+1 → L as n → ∞ (it’s a tail of the sequence).
But if L ̸= 0 then
1 c 1 c
an+1 = an + → L+
2 an 2 L
by AOL.
1 c
Since limits are unique, we have L = 2
L+ L
,
so, rearranging, L2 = c.
Also, we have an > 0 for all n, and limits preserve weak inequalities, so
L ⩾ 0.
√ √
So c exists (L = c).
In the case that L = 0, since limits preserve weak inequalities and a2n ⩾ c
for n ⩾ 2 we have c ⩽ 0, so c = 0 and L2 = c.
log n
Lemma 40. We have n
→ 0 as n → ∞.
log n
Proof. Let an = n
.
Then an ⩾ 0 for all n, so (an ) is bounded below.
Also, by properties of log we see that (an )n⩾100 is decreasing.
log n
So, by the Monotone Sequences Theorem, (an ) converges. Say n
→L
as n → ∞.
Since limits preserve weak inequalities, we have L ⩾ 0.
73
Now
log(2n) log 2 + log n L
a2n = = →0+
2n 2n 2
by AOL,
but also (a2n ) is a subsequence of (an ) so a2n → L as n → ∞.
L
So, by uniqueness of limits, 2
= L, so L = 0.
26 Convergent subsequences
Theorem 41 (Scenic Viewpoints Theorem). Let (an ) be a real sequence.
Then (an ) has a monotone subsequence.
74
Let m1 = N . Then m1 ̸∈ V so there is m2 > m1 with am2 ⩾ am1 .
Also, m2 ̸∈ V so there is m3 > m2 with am3 ⩾ am2 .
Continuing inductively, we construct m1 < m2 < m3 < · · · such that
am1 ⩽ am2 ⩽ am3 ⩽ · · · .
Then (amr )r is an increasing subsequence of (an ).
Proof. Study real and imaginary parts, and repeatedly pass to subsequences
Write zn = xn + iyn where xn , yn ∈ R.
Say (zn ) is bounded by M , so |zn | ⩽ M for all n.
Then (xn ) and (yn ) are also bounded by M , and they are real sequences.
By Bolzano-Weierstrass, (xn ) has a convergent subsequence, say (xnr )r .
75
Now (ynr )r is a bounded real sequence, so by Bolzano-Weierstrass it has
a convergent subsequence, say (ynrs )s .
Note that (xnrs )s is a subsequence of the convergent sequence (xnr )r and
hence converges.
So, by Theorem 33, (znrs )s converges (since its real and imaginary parts
converge).
27 Cauchy sequences
Example. Let (an ) be a convergent sequence.
Then an+1 − an → 0 as n → ∞.
We can prove this directly from the definition (with the triangle inequal-
ity), or using tails and the Algebra of Limits.
But it is not the case that if an+1 −an → 0 as n → ∞ then (an ) converges.
√
For example, consider an = n. Certainly (an ) does not converge. But
√ √ (n + 1) − n 1
an+1 − an = n+1− n= √ √ =√ √ →0
n+1+ n n+1+ n
as n → ∞.
Nonetheless, intuitively it seems that if eventually all the terms of a se-
quence are bunched up close together then the sequence might converge.
Remark. Note that this definition makes sense for complex sequences as
well as for real sequences.
76
Proof. Say an → L as n → ∞.
Take ε > 0.
|am − an | = |(am − L) + (L − an )|
So (an ) is Cauchy.
Proof. Idea: use a similar strategy to Proposition 30, where we showed that
a convergent sequence is bounded.
Since (an ) is Cauchy, there is (applying the definition with ε = 1) N such
that if m, n ⩾ N then |am − an | < 1.
Now for n ⩾ N we have |an − aN | < 1,
so |an | = |(an − aN ) + aN | ⩽ 1 + |aN |.
Let K = max{|a1 |, |a2 |, . . . , |aN −1 |, 1 + |aN |}.
Then |an | ⩽ K for all n ⩾ 1.
So (an ) is bounded.
77
Proposition 46. Let (an ) be a Cauchy sequence. Suppose that the subse-
quence (anr )r converges. Then (an ) converges.
Proof. Idea: eventually all the terms of (anr ) are really close to the limit L,
and eventually all the terms of (an ) are really close to terms in the subse-
quence and hence also really close to L.
Say that anr → L as r → ∞.
Take ε > 0.
Then there is N1 such that if r ⩾ N1 then |anr − L| < 2ε .
Also, since (an ) is Cauchy there is N2 such that if m, n ⩾ N2 then |am −
an | < 2ε .
Let N = max{N1 , N2 }.
ε
Let r = N . Then nr ⩾ r ⩾ N1 so |anr − L| < 2
So an → L as n → ∞.
78
Then, by Proposition 46, (an ) converges.
Remark. One reason this is so useful is that it gives us a way to show that
a sequence converges without needing to know in advance what the limit is.
79
Remark. So convergence of series is really a special case of convergence
of sequences, rather than a new concept.
A series is a limit.
X ∞
X
We might sometimes write
P
ak or even ak instead of ak .
k⩾1 k=1
n
X
It would be highly illegal to write something like an — we need to
n=1
use different letters for quantities that can be different. That’s why
I’ve put k as the dummy variable in the sums, because it isn’t n (and
is still a good letter for a natural number).
∞
1 X 1
If |z| < 1, then sn → as n → ∞, so z n exists and equals .
1−z n=0
1−z
If |z| ⩾ 1, then (sn ) does not converge and so the series diverges. (One way
to see that (sn ) does not converge is to note that if |z| ⩾ 1 then sn − sn−1 =
an = z n does not tend to 0 as n → ∞.)
Remark. Notice how we worked with partial sums, and determined that the
P n
limit exists before writing down z .
1
Example. A telescoping series. Let ak = for k ⩾ 1.
k(k + 1)
80
n
X 1
Let sn = .
k=1
k(k + 1)
Then
n
X 1 1
sn = −
k=1
k k+1
1 1 1 1 1 1 1
= 1− + − + − + ··· + −
2 2 3 3 4 n n+1
1
=1− → 1 as n → ∞
n+1
∞
X 1
so exists and equals 1.
k=1
k(k + 1)
Remark. Notice how we worked with partial sums, and determined that the
P 1
limit exists before writing down k(k+1)
.
n
X
k
Example. Let ak = (−1) , let sn = (−1)k .
k=1
Then
−1
if n odd
sn =
0
if n even.
∞
X
So (sn ) does not converge, that is, (−1)k diverges.
k=1
Remark. Notice how we worked with partial sums, not the series, and in
fact the limit doesn’t exist. We definitely didn’t write anything dodgy like
∞
X
(−1)k = (−1 + 1) + (−1 + 1) + · · · = 0,
k=1
81
29 Series: first results and a first test for con-
vergence
∞
X ∞
X
Proposition 48. Consider the series ak . If ak converges, then ak →
k=1 k=1
0 as k → ∞.
Proof. Idea
82
Show that (sn ) is not Cauchy.
Consider |s2n+1 − s2n |. We have
n+1
2X
1 1 1
|s2n+1 − s2n | = ⩾ 2n · n+1 = .
k=2n +1
k 2 2
Proposition 49. Let (ak ) be a sequence of non-negative real numbers, and let
n
X X∞
sn = ak . Suppose that (sn ) is bounded. Then the series ak converges.
k=1 k=1
Theorem 50 (Comparison Test). Let (ak ) and (bk ) be real sequences. As-
∞
X X∞
sume that 0 ⩽ ak ⩽ bk for all k ⩾ 1, and that bk converges. Then ak
k=1 k=1
converges.
n
X
Proof. Let sn = ak .
k=1
Then (sn ) is increasing, since ak ⩾ 0 for all k ⩾ 1.
83
Also,
n
X n
X ∞
X
sn = ak ⩽ bk ⩽ bk
k=1 k=1 k=1
The Comparison Test can also be used to show that a series diverges.
∞
X ∞
X
If 0 ⩽ ak ⩽ bk for all k and ak diverges, then bk diverges.
k=1 k=1
Please check the conditions of the Comparison Test very carefully be-
∞
X
fore applying it. Please do not do this by writing things like ak ⩽
k=1
∞
X P
bk . We can’t write down ak (which is, remember, a limit) until
k=1
we know that the limit exists. So either check the precise conditions of
the Comparison Test, or work with partial sums as in Proposition 49.
Example.
∞
X 1
Claim. converges.
k=1
k2
84
Proof. For k ⩾ 2, we have
1 1
0⩽ 2
⩽ ,
k k(k − 1)
∞
X 1
and converges (we saw this previously),
k=2
k(k − 1)
∞
X 1
so by the Comparison Test we have that 2
converges.
k=1
k
∞
X 1
Remark. Note that this tells us nothing about the value of 2
! That is
k=1
k
an interesting, but more challenging, problem for another time (not in this
P 1
course). But we can still use k2
in future applications of the Comparison
Test, even without knowing the value.
∞
X 1
Example. The series converges. (As usual, we define 0! = 1.) This
k=0
k!
is an exercise on Sheet 5.
∞
X 1
We can then define e = .
k=0
k!
85
Theorem 51 (Cauchy Convergence Criterion for series). Let (ak ) be a se-
n
X ∞
X
quence, and write sn = ak . Then ak converges if and only if
k=1 k=1
n
X
∀ε > 0 ∃N ∈ N such that ∀n > m ⩾ N |sn − sm | = ak < ε.
k=m+1
So far, we have mostly considered series where all the terms are non-
negative real numbers. We are interested in other series too, though. When
a series can have negative terms (or even non-real), it might be that they
enable enough cancellation that a series converges, or it might be that the
P
convergence is so robust that even |ak | converges. That’s what the next
definition and result are about.
∞
X
Definition. Let (ak ) be a sequence. We say that ak converges absolutely
k=1
∞
X
if |ak | converges.
k=1
The series
P
|ak | is a series where all the terms are (real and) non-
negative. Such series are particularly nice!
86
So we are assuming that (Sn ) converges, and want to deduce that (sn )
converges.
For n > m, we have
n n
X X
|sn − sm | = ak ⩽ |ak | = |Sn − Sm |.
k=m+1 k=m+1
P
Now |ak | converges by assumption,
so (Sn ) is Cauchy by the Cauchy Convergence Criterion,
so (sn ) is Cauchy by the inequality above,
P
so ak converges by the Cauchy Convergence Criterion.
sin3 (k 2 )
Example. Let ak = (−1)3k .
k2 + 1
Then 0 ⩽ |ak | ⩽ k12 for k ⩾ 1,
P 1
and k2
converges,
P
so by the Comparison Test |ak | converges,
P
so ak converges since absolute convergence implies convergence.
∞
X
Lemma 53. Take p ∈ R. Then k −p diverges for p ⩽ 1, and converges if
k=1
p > 1.
87
P 1
P (−1)n
Example. We know that n
diverges, and so n
does not converge
absolutely. But does it converge? The next result will give us a way to show
that it does.
uk ⩾ 0 for k ⩾ 1; and
uk → 0 as k → ∞,
∞
X
then (−1)k−1 uk converges.
k=1
Proof. Idea: consider partial sums, get subsequences that are monotone and
bounded.
n
X
Let sn = (−1)k−1 uk .
k=1
88
Example.
∞
X (−1)n
Claim. converges.
n=1
n
1
and n
→ 0 as n → ∞.
∞
X 1
Hence, by the Alternating Series Test, (−1)n−1 converges,
n=1
n
∞
X (−1) n
and so (by AOL) converges.
n=1
n
Example.
∞
X (−1)n
Claim. √ converges.
n=1
n
Proof. Exercise.
P (−1)n
Remark. This remark is not part of the course. A series such as n
that
converges but does not converge absolutely is said to converge conditionally.
Such series are delicate, when compared to more robust series that converge
absolutely!
89
For sufficiently large k, we have
ak 4k 2 (k 2 + k + 1)
1 =
4k2
4k 4 − k 2 − 1
4k 4 + 4k 3 + 4k 2
=
4k 4 − k 2 − 1
1 + k1 + k12
= → 1 as k → ∞,
1 − 4k12 − 4k14
so there is K such that if k ⩾ K then
ak 3
0⩽ 1 ⩽
4k2
2
so
3 1
0 ⩽ ak ⩽ · .
2 4k 2
X 3
Now converges,
k
8k 2
P
so, by the Comparison Test, k ak converges.
(It doesn’t matter that we have the inequalities only for large enough k
— the first finitely many terms don’t affect convergence.)
Remark. Some people like to summarise this strategy in the following result.
Theorem 55 (Limit form of Comparison Test). Let (ak ), (bk ) be real se-
ak
quences of positive terms, and assume that there is L > 0 such that bk
→L
P P
as k → ∞. Then ak converges if and only if bk converges.
90
Remark. It was important that, at least for sufficiently large k, the terms
ak
ak and bk are positive, and it was important that bk
converges to a positive
real number.
k2 + k + 1
Example. Let ak = .
4k 4 − k 2 − 1
Then (as before)
ak
1 → 1 as k → ∞,
4k2
32 Ratio Test
Our next test for convergence is really useful. It sometimes gives a self-
contained way to decide whether a series converges, rather than having to
have an idea already (as is necessary for the Comparison Test, for example).
The idea of the next test is essentially comparison with a geometric series.
Let’s do an example before we state the general result.
∞
k X k
Example. Let ak = k and consider .
2 k=1
2k
P 1
We can’t directly compare with 2k
.
1
Idea: the terms ak decrease nearly like 2k
.
91
More precisely,
ak+1 k+1 k
= k+1 / k
ak 2 2
k + 1 2k
= k+1 ·
2 k
k+1 1
= ·
k 2
1 1 1
= 1+ · → as k → ∞,
k 2 2
where we used AOL at the end.
ak+1 1 1 ak+1 3
So there is K such that if k ⩾ K then − < , so < .
ak 2 4 ak 4
3 k−K
Then for k ⩾ K we have 0 < ak ⩽ 4 aK
∞ k−K
X 3
and aK converges (geometric series with common ratio 34 ,
4
3 k=K
and 4 < 1)
P
so, by the Comparison Test, ak converges.
ak+1
If ak
does not tend to a limit as k → ∞, then the Ratio Test tells us
nothing.
92
ak+1
Since → L, there is N such that if k ⩾ N then ak+1 − L < ε,
ak ak
ak+1
so ak
< L + ε = α.
Case 1 L ∈ R.
1+L
Let α = 2
, so 1 < α < L. Let ε = L − α > 0.
ak+1
ak+1
Since → L, there is N such that if k ⩾ N then ak − L < ε,
ak
ak+1
so ak
> L − ε = α.
Case 2 L = ∞.
Let α = 2.
ak+1 ak+1
Since → ∞, there is N such that if k ⩾ N then an
> α.
ak
Then finish as in Case 1.
k
Example. Let ak = (we did this before!).
2k
Then ak > 0 for all k, and
k + 1 2k
ak+1 1 1 1
= k+1 · = 1+ · → < 1 as k → ∞,
ak 2 k k 2 2
93
by AOL.
P
So, by the Ratio Test, ak converges.
Example. Let ak = k1 .
Then ak > 0 for all k, and
ak+1 k
= → 1 as k → ∞,
ak k+1
so the Ratio Test tells us nothing.
ak+1
Notice how we really had to consider the limit. We have ak
< 1 for
all k, but that’s not enough to determine convergence — remember that we
already know that this series diverges.
Example. Let
1k
if k = 2m for some m ⩾ 1
2
ak =
0
otherwise.
As it stands, we can’t apply the Ratio Test, because the terms aren’t all
positive.
But we can omit the zero terms (which do not affect the convergence of
1 X
the series): let bm = 2m for m ⩾ 1, and consider bm .
2 m
Now bm > 0 for all m, and
m
bm+1 22 1
= 2m+1 = 2m → 0 < 1 as m → ∞,
bm 2 2
P P
so by the Ratio Test bm converges and hence ak converges.
Remark. The Ratio Test is brilliant, but please make sure you apply
it carefully. Check the conditions!
ak+1
It’s not always the case that ak
converges, so that’s why we stated it
as a condition in the Ratio Test. Try to avoid assuming that the limit
exists.
94
We proved the Ratio Test by comparing with a geometric series. So
we shouldn’t use the Ratio Test to decide whether a geometric series
converges!
We can adapt the Ratio Test to study absolute convergence of series even
when the terms are not all real and positive.
(ii) If L > 1, then the proof of the Ratio Test as applied to (|ak |) shows
P
that |ak | ̸→ 0, so ak ̸→ 0, and so ak diverges.
Remark. We’ll see later in the course that the Ratio Test (especially in this
form) is extremely helpful for studying power series.
33 Integral Test
In this section, we’ll study certain series by considering corresponding inte-
grals. This is a bit surprising, since we currently don’t know what integration
is. But it’s nice to see the link to convergence of series now, so we’ll pretend
95
that we know what integration is, and that we know some basic facts about
integration. In Analysis III, you’ll fill in the details of this — you might like
to revisit this section/video after studying Analysis III.
Some (for now unofficial) facts we’ll assume:
Suitably nice functions are integrable (in this section we’ll consider only
suitably nice functions).
R k+1
We can integrate constants: if c ∈ R then k
c dx = c.
Remark. The main part of the Integral Test is (ii), and (i) is mostly
interesting for helping us to prove (ii), but (as we’ll see) (i) is also useful
in its own right.
96
R k+1
If f is continuous then k
f (x)dx exists for each k ⩾ 1.
Proof. (i) Idea: show that (σn ) is bounded below and decreasing.
f (k + 1) ⩽ f (x) ⩽ f (k),
and so
Z k+1 Z k+1 Z k+1
f (k + 1) = f (k + 1)dx ⩽ f (x)dx ⩽ f (k)dx = f (k).
k k k
Now
Z 2
f (2) ⩽ f (x)dx ⩽ f (1)
1
Z 3
and f (3) ⩽ f (x)dx ⩽ f (2)
2
..
and .
Z n
and f (n) ⩽ f (x)dx ⩽ f (n − 1).
n−1
sn − f (1) ⩽ In ⩽ sn − f (n)
97
so
0 ⩽ f (n) ⩽ sn − In ⩽ f (1)
so
Also,
as above.
Say σn → σ as n → ∞.
Then, since limits preserve weak inequalities, and 0 ⩽ σn ⩽ f (1) for all
n ⩾ 1, we have 0 ⩽ σ ⩽ f (1).
98
Now for p ̸= 1 we have
Z n
In = x−p dx
1 n
1 1−p
= x
1−p 1
1
= (n1−p − 1),
1−p
Remark. The Integral Test handles p ⩾ 0, but not p < 0 because in this
case the function is not decreasing. Fortunately we can handle p < 0 directly,
because in this case k −p ̸→ 0 and so
P −p
k diverges.
Example.
X 1
Claim. diverges.
k⩾2
k log k
Remark. This series can be useful for counterexamples, because it feels like
it ‘only just’ diverges.
99
34 Euler’s constant and rearranging series
X1
Example. We know that the harmonic series diverges. But the Inte-
k
k
gral Test can give us additional information.
Let γn = 1 + 12 + 13 + · · · + 1
n
− log n.
Define f : [1, ∞) → R by f (x) = x1 .
Then f is non-negative, decreasing and continuous, and
n Z n
X 1 1
γn = − dx,
k=1
k 1 x
= log 2 + γ2n − γn
→ log 2 as n → ∞,
100
1
and s2n+1 = s2n + 2n+1
→ log 2 as n → ∞,
so (by a result on a problems sheet) (sn ) converges to log 2, that is,
∞
X (−1)k−1
= log 2.
k=1
k
Remark. The order in which we sum the terms in this series really matters.
It turns out that if we regroup to have the same terms but in another
order, with three positive terms followed by one negative, so
1 1 1 1 1 1 1
1+ + − + + + − + ···
3 5 2 7 9 11 4
then we instead get log 2 + 12 log 3 (exercise: show this!). There’s yet another
version of the series, with yet another value, on Sheet 7.
As we have seen, a series that converges but not absolutely (that is,
a series that converges conditionally) is less robust. A rearrangement
might give a series that converges to a different value, or even that does
not converge at all.
Remark. In this course we’ve seen several tests for convergence of a series:
101
the Integral Test.
35 Power series
∞
X
Definition. A real power series is a series of the form ck xk , where ck ∈ R
k=0
for all k ⩾ 0 and x is a real variable.
∞
X
A complex power series is a series of the form ck z k , where ck ∈ C for
k=0
all k ⩾ 0 and z is a complex variable.
102
∞
X zk
Example. Consider . We use the Ratio Test: for z ̸= 0, we have
k=0
k!
k+1
z k
z k! |z|
(k + 1)! / k! = (k + 1)! |z| = k + 1 → 0 as k → ∞
and 0 < 1, so by the Ratio Test the series converges absolutely, and hence
converges, for all z ∈ C.
Example. Consider
∞ ∞ ∞ ∞
X
k z 2k X
k z
2k+1 X z 2k+1 X z 2k
(−1) and (−1) and and .
k=0
(2k)! k=0
(2k + 1)! k=0
(2k + 1)! k=0
(2k)!
Each of these converges for all z ∈ C. (Exercise: use the Ratio Test to
prove this for z ̸= 0.)
103
Remark. We can go on to define other trig functions such as tan, cosec,
sec and cot using these, on suitable domains. We wouldn’t expect these
further functions to have power series that converge on the whole of C.
We have defined sin and cos by power series, not by right-angled trian-
gles.
Remark. We previously proved (as part of AOL) that if (sn ) and (tn ) are
convergent sequences, with sn → L and tn → M , then (sn +tn ) also converges,
and sn + tn → L + M .
We can apply this to sequences of partial sums, which gives us a way to
consider the sum of two series.
P P
To put that more explicitly, let ak and bk be convergent series, and
write
n
X n
X
sn = ak and tn = bk .
k=1 k=1
∞
X
Then (sn ) and (tn ) converge. Say sn → s and tn → t (that is, ak = s and
k=1
∞
X
bk = t). Then
k=1
n
X n
X n
X
sn + t n = ak + bk = (ak + bk ),
k=1 k=1 k=1
∞
X
so by AOL (sn + tn ) converges, and (ak + bk ) = s + t.
k=1
So we can sum two convergent series, and we can also use AOL to show
that we can multiply a series by a (real or complex) number.
104
Remark. The above remark gives a useful way to show that a series diverges.
P P P
If ak converges and bk diverges, then (ak +bk ) diverges too. That’s
P P
because if (ak + bk ) converges, then also ((ak + bk ) − ak ) converges, by
the remark above.
P P
Exercise: show, through suitable examples, that if ak and bk both
P
diverge, then it might be that (ak + bk ) converges and it might be that it
diverges.
Example. From the power series definitions earlier, and this remark about
AOL applied to series, we can see that for z ∈ C we have
1
cos z = (eiz + e−iz )
2
1
and sin z = (eiz − e−iz )
2i
1 z
and cosh z = (e + e−z )
2
1 z
and sinh z = (e − e−z )
2
and eiz = cos z + i sin z.
We can also see from the power series definitions that for z ∈ C we have
cos(iz) = cosh z, and other similar relationships between cos and cosh, and
between sin and sinh. (Exercise: think about all of these!)
36 Radius of convergence
In this section, it will be more natural to study power series in C. The
main goal will be to determine the subset of C on which a given power series
converges. As we’ll see, this subset must have a rather specific form. You
might already have ideas about this, having tackled Sheet 6 Q4.
We expect that a power series will be more likely to converge for small
|z| than for large |z|. In principle, the subset of C on which a given power
105
ck z k converges might be a blob of convergence, or an ink splat of
P
series
convergence, or an even more complicated region.
It turns out, though, that in fact the relevant shape is not a blob or an
ink splat, but a disc. There are some details to be addressed, but that is the
secret reason for the following definition — we’ll go into the details after the
definition.
106
ck z k be a power series with
P
Proposition 59 (Radius of convergence). Let
radius of convergence R.
ck z k diverges.
P
(ii) If |z| > R, then
ck z k
P
Since absolute convergence implies convergence, this shows that
converges.
Case 2: R = ∞.
ck z k converges.
P
Suppose, for a contradiction, that
107
|ck ρk | converges.
P
Find ρ with ρ > R such that
Then
ρ k ρ k
0 ⩽ |ck ρk | ⩽ |ck z k | ⩽ M
z z
P ρ k ρ
and z
converges (geometric series with common ratio , and
z
ρ
< 1),
z
|ck ρk | converges,
P
so, by the Comparison Test,
Anything at all can happen on the circle {z ∈ C : |z| = R}! The series
might converge everywhere on the circle, or diverge everywhere on the
circle, or converge at some points and diverge at others.
You might like to revisit Sheet 6 Q4 briefly having seen the theory, to
see the connections.
Example. We have already seen that the exponential, sine and cosine,
hyperbolic sine and hyperbolic cosine series have radius of convergence
∞ (using the Ratio Test).
108
The geometric series z k has R = 1 (from an example in Section 28).
P
∞
X k! k
Example. Consider k
x .
k=0
k
For x ̸= 0, we have
k
(k + 1)! k+1 k k kk
k! k
(k + 1)k+1 x
· = |x| = |x|
k!xk (k + 1)k k! k+1
−k
1 1
= 1+ |x| → |x| as k → ∞,
k e
P k! k
so by the Ratio Test the series k x converges for |x| < e (so R ⩾ e)
k
Remark. Note that it was not enough to use the Ratio Test to show that
the series converges (absolutely) for |x| < e — this shows that R ⩾ e, not
that R = e.
1 if k prime
ck xk where ck =
P
Example. Consider
0 otherwise.
Remark. The Ratio Test is often useful for finding the radius of convergence
of a power series, but does not always work. There are more sophisticated
strategies that work in other situations, but it is easy to apply them incor-
rectly, and they are not needed for Prelims.
109
37 Differentiation Theorem
We have seen that we can define a function using a power series. For ex-
ample, we defined the exponential, sine and cosine functions in this way. In
this section, we’re going to explore the derivative of a function defined by a
power series, as this will enable us to study some key properties of familiar
functions. This will not be an in-depth exploration, since you haven’t stud-
ied differentiability yet. We’ll state a theorem, and then see how extremely
useful it can be in practice. We shan’t prove it in this course; you’ll see a
proof in a future analysis course.
ck xk be
P
Theorem 60 (Differentiation Theorem for real power series). Let
a real power series with radius of convergence R. Assume that 0 < R ⩽ ∞.
X∞
For |x| < R, define f (x) = ck x k .
k=0
Then f (x) is well defined whenever |x| < R. Moreover, if |x| < R then
the derivative f ′ (x) exists, and
∞
! ∞ ∞
d X X d X
f ′ (x) = ck x k
= k
(ck x ) = kck xk−1 .
dx k=0 k=0
dx k=1
Remark. The slogan is that “on the disc of convergence, we can dif-
ferentiate term-by-term”.
Example. We saw that the power series defining the exponential, sine, co-
sine, sinh and cosh functions have R = ∞, so the series converge on R (and
on C), and by the Differentiation Theorem they are differentiable on all of
R. Moreover, by the Differentiation Theorem we can differentiate term by
term on R.
110
For example, for x ∈ R we have
∞
!
k
d x d X x
e =
dx dx k=0 k!
∞
d xk
X
= by the Differentiation Theorem
k=0
dx k!
∞
X kxk−1
=
k=1
k!
∞
X xk−1
=
k=1
(k − 1)!
∞
X xk
= = ex .
k=0
k!
d x
e = ex
dx
d
sin x = cos x
dx
d
cos x = − sin x
dx
d
sinh x = cosh x
dx
d
cosh x = sinh x.
dx
Example.
This means (using a result you’ll see in Analysis II) that h is constant.
111
But we know from the power series that sin 0 = 0 and cos 0 = 1, so
h(0) = 1.
So h(x) = 1 for all x ∈ R.
Example.
Remark. This shows that for all x ∈ R we have ex e−x = e0 = 1. From the
power series, we see that ex > 0 for x ⩾ 0, and hence in fact ex > 0 for all
x ∈ R.
Remark. These examples illustrate a really useful strategy, which can also
be used to prove results like trig identities. Watch out for more on this in
Analysis II next term!
What is π? We have defined sine and cosine using power series, without
mentioning right-angled triangles. We can then define π to be the smallest
112
π
positive x such that sin x = 0, or 2
as the smallest positive x such that
cos x = 0. It is not obvious that smallest such values exist; you’ll look at this
in more detail in Analysis II. You’ll then be able to go on and prove that
sine and cosine are 2π-periodic, for example.
There are some further examples at the end of Hilary Priestley’s notes on
Moodle, which you’ll also see in Analysis II/III.
This brings us to the end of Analysis I, but definitely not the end of
analysis.
Building on your knowledge of analysis so far, you might like to consider
the following questions, as a warm up for Analysis II.
113
What does it mean to say that f : R → R is differentiable at a point
x ∈ R?
Well done and thank you for making it to the end of Analysis I!
114