AC08 Saddle Djvu
AC08 Saddle Djvu
PART TWO
Analytic
Combinatorics
8. Saddle-Point Asymptotics
Cambridge
http://ac.cs.princeton.edu
A. SYMBOLIC METHOD
1. OGFs
2. EGFs
3. MGFs
B. COMPLEX ASYMPTOTICS
5. Applications of R&M
6. Singularity Analysis
7. Applications of SA
^ 8. Saddle point
specification
SYMBOLIC METHOD
Analytic
Combinatorics
Philippe Flajolet and
Robert Sedgewick
GF
equation
■ I
•»ill
COMPLEX ASYMPTOTICS
asymptotic
estimate
desired
result!
ANALYTIC COMBINATORICS
PART TWO
Analytic
Combinatorics
Philippe Flajolet and
Robert Sedgewick
CAMBRIDGE
8. Saddle-Point Asymptotics
• Modulus surfaces
^[^^oaadle point bounds
• Applications
http://ac.cs.princeton.edu
II.8a.Saddle.Surfaces
4
Welcome to absolute-value-land!
Example: 1 +4 z 2
1 — 4 z 2
2D version
A. No.
A zero of order p is a point where f (k Hz) = 0 for 0<k<p and fW(z) =*= 0.
zero of order 3
zero (order 1)
zero of order 2
A.
1 -z
^ c
(1-z)(2-z)
Basic characteristic
10
simple zero
not 0
~ c (z - Zo)
~ c (z - Zo)P
saddle point
not 0
~ c(z- Zo ) 2
ordinary point
not 0
not 0
~ c
simple pole
~ c / (z - Zo)
poles at
0 + i/2 and 0 - //2
1 -4 Z 2 ,
1 + 4z 22
—8z(1 + 4z 2 ) - (1 - 4 z 2 )8z
( 1 + 4z 2 ) 2
16 z
“(1 — 4z 2 ) 2
1 + z + z 2 + z 3
A. Where 1 + 2z + 3z 2 = 0 ,
or
• saddle points
bottom view
Modulus surface plots for familiar AC GFs
1 - Z
13
ANALYTIC COMBINATORICS
PART TWO
Analytic
Combinatorics
CAMBRIDGE
8. Saddle-Point Asymptotics
• Modulus surfaces
^[^^oaadle point bounds
• Applications
http://ac.cs.princeton.edu
II.8a.Saddle.Surfaces
ANALYTIC COMBINATORICS
PART TWO
Analytic
Combinatorics
CAMBRIDGE
8. Saddle-Point Asymptotics
• Modulus surfaces
• Applications
http://ac.cs.princeton.edu
II.8b.Saddle.Bounds
1 zeta
•Saddle point at ^
C ; (z)
z N+^
Q zG\^Jg{^ = N +T )*
Example: e z /z
Let C(z), not a polynomial, be analytic at the origin with finite radius of
convergence R.
If G has nonnegative coefficients, then ^z N ]C(z) < c(0/C") where ^ is the saddle
point
closest to the origin, the unique real root of the saddle point equation = N + 1
z N ]C(z)
I
dz
<
2ni J c G(z) z^
C r 2n r-, \ de
2n 1 (z) z«+i
Take C to be a
circle of radius X,
and change to
polar coordinates
c(0
C N
Example:
C(z)
C'(z)
C = 6
<
5! “ 6 5
e z /z 6
Saddle point GF bound example I: factorial/exponential
Goal. Estimate
N\
,N
JZ
G(z) = e
.z
nZ
Saddle point
C = N+1
C(z)
e z /z 6
e z = — <
,N+1
N! “ (N+ 1) N
,N
—)►
OGr-e
./V
N\ N n V2^N
18
Goal. Estimate
2 N
N
[z N }( 1 +z)
2 N
C(z) = (1 +z)
2N
c =
2/V
N
<
N + 1
N- 1
V N—1 )
IN
4N 2 \N
r/V+1 ' N
VN-1
N 2 - 1
» 4
(1 +z) 10 /z 6
2N\ 4 n
I ~ x
N / y/nN
ANALYTIC COMBINATORICS
PART TWO
Analytic
Combinatorics
CAMBRIDGE
8. Saddle-Point Asymptotics
• Modulus surfaces
• Applications
http://ac.cs.princeton.edu
II.8b.Saddle.Bounds
ANALYTIC COMBINATORICS
PART TWO
Analytic
Combinatorics
CAMBRIDGE
8. Saddle-Point Asymptotics
• Modulus surfaces
^[^^oaadle point bounds
• Applications
http://ac.cs.princeton.edu
II.8c.Saddle.Method
•Saddle point at Z,
•Use circle of radius Z,
22
Saddle-point susceptibility
The contour integral J F(z)dz with F(z ) = e f(z) is susceptible to the saddle
point approximation if
C passes through a saddle point the unique real root of the saddle point equation
F'(z) = 0
(or f'(z) = 0) and C can be split into two parts T and Q such that
z — o
F(z)dz
f(0 + >(C)(z-0
• Tails can be completed back [details omitted].
to be expected unless
multiple saddle point
since f'(Q= 0
23
C 1 f F(()
2 mJc s/2nf"{ Q
Proof.
24
271 /
F(z)dz
f ( z )
J2nf"(0
where g(z) = InC(z) - (N + 1 )ln z and G, is the unique positive real root of
the saddle point equation g'(z) = 0.
Equivalent forms
SP equation
G'(z) _ N + 1
G(z) _ z
SP approximation
Q(C)
C N+1 \/2jrg"(£)
25
Saddle point transfer example I: factorial/exponential
Goal. Estimate —
N\
Saddle point
Saddle point
approximation
,N
JZ
C(z)
e z =
C = N+1
r'(z) i N +1
f"( z) =
f\z) = 0
e N+1
[z N ]C(z) ~ _
1 C N+ V2irf"(C)
N N \/2n N
Important note : Need to check susceptibility, or use bound and sacrifice V2nN
factor.
tails are negligible, a central approximation holds, and tails can be completed
back
26
Saddle point method example I (susceptibility to saddle point)
Contour integral
2 71 /
I e z-(N+1) lnzj z
Cn
z = /Ve' 61
Neglect tails
N!
1 / e _ \
Qn =
J_e^_
271 /V N
exponentially small for
27
Approximate integrand
(e id - 1 - id) = -9 2 /2 + 0(6 3 )
Change of variable
Finish —
rsj
2k
P J tOq\/~N
y/N .
/ e
J — Oq y/~N
y/N
y/ln/N for 6
( ° )
1 N 1
y/2nN
! 2 dt for 9 q — N a
0 = t/y/N
d9 — dt/y/N
28
Saddle-point asymptotics
Q. N 1 / 2 - 2 / 5
29
Goal. Estimate
2 N
N
[z N }( 1 +z)
2 N
C(z) = (1 +z)
2N
Saddle point
c =
N+ 1
N- 1
Saddle point
approximation
[z N ]( 1 +z)" /v =
2N
2/V
N
r'(z)
//
2N N + 1
1 + z z
2/V N+1
(1+z) 2 + z 2
f'(z) = 0
/ 2N \ 2N
\N -1 /
[z N ]C(z) - _
1 < N+ V2rf"«)
Note : Slight shift of saddle point often simplifies calcuations (see next slide).
30
Goal. Estimate
Saddle point
[z N ]( 1 + z) 2N
f(z) = In C(z) — (N + 1) lnz
2Nln(1 + z) — (N + 1) lnz
2 N N + 1
1 + z z
2N N + 1
“(1 +z) 2 +
f'(z) = 0
Saddle point
approximation
,/v
]G(z)
C(0
/■"(I) ~N/2
Important note : Need to check susceptibility, or use bound and sacrifice v^icN
factor.
tails are negligible, a central approximation holds, and tails can be completed
back
31
ANALYTIC COMBINATORICS
PART TWO
Analytic
Combinatorics
CAMBRIDGE
8. Saddle-Point Asymptotics
• Modulus surfaces
^[^^oaadle point bounds
• Applications
http://ac.cs.princeton.edu
II.8c.Saddle.Method
ANALYTIC COMBINATORICS
PART TWO
Analytic
Combinatorics
CAMBRIDGE
8. Saddle-Point Asymptotics
• Modulus surfaces
^[^^oaadle point bounds
• Applications
http://ac.cs.princeton.edu
II.8d.Saddle.Apps
Involutions
/i
k = 2
h = 4
U= 10
34
I = SET(CYCi,2(Z))
/(z) = e
— o z + z V 2
Z N ]/(z)
N\[z n ]I(z)
3 N/2 + VN-1 /4
2 N N / 2 VnN
1 l-) N/2 e ^
</4e v e
Saddle-point transfer. Given a GF G(z), if the contour integral
is susceptible to the saddle point approximation, then
2 71 /
C(z)
c/z
Z N+1
2ni
C(z )
Z N+1
e g(0
\Z 2 *g "(0 y
where g(z) = InG(z) - (N + 1 )ln z and is the unique positive real root of the
saddle point equation g'(z ) = 0 (equivalently, G'(z)/G(z ) = (A/+l)/z ).
g'(z) = 1+ z-^±l
= 1 + N z t 1
C = -1 ^ v / TT4(NTTy
35
Set partitions
Si = 1
{1}
{2}
{1}
{2}
{1}
{2
{1
2}
{2}
{1
S 2 =
= 2
{3}
{1
{1}
{2}
S 3
= 5
{1} {2}
{3}
■ {4}
{1} {2 3
4}
{2} {1 3
4}
{3} {1 2
4}
{4} {1 2
3}
UJ
{1 2}
{3}
{4}
3}
{1 3}
{2}
{4}
3}
{1 4}
{2}
{3}
2}
{2 3}
{1}
{4}
{3}
{2 4}
{1}
{3}
{3 4}
{1}
{2}
{1 2}
{3
4}
{1 3}
{2
4}
{1 4}
{2
3}
{1 2
3 4}
S 4 =
= 15
36
S = SET(SET>o(Z))
S(z)
.N—1
Sn < N\
(In N)
&V^NTe
Saddle-point transfer. Given a GF G(z), if the contour integral
is susceptible to the saddle point approximation, then
2ni
dz
Z N +1
e g( 0 N
\/ 2 *g"(C) )
where g(z) = InG(z) - (N + 1 )ln z and ^ is the unique positive real root of the
saddle point equation g'(z) = 0 (equivalently, C'(z)/C(z) = (A/+l)/z ).
g(z )
g'V)
e z — 1 — (N + *\) In z
N + 1
e z —
g"(z) = e z +
N+ 1
^2
= N + 1
£ ~ In N — In In N
SP bound
[z N ]S(z) < ^
37
Saddle point: summary of combinatorial applications
urns
U = SET(Z )
e z
e N
^ N n
central binomial
[z N ]( 1 +z) 2N
->• 4 n
involutions
e z+z2 /2
p N/2+>/N-1/4
< A/'
" V2N n ^ 2
set partitions
S = SET(SET>o(Z))
e 6 " -1
pN-1
< N>
- (lnN) w
fragmented
permutations
F = SET(SEQ>o(Z ))
e z /0~ z )
integer partitions
P= MSET(SEQ>o(Z))
< e n^/2N/3
coefficient
asymptotics
N\ ~ N N V2nN
VnN
„N/2+VN- 1/4
/V'-
2 N N/2 VnN
< N\
,2\//V—1 /2
2 \/7t
e 7i^2W/3
4N\/3
amateurs
38
ANALYTIC COMBINATORICS
PART TWO
Analytic
Combinatorics
CAMBRIDGE
8. Saddle-Point Asymptotics
• Modulus surfaces
^[^^oaadle point bounds
http://ac.cs.princeton.edu
II.8d.Saddle.Apps
ANALYTIC COMBINATORICS
PART TWO
Analytic
Combinatorics
CAMBRIDGE
http://ac.cs.princeton.edu
8. Saddle-Point Asymptotics
• Modulus surfaces
^[^^oaadle point bounds
• Applications
• AC wrapup
II.8e.Saddle.Summary
1. OGFs
2. EGFs
3. MGFs
B. COMPLEX ASYMPTOTICS
5. Applications of R&M
6. Singularity Analysis
7. Applications of SA
8. Saddle point
specification
SYMBOLIC METHOD
Analytic
Combinatorics
GF
equation
■ I
•»ill
COMPLEX ASYMPTOTICS
asymptotic
estimate
desired
result!
4. Combinatorial classes fall into general schema that are governed by universal
asymptotic laws.
42
operation
notation
semantics
disjoint
union
A + B
Cartesian
product
Ax B
sequence
SEQ(A)
powerset
PSET(A)
no +z '
n> 1
multiset
MSET(A)
n (T
n> 1 v
—one exa
OCF
A(z) + B(z)
A(z)B(z)
Theorem. Let A and B be combinatorial classes of labelled objects with EGFs A(z)
and B(z). Then
construction
notation
semantics
EGF
disjoint union
A + B
A(z) + B(z)
labelled product
A ★ B
A(z)B(z)
SEQk(A) or A k
A(z) k
sequence
SEQ(A)
1 -A(z)
set
SET k (A)
/c-sets of objects from A
A(zf/k\
SET( A)
e A(z)
CYCk(A)
A(z) k /k
cycle
CYC {A)
hl 1-A(z)
43
meromorphic?
standard
scale?
Meromorphic Transfer
(see Lecture 4)
> f
Standard Scale Transfe
(see Lecture 6)
square root?
logarithmic?
no singularities?
Singularity Analysis
(see Lecture 6)
> r
Saddle Point
Schemas
1 1
1 -z/p 1- z/p
and
[z n ]F(z)
e 13 ,1
v--- y /
r(a) V
(-) N
1 —Of
\_ ymt yr _ J
[z N ]F(z)
\/2jt<?i"(A)/</>(A)
Suppose that F is an implicit tree-like class with associated GF F(z) = 4>(z, F(z))
that
is aperiodic and smooth-implicit^, s), so that G(r, s) = s and G w (r, s) = 1. Then
F(z) converges at z= r where it has a square-root singularity with
2y/n v r
45
"If you can specify it, you can analyze it"
( Specification )
ir
Symbolic transfer
GF equation)
IT
Analytic transfer
_L
Example 3: Suriections
( Specification]
VT J
Symbolic trans
T J
D, the class of all derangements
D = SET(CYC > 0 (Z))
PS 2 >
:®\ © r®
Cl
Ana
Mappings
raphs
Example
Spei
Symlj
Symbolic transfer
• V * • *
i V
* v ^ 4
■'v'-z...
r = set(ucyc>2(;
a a n
Analytic
Combinatorics
1-z/p V 1 -z/p'
and
(J
M(z) = e Y ^s
1 1 *
Analytic transfer
~T~
N\[z‘
L, the class of
L = i
L(z)=z +
S = SET(SET>o(Z))
5(z) = e 1
,e z —1
(7)
©®
¥
— o z + z2 / 2
g'( z ) =
Asymptotics ) . SP bound
{2 3} {5 7 9} {4} {1 8}
2 tit J £
( flew = -1 ,[ ~ ^
_ 2m J c Z y/2*g"(0 J
where g(z) = InG(z) - (/V+ l)lnz and G, is the unique positive real root of the
saddle point equation g’(z) = 0 (equivalently, G\z)/G(z) = ( N+])/z ).
g(z) = e z - 1 - (N + 1) In z
N + 1 Ce c = N + 1
2ni J c /rv+i
V 2 Wr y/2ip(0 J
where g(z) = InG(z) - (W + 1 )ln z and G, is the unique positive real root of the
saddle point equation g'(z) = 0 (equivalently, C'(z)/C(z) = (/V+l)/z ).
g(z) = z + z 2 /2 - (N + 1) lnz
N + 1 c 2 +C-(n+i) = o
z N ]l(z)
e N/2+VN-1/4
2 N N / 2 V^
g'(z) = 1+z--
g"( z ) = 1 + ^
Q = -\ + l^ + 4(N + 1 )
~ VN - 1 /2 + 0(1 /Vn)
N+1
£ ~ In N — In In N
Sn < N\
a N -1
(In NY
iVnTfi' r>
with r = 2 In 2 — 1
<t>„,(z, w) = e w — 1
$mv(z, w) = e w
%/21n2 - 1 )
"T
4\/7r
4 n N 3 /2
d>'(u) =
<t>"(u) =
V2k
(i - up
i
(TAj 1
1 - A (1 - A) 2
_ 1/2
«i(A) = 2
<t>'{ A) = 4
gi"(A) = 16
otics
F -7
Note that the specification is the most succinct of all the descriptions
S(z)=z +
1 -S(z)
1 - S(z)
Analytic transfer
Suppose that F is an implicit tree like class with associated GF F(z) = 4>(z, F(z))
that
is aperiodic and smooth-implicit(r, s), so that C(r, s) = s and G w (r, s) = 1.
Then
F(z) converges at z= r where it has a square-root singularity with
2 r^,(r,s)
^ww(r, s)
[z~]5(z)
,^ = (l) N N -3/2
with r = 3 - 2 V 2
Dn
7.. . 1
2 .. . 2
1... 9
5 44.1455... 44
46
What is "Analytic combinatorics"?
47
What's next?
• Details of SA proofs
• Additional schema
• Drmota-Llaley-Woods theorem
Available as "postscript"
to this course
For an overview of Flajolet's work and current research in AC, watch the lecture
"If you can specify it you can analyze it": the lasting legacy of Philippe Flajolet
48
Shameless plugs
Books
Booksites
TO THE
Analysis
Algorithms
ROBERT SEDGEWICK
PHILIPPE FLAJOLET
Analytic
Combinatorics
Online courses
Princeton University
Algorithms, Part I
Princeton University
Algorithms, Part II
Princeton University
And,
this course . . .
see AC booksite
for details
49
Now this is not the end. It is not even the beginning of the end.
But it is, perhaps, the end of the beginning. "
ANALYTIC COMBINATORICS
PART TWO
Analytic
Combinatorics
Philippe Flajolet and
Robert Sedgewick
CAMBRIDGE
http://ac.cs.princeton.edu
8. Saddle-Point Asymptotics
• Modulus surfaces
^[^^oaadle point bounds
• Applications
• AC wrapup
II.8e.Saddle.Summary
ANALYTIC COMBINATORICS
PART TWO
Analytic
Combinatorics
8. Saddle-Point Asymptotics
Cambridge
http://ac.cs.princeton.edu