PHAS0024 v1
PHAS0024 v1
(q signifying quasi-static change, a process such that each intermediate state approaches
an equilibrium state)
The Clausius Statement of the 2nd Law - Spontaneous heat flow between two
systems
For two systems in equilibrium at temperature and , consider spontaneous heat flow
from to with . As both are in equilibrium, the quasistatic expression
holds:
PHAS0024 Page 1
The 2nd Law, the Arrow of Time and Equilibrium
From the 2nd law above, we see that time-reversal symmetry is broken. This is not trivial,
considering all underlying mechanical laws are time-symmetric.
Due to this, we can also see that equilibrium will be reached by increasing entropy until it
is maximised.
Quasistatic approximation
The quasistatic approximation assumes a constant temperature , even with
nonzero heat transfer . This holds better with a small or a large system (with a
large specific heat capacity).
As such, for large reservoirs/environments, we take the approximation
. Note that the same isn't always applied to small systems.
The Kelvin Statement of the 2nd Law - Heat engine between two systems
Consider two systems and (with and ), with a heat engine.
Proceeding as per the Clausius Statement, noting
(Note that )
, if
By the Kelvin statement, "No device operating on a cycle may produce work from a single
thermal reservoir".
Note that efficiency approaches 1 if the second reservoir has temperature approaching
zero. This leads well into the third law - also known as Nernst's unattainability principle.
For energy as a function of entropy, volume, and number of particles, by the definition of
the total derivative:
Where is the chemical potential, the change in energy of system upon adding
another particle.
Note that in this case, and , and , and and are conjugate thermodynamic
variables.
Examining the behaviour of total entropy when energy is minimised, subject to fixed SVN:
As
Looking at the behaviour of total entropy when minimizing , subject to fixed TVN:
PHAS0024 Page 2
Again, total entropy is maximised.
Legendre Transformations
The dependence of a function can be modified:
The Legendre transform of function with respect to the
variable is given by:
Thermodynamic potentials:
Potential Name Definition System
Energy Is isolated
Helmholtz free energy Can exchange heat to keep constant
Enthalpy Can exchange volume to keep constant
Gibbs free energy Can exchange both heat and volume
Grand potential Can exchange heat and particles
The remaining 3 potentials are not defined as they have no physically meaningful
application. For instance, the potential would signify a system that can exchange
particles , but not heat .
We modify the ideal gas situation by introducing a gravitational potential energy term:
Assuming constant :
To find the variation of number density with height, we consider the pressure exerted by
a layer of air between and over an area
e e
(i.e. the number density decays exponentially with height)
Dividing the room up into a large number of equally spaced lattice points each with a
volume of .
Significance:
- the molecules do not all gather in a small volume, but instead spreads over the
whole room, maximising entropy.
- Constant temperature restriction means that a maximisation of entropy
corresponds to a minimisation of the Helmholtz free energy.
Basics of Probability
We can demonstrate many relevant concepts using the simple example of a die. (Taking a
six-sided die, D6 for the examples):
PHAS0024 Page 3
Microstates and Macrostates
Note that microstates all have equal probability, while this is not necessarily the case for
macrostates. This can be quantified with the concept of multiplicity :
- A macrostate has a multiplicity of if microstates belong under that macrostate.
As an extensive variable, entropy should scale proportionally with the extent of the
system. However, the number of microstates increases exponentially with the extent of
the system.
As such, one must take a logarithm of the number of microstates to obtain an extensive
variable.
Boltzmann defines entropy with pre-factor and base (natural log):
Statistical Ensembles
We concern ourselves with three main statistical ensembles:
- Microcanonical ensemble
○ The system is completely isolated. That is, the energy and number of particles
is conserved
○ Each microstate has an equal probability
- Canonical ensemble
○ Energy can be exchanged between the system and the reservoir
○ Each microstate (system + reservoir) is equally likely
○ Probability of microstate in system depends on microstates in reservoir
- Grand canonical ensemble
○ Energy and particles can be exchanged between the system and the reservoir
○ Microstates are equally likely
○ Probability of microstate in system depends on microstates in reservoir
We see the three statistical ensembles share the second property. This is the principle of
equal a priori probability: that the probability of a microstate in a closed system is
equal to that of any other microstate.
However, there is a dependence between the microstates of the system and the reservoir
for the canonical and grand canonical ensembles. We will see how these can potentially be
quantified.
Assuming that the reservoir is much larger than the system, and that their energies follow
the same trend, we can consider as a taylor expansion about
with deviation :
Per the properties of probability, we know that they must sum up to 1. We can thus divide
by a factor to normalise this probability:
PHAS0024 Page 4
called the inverse temperature or thermodynamic beta.
We note:
Variables
m for constant:
Potential
To distribute identical objects across boxes, we can also think of the situation as
distributing the box boundaries across the gaps between the objects:
For fewer number of boxes, we can illustrate a phase space to calculate the multiplicity of
each macrostate.
Stirling's Approximation:
We therefore conclude:
Equipartition of Energy
The equipartition theorem states that: each term in the energy, or each degree of
freedom, contributes a term to the total average canonical energy at temperature .
Here is a constant and is an independent phase space variable.
PHAS0024 Page 5
Here is a constant and is an independent phase space variable.
s s
s
s
s
s
t
s
t
t
Asymptotic behaviour:
- , depending on the sign of
-
As relevant in deriving the expected kinetic energy, we will need to calculate the expected
squared velocity.
As such, we will need the probability distribution function for velocity squared, which is
termed the Maxwell Boltzmann distribution.
Consider the velocity squared as a sum of the three separate components squared:
Noting that all molecules with the same velocity are equal radius from the origin.
PHAS0024 Page 6
From spherical symmetry, we may integrate over the latter two variables to yield:
Changing variables:
Integrating by parts:
Vacancies in Crystals
Assuming that:
- Vacancy is independent of other vacancies
- Atoms can hop between lattice sites
- Multiplicities of each atom are 1
This results in the grand partition function:
Thermodynamic Limit
For large :
For large :
PHAS0024 Page 7
Given the change of variable:
The first two factors are constant with respect to , and the last is a Gaussian function
around . The curve is characterised by the standard deviation
For :
Gibbs Entropy
We define a new entropy called the Gibbs entropy, defined in terms of the probability of
microstate instead of the multiplicity:
The multiplicity for any microstate (given the principle of equal a priori probability) is 1:
We see that is therefore a measure of how much we do not know. As such, it is also
sometimes termed uncertainty.
PHAS0024 Page 8
Helmholtz free energy in terms of canonical partition function:
For a message of symbols constructed of bits (0s and 1s). The total number of possible
messages is , where is the number of bits per symbol.
To find , we take the natural logarithm and employ Stirling's approximation to yield:
Note that this quantity is the minimum number of bits per symbol to convey a
message of symbols with probability of occurrence with out loss of information, also
called Shannon entropy.
Also termed the surprisal, this can be seen as a generalisation to the energy of a quantum
gas.
We can now consider the multiplicities by moving from the quantum number space
into the wavevector space .
To consider how the two scale, the interval between two consecutive is
. Taking spin into account, each lattice poinnt in -space has distinct quantum
states.
Be can see the canonical partition function as the sum of Boltzmann factors over all
available microstates. For a single particle:
PHAS0024 Page 9
The microstates are grouped into microstates depending on the magnitude of the
wavevector. Integrating the sum over all states via an integral:
As we're only counting positive wavevectors, we can determine the density of states by
calculating the microstate multiplicity in a thin shell of the first octant:
Upon exchange of two identical particles, a quantum state changes at most by a global
phase. Upon exchange and swapping back, we must recover the original wavefunction.
For bosons:
s e e e
Asymptotic behavior:
- Note that energy is strictly
-
-
For fermions:
PHAS0024 Page 10
Asymptotic behavior:
-
-
In conclusion:
These phenomena result in condensation processes for both Fermi-Dirac and Bose-
Einstein gases at lower temperatures.
- Bose Einstein Condensate
○ Note that Bose-Einstein condensation will happen much more noticeably due
to no PEP restricting the maximum number.
- Fermi degenerate gas
○ Highest level is called the Fermi level, determined by calculating half the
number of free electrons per unit volume/area/length. This is an intensive
property.
Given the single-particle and multiple particle single level partition functions, we
now want to find the partition function for multiple states by multiple particles
Note that multiple wavevectors may result in the same energy, which means that they can
be collected through exponentiation. Note that the product now iterates through the
energies.
Taking the natural logarithm of this expression, in the limit that we consider a decreasing
spacing between energy levels:
Bosons:
Fermions:
From the grand canonical partition function above, as well as an expression for the
density of states ( ):
From
(integration by parts?)
Conducting a first order Taylor expansion, we see that the single-energy grand canonical
partition function matches:
By another Taylor expansion, we find the multi-energy grand canonical partition function
If this last integral looks familiar, you've been doing too much stat mech it's because it's
the one-particle canonical partition function:
We take another approach from the definition of the grand canonical partition function,
dividing the summation over two indices into two separate summations by noting part of
the expression as the partition function with respect to number of particles :
Given our previous definition of entropy using expected values, we can derive the Sackur-
Tetrode equation for the entropy of a classical monoatomic ideal gas:
e e
From this, we are able to find the constant in our original derivation of entropy as
a state function:
And the influence of in shows that quantum mechanics imposes limits on the
granularity of , preventing it from approaching infinity.
Blackbody radiation
An ideal blackbody is a theorized object which absorbs all incident light, and is in thermal
equilibrium with its surroundings.
Applying these to calculate the density of states in terms of angular frequency (and noting
that photons have a degeneracy of 2 despite a spin of 1:
As such, we must consider the expected energy density using the statistical mechanics
formulation. Ignoring the zero point energy:
PHAS0024 Page 12
Applying a change of variables
and using the standard integral :
To find the frequency of light with the highest "contribution" to energy (peak frequency),
we can differentiate the integrand with respect to frequency. Note that the solution
requires use of the Lambert-W function.
Setting :
Expected Values
Use Case Expression
Partition Functions
Use Case Symbol Expression
Single particle (canonical)
The effect of the atmosphere becomes prevalent when we consider the sun and earth as
two ideal black bodies in thermal equilibrium.
From the Stefan-Boltzmann radiation law and the solid angle subtended by the Earth/ the
inverse square law of radiation, we can calculate the incident solar flux (incident power
per unit area):
Note that only of the Earth will receive the incident radiation, but the energy will be
spread out over all of the surface:
(Incident solar flux - the input power per unit area received by the Earth)
PHAS0024 Page 13
Incoming energy = outgoing energy
(assuming no energy is absorbed by the atmosphere on initial incidence)
At a habitable .
Bose-Einstein condensation
As we require for convergence of the grand partition function, the ground state
will then necessitate .
Where is the critical temperature, the threshold at which a finite ratio of the total
number of particles occupy the single-particle ground state. Particles in such a state are
said to be in a Bose-Einstein condensate. This can be done through evapoartion cooling,
reducing the potential well depth and allowing particles to re-thermalise (reattain
thermal equilibrium).
Phenomena of BECs:
- Particles all occupy the same delocalised quantum wavefunction,
- Collisions are suppressed, viscosity approaches zero.
Other notable bosons include phonons, from which we can determine the heat capacity of
solids.
By visualising the excitation of bosons in a lattice, we can assume a large set of coupled
differential equations where bosons experience a spring force from its nearest
neighbours:
s s
There is a solution for every pair of values of and , of this dispersion relation.
If , we can also make the small angle approximation:
We can now also rewrite the dispersion relation under small angle approximations as:
Where
Heat Capacity
Peter Debye (1884-1966) capped the maximum frequency at , allowing us to count the
number of modes as the integral of density of states over frequency:
PHAS0024 Page 14
With this, we find the heat capacity at fixed volume , noting the zero point energy:
s s s s
s s
For the low temperature limit, . Making the substituion and using a
standard integral:
Comparing this to the Einstein model, the Debye model predicts a higher specific heat
capacity at lower temperatures.
Unlike bosons which have no limitation to the number of particles in one energy level,
fermions are restricted by the Pauli exclusion principle. As such, at lower temperature
limits, a degenerate Fermi gas occurs.
Such a gas occurs when the single-particle energy eigenstates are occupied with
probability 1 up to a maximum single-particle energy (the Fermi energy ), with all
states above this energy empty.
This occurs approximately when , and Fermi energy is related to number density
as belows:
PHAS0024 Page 15
Which is to say, a degenerate Fermi gas can occur at any temperature provided a
sufficiently high temperature, since , and the criterion for Fermi degeneracy is
.
Assuming es t e e t s t s e t s
Stars are in hydrostatic equilibrium - there is a balance between the gas and radiation
pressures outwards, and the gravitational attraction inwards.
As nuclear fuel depletes, gravity is able to push the star further inwards, leading to our
condition for degeneracy fulfilled ( )
The lower the mass, the higher the Fermi energy. As such, electrons with lighter mass will
enter degeneracy first.
With at about 1/65 times the Fermi energy, we may safely assume
degeneracy.
We can also investigate the radius threshold at which Fermi pressure equals gravitational
compression:
To find the force from each mass layer of thickness , we assume a star with
homogeneous mass ( ) and calculate the attraction felt by the shell:
We then integrate the force divided by surface area over each shell:
PHAS0024 Page 16
However, a relativistic modification changes this result:
In the extreme ultra-relativistic case where the kinetic energy greatly exceeds the rest
energy ( ): .
With further mass, further collapse is possible, now putting the nucleons in degeneracy,
yileding a radius:
Following the free electron model of electron gas, we yield an effective electron mass
as a result of:
- repulsive electrostatic interactions, and
- screening from attractive interactions with the ions
Given the number density of free electrons in a metal, Fermi temperatures ( ) are
thousands of kelvins, allowing us to safely assume Fermi degeneracy.
Subbing into :
Allowing us to recover
- Heat capacity
Electrons with will contribute to the heat capacity, and the proportion which
contributes to storing this energy can be estimated from the width of the curve at
.
- Heat conductivity
The heat conductivity is defined via the heat flux , and also given by the
PHAS0024 Page 17
The heat conductivity is defined via the heat flux , and also given by the
expression below (where is equal to the mean time between electron-phonon collisions)
The Debye frequency allows us to observe a regime in which the mean collision time is
not the same for thermal and electrical conductivity. When , some collisions
only affect thermal conductivity.
wef
PHAS0024 Page 18