A F A E: Daptive Iltering Pplications Xplained
A F A E: Daptive Iltering Pplications Xplained
INTRODUCTION
Although well-known and widely used, adaptive filtering
applications are not easily understood, and their principles
are not easily simplified. Currently, adaptive filtering is
applied in such diverse fields as communications, radar,
sonar, seismology, and biomedical engineering. Although
these various applications are very different in nature, one
common feature can be noted: an input vector and a
desired response are used to compute an estimation error,
which is used, in turn, to control the values of a set of
adjustable filter coefficients. The adjustable coefficients
may take the form of tap weights, reflection coefficients, or
rotation parameters, depending on the filter structure
employed.
Despite the diversity and complexity, a simple classification
of adaptive filtering does emerge and practical applications
can be demonstrated. This app. note begins by describing
four basic classes of adaptive filtering applications and
follows with sections that detail various fundamentals,
techniques, and algorithms of several selected adaptive
applications (refer to Table 1).
Application
System Identification
Layered Earth Modeling
Inverse Modeling Predictive Deconvolution
Adaptive Equalization
Prediction
Linear Predictive Coding
Adaptive Differential PCM
Auto-Regressive Spectrum Analysis
Signal Detection
Interference
Adaptive Noise Canceling
Canceling
Echo Cancellation
Radar Polarimetry
Adaptive Beamforming
The following notations are used in Figures 14:
u = input applied to the adaptive filter
d = desired response
Identification
Inverse Modeling
Prediction
Interference Canceling
AP96DSP0200
e = d -y = estimation error
The functions of the four basic classes of adaptive filtering
applications follow.
AN008001-0301
System
Output 2
Random
Signal
u
Adaptive
Filter
Delay
+ d
y
e System
Adaptive
Filter
Output 1
Figure 3. Prediction
+
d
System
Input
System
Output
Plant
Figure 1. Identification
Primary
Signal
d
+
Reference u
Signal
System
Plant
Adaptive
Adaptive
Filter
System
Output
System
y
Delay
AN008001-0301
AP96DSP0200
Pitch
Period
Impulse Train
Generator
Vocal-Cord
Sound Pulse
Voiced/Unvoiced
Switch
White-Noise
Generator
Vocal-Tract
Filter
Synthesized
Speech
Vocal-Tract
Parameters
Figure 5. Block Diagram of a Simplified Model for the Speech Production Process
AP96DSP0200
AN008001-0301
Speech
Signal
Window
LPC
Analyzer
Coder
Pitch
Detector
(a) Transmitter
Speech
Synthesizer
Decoder
Reproduction of
Speech Signal
(b) Receiver
Adaptive Equalization
During the past three decades, a considerable effort has
been devoted to the study of data-transmission systems
that utilize the available channel bandwidth efficiently. The
objective here is to design the system to accommodate the
highest possible rate of data transmission, subject to a
specified reliability that is usually measured in terms of the
error rate or average probability of symbol error.
AN008001-0301
AP96DSP0200
Synchronization
Input
Binary
Data
Pulse
Generator
Transmit
Filter
Medium
Receive
Filter
Noise
Transmitter
()
Sampler
Decision
Device
Output
Binary
Data
Receiver
AP96DSP0200
AN008001-0301
AN008001-0301
AP96DSP0200
Sampled
Speech
Input
Nonuniform
Quantizer
PCM
Wave
(a)
+
Sampled
Speech
Input
DPCM
Wave
Quantizer
Predictor
(b)
Adaptive
Algorithm
Sampled
Speech
Input
ADPCM
Wave
Quantizer
Predictor
Adaptive
Algorithm
(c)
AP96DSP0200
AN008001-0301
Primary
Sensor
Output
Signal
Source
Reference
Sensor
Noise
Source
Adaptive
Filter
Estimate of
Noise
The signal and the noise are not correlated with each
other. The reference sensor receives a noise v1(n)
that is not correlated with the signal s(n) but correlated
with the noise v0(n) in the primary sensor output in an
unknown way:
AN008001-0301
AP96DSP0200
ECG
Preamplifier
Output
Primary
Signal
^ (n)
w
0
+
Reference
Signal
ECG
Recorder
Attenuator
^ (n)
w
1
90Phase
Shifter
LMS
Algorithm
AP96DSP0200
AN008001-0301
Echo Cancellation
Almost all conversations are conducted in the presence of
echoes. An echo may not be distinct, depending on the
Echo of As Speech
L1
Hybrid
A
Hybrid
B
Speaker
A
Speaker
B
L2
Echo of Bs Speech
10
AN008001-0301
AP96DSP0200
In
Balancing
Network
Speaker
Out
Adaptive
Filter
^r (n)
e(n)
Speaker
B
Hybrid
Speaker As
Echo r(n)
Speaker Bs
Signal x(n)
+
r(n) + x(n)
AP96DSP0200
AN008001-0301
11
LMS Algorithm
The well-known least-mean-square (LMS) algorithm is an
important member of the family of stochastic gradientbased algorithms. A significant feature of the LMS
algorithm is its simplicity. It does not require
measurements of the pertinent correlation functions, nor
does it require matrix inversion. Indeed, it is the simplicity
of the LMS algorithm that has made it the standard against
which other adaptive filtering algorithms are benchmarked.
The operation of the LMS algorithm is descriptive of a
feedback control system. Basically, it consists of a
combination of two basic processes:
u(n)
^
d(n |Un)
Transversal Filter
w(n)
Adaptive Weight-Control
Mechanism
e(n)
+
d(n)
12
AN008001-0301
AP96DSP0200
u(n)
u(n 1)
z 1
w0 (n)
z 1
u(n M
u(n 2)
. . .
w1 (n)
w2 (n)
. . .
. . .
z 1
u(n M +
(n)
wM-2
wM-1 (n)
d(n
e(n)
+
d(n)
AP96DSP0200
AN008001-0301
13
w0 (n)
u(n)
w1 (n)
u(n 1)
w2 (n)
u(n 2)
.
.
.
.
.
.
u(n M + 2)
u(n M + 1)
wM2 (n)
wM1 (n)
14
It is important to realize, however, that the misadjustments are under the designer's control. In
particular, the feedback loop acting around the tap weights
behaves like a low-pass filter, with an average time
constant that is inversely proportional to the step size
parameter u. Hence, by assigning a small value to u, the
adaptive process is made to progress slowly, and the
effects of gradient noise on the tap weights are largely
filtered out. This, in turn, has the effect of reducing the misadjustments.
AN008001-0301
AP96DSP0200
AP96DSP0200
References
1. Haykin, S. Adaptive Filter Theory. Prentice-Hall
International, Inc. 1991, pages 1720, 3140, 4955,
303.
2. Honig, M. and Messerschmitt, D. Adaptive Filters:
Structures, Algorithms, and Applications. Boston:
Kluwer Academic Publishers. 1984.
AN008001-0301
15