Scribd
Upload
24 views

As A Science Major, You Will All Eventually Have To Deal With Data

1) Data processing techniques such as Fourier analysis and digital filtering can be used to separate signals in data by wavelength and remove unwanted noise. 2) Fourier analysis decomposes wiggly data into harmonic components of varying amplitudes to isolate dominant frequencies/wavelengths, while digital filters directly target specific wavelengths for removal. 3) Care must be taken when processing data to avoid issues like aliasing and complete signal decimation from incompatible filters or insufficient sampling rates.

Uploaded by

Yuniarti Wijadi
Copyright
© © All Rights Reserved
Available Formats
Download as PPTX, PDF, TXT or read online on Scribd
24 views

As A Science Major, You Will All Eventually Have To Deal With Data

1) Data processing techniques such as Fourier analysis and digital filtering can be used to separate signals in data by wavelength and remove unwanted noise. 2) Fourier analysis decomposes wiggly data into harmonic components of varying amplitudes to isolate dominant frequencies/wavelengths, while digital filters directly target specific wavelengths for removal. 3) Care must be taken when processing data to avoid issues like aliasing and complete signal decimation from incompatible filters or insufficient sampling rates.

Uploaded by

Yuniarti Wijadi
Copyright
© © All Rights Reserved
Available Formats
Download as PPTX, PDF, TXT or read online on Scribd
You are on page 1/ 13

Data

Processing
Chapter 3

As a science major, you will all eventually have to deal with


data.
All data has noise
Devices do not give useful measurements; must convert data
The better you can handle data, the more employable you will be

Wavelength and Fourier Analysis

A Simple Example

The granite produces a


negative gravity
anomaly
Variations in the
sediment cover cause
noise in the data
The noise and the
anomaly have different
wavelength scales
Fourier analysis
Separates signals by
wavelength

2 x

General Wave Terms


a

0.5a

0.5a

Amplitude

y a sin

0.5

Wavelength ()

-a

Amplitude (a) =
Wavelength () =
Frequency =
Period =

1.5

nx
y a sin

Harmonic Analysis

1st 5 harmonics

1
0.5
0
0.5
-1

nx
y a sin


0.2 L

0.4 L

0.6 L

0.8 L

Harmonics: multiples of a signals half


wavelength, L
Why use harmonics?
Found in nature and music
Like a guitar!

Any wiggly line can be mathematically reproduced


by adding together a series of waves
Exact match requires waves

Fourier Analysis
A type of harmonic
analysis where wiggly
data are separated into
various harmonics of
differing amplitude
Adjusts the amplitudes
of each harmonic
Can isolate dominant
frequencies/wavelength
s in data and remove
unwanted ones
Sum of harmonics
reproduces data exactly

Data Separated by Wavelength

Sum of same harmonics, but with different amplitudes

What to Remove?

In this tide data, what type of wavelengths


(short or long) should we remove?
What causes each?

Caveats of
Fourier Analysis
Requires a complete
signal
Starts and ends at
same value

Only analyzes
wavelengths that are
multiples of the signal
length
Geologic targets likely
have multiple
wavelengths and may
share some

Digital Filtering
An alternative way to remove unwanted
wavelengths/frequencies: Filtering
Usually applied to regularly space data
If data not regular, interpolation can be used

E.g. A simple 3-point filter :: 1/3 (y n-1 + yn + yn+1)


Also called
3-point running average
3-point moving window
Time or
Distance

Valu
e
Filtered
Value

1
18
X3

2
09
2 13

3
510
5
6

4
4

5
9

6
4

7
2

There are also 5-point, 7-point, and n-point filters.


Some are weighted to remove certain wavelengths

Effects of Digital Filters


Low-pass filter
Also called
Smoothing filter
Allows low freq
to pass through

High-pass filter
Allows high freq
To pass through

Band-pass filter
Constructed to only let certain
bands or frequencies through

A subwoofer
in a
bandpass
box

Effects of Digital Filters


A given filter
may have a very
different effect
on data
depending on:
Wavelength
Sampling Rate /
Resolution

A filter can
completely
decimate a
signal

Aliasing
If sampling rate
(resolution) approaches
wavelength of signal
May see false patterns

If sampling rate is less


than signals
wavelength
May see false long
wavelength signals

Aliasing: Discrete
(non-continuous) data
can suggest patterns
that are not real
Nyquist wavelength
= half the signals
wavelength.
This is the minimum
sampling rate to avoid
aliasing

Gridded Data Processing

All of the data processing techniques discussed here can


also be applied to gridded or even three-dimensional data
Can filter directional noise
Highlights directional features
Geologists should pay attention in multivariable calculus class!
E.g. MAT 2130 - CALCUL ANALY GEOM III

Do not rely on black box computer programs


E.g. Arc GIS

Filtering in 2D :: Gridded Data


Filters can be created
to filter all types of
data
No technique is perfect
Great care must be
given when creating a
filter or processing data
in general

You might also like