Scribd
Upload
40 views

02 - Image Formation

The document discusses concepts related to signals, image formation, and digital image representation. It covers topics like time-varying signals, sampling, quantization, color perception, illumination, reflectance, and color models. It also discusses the physics of light, camera sensors, lenses, depth of field, field of view, and other optical concepts.

Uploaded by

Mohamed Abd El Emam
Copyright
© © All Rights Reserved
Available Formats
Download as PPT, PDF, TXT or read online on Scribd
40 views

02 - Image Formation

The document discusses concepts related to signals, image formation, and digital image representation. It covers topics like time-varying signals, sampling, quantization, color perception, illumination, reflectance, and color models. It also discusses the physics of light, camera sensors, lenses, depth of field, field of view, and other optical concepts.

Uploaded by

Mohamed Abd El Emam
Copyright
© © All Rights Reserved
Available Formats
Download as PPT, PDF, TXT or read online on Scribd
You are on page 1/ 75

MD Signals & Image Formation

Lecturer: Hossam Abdelmunim


Email : [email protected]

Computer and Systems Engineering Department


Signals
Time-Varying Signals
Spatially-Varying Signals
Spatiotemporal Signals

Video Signal!
Types of Signals
Analog & Digital
Sampling
Quantization
Digital Image Representation
Digital Image Representation
Digital Image Representation
Example of Digital Image
Light-intensity function
Illumination and Reflectance
Illumination and Reflectance
Gray level
Color Perception
• Color is an important part of our visual experience.

• We distinguish only 100 levels of grays but hundreds of


thousands of colors.

• Color detection is important to computer vision;


• Object recognition is easier
• Underutilized because more processing is required, hard
to publish
Color Perception of Reflection
Electromagnetic Spectrum

Human Luminance Sensitivity Function

http://www.yorku.ca/eye/photopik.htm
The Physics of Light

Some examples of the reflectance spectra of surfaces


% Photons Reflected

Red Yellow Blue Purple

400 700 400 700 400 700 400 700


Wavelength (nm) © Stephen E. Palmer, 2002
Color Sensing in Camera (RGB)
• 3-chip vs. 1-chip: quality vs. cost
• Why more green?

Why 3 colors?
http://www.cooldic
http://www.cooldi tionary.com/words/Bayer-filter.wikipedia
Slide by Steve Seitz
Practical Color Sensing: Bayer Grid

• Estimate RGB
at ‘G’ cells from
neighboring
values

Slide by Steve Seitz


Original Scene
Bayer Filter Output
Bayer Filter Output (Enlarged)
Bayer Filter Output (After Interpolation)
Both Images
Color Models
• Color Models are useful for driving hardware that generates
or captures images
• Monitors, TVs, video cameras
• Color printers

• Since color sensation can be reproduced by combination of


pure colors, it is simpler to use phosphors and CCD
(charge-couple device) elements that have sharp and
narrow spectra rather than combine overlapping spectra.

• Color models describe in what proportion to combine


these spectra to produce different color impressions.
Additive Color Models
• In monitors, 3 electron beams illuminate phosphors of 3
colors that act as additive light sources.

• The powers of these beams are controlled by the


components of colors described by the R,G,B model
Color Models (RGB Cube)
Additive vs Subtractive Color Models
Number of bits
Example Color Depth

1-bit depth 4-bit depth

8-bit depth 16-bit depth


Resolution
Checkerboard effect
False contouring
Nonuniform sampling
Example
Example
Nonuniform quantization
Image Formation
Lens-less Imaging Systems - Pinhole
Optics
• Projects images
– without lens
– with infinite depth of field
• Smaller the pinhole
– better the focus
– less the light energy from any single point
• Good for tracking solar eclipses
Pinhole Camera (Cont…)
Distant Objects are Smaller
Pinhole Camera (Cont…)
Bigger Hole-More Blurred Images
Lenses Collect More Lights
• With a lens, diverging rays from a scene point are
converged back to an image point
Lens Equation

n: Lens’ Refractive Index


hI: Image Height
ho: Object Height
The negative values for image height indicate that the image is an inverted
image…
Thin Lens
• relates the distance between the scene point being viewed
and the lens to the distance between the lens and the point’s
image (where the rays from that point are brought into focus
by the lens)
• Let M be a point being viewed, p is the distance of M from the
lens along the optical axis.
• The thin lens focuses all the rays from M onto the same point,
the image point m at distance q from the lens.
Thin Lens Equation
• m can be determined by intersecting two known rays
– MQ is parallel to the optical axis, so it must be refracted to pass
through F.
– MO passes through the lens center, so it is not bent.

• Note two pairs of similar triangles


– MSO and Osm (yellow)
– OQF and Fsm (green)
Thin Lens Equation
• As p gets large, q approaches f
• As q approaches f, p approaches infinity
Field of View
• As f gets smaller, image becomes more wide angle (more
world points project onto the finite image plane).
• As f gets larger, image becomes more telescopic (smaller
part of the world projects onto the finite image plane)
According to that MODEL?
Vanishing Point?
Vanishing Point – TWO Points Perspective

vy vx
Optical Power and Accommodation
Optical power of a lens - how strongly the lens bends the
incoming rays
– Short focal length lens bends rays significantly
– It images a point source at infinity (large p) at distance f
behind the lens. The smaller f, the more the rays must be
bent to bring them into focus sooner.
– Optical power is 1/f, with f measured in meters. The unit is
called the diopter
– Human vision: when viewing faraway objects the distance
from the lens to the retina is 0.017m. So the optical power of
the eye is 58.8 diopters
Accommodation
How does the human eye bring nearby points into focus on the
retina?
– by increasing the power of the lens
– muscles attached to the lens change its shape to change the lens
power
– accommodation: adjusting the focal length of the lens
– bringing points that are nearby into focus causes faraway
points to go out of focus
– depth-of-field: range of distances in focus
Accommodation
Physical cameras: mechanically change the distance between
the lens and the image plane
Depth of Field

http://www.cambridgeincolour.com/tutorials/depth-of-field.htm

Slide Credit: A. Efros


Controlling Depth of Field

Changing the aperture size affects depth of field


A smaller aperture increases the range in which
the object is approximately in focus
Diagram: Wikipedia
Controlling Depth of Field

If a smaller aperture makes everything


focused, why don’t we just always use it?

Diagram: Wikipedia
Varying the Aperture

Small aperture = large DOF Large aperture = small DOF


Slide Credit: A. Efros, Photo: Philip Greenspun
Varying the Aperture
Field of View (FOV)

Photo. Material
tan-1 is monotonic increasing.
How can I get the FOV bigger?
Field of View

Slide Credit: A. Efros


Field of View

Slide Credit: A. Efros


Field of View and Focal Length

Large FOV, small f


Camera close to car

Small FOV, large f


Slide Credit: A. Efros, F. Durand Camera far from the car
Field of View and Focal Length

wide-angle standard telephoto

Slide Credit: F. Durand


Dolly Zoom
Change f and distance at the same time

Video Credit: Goodfellas 1990


More Bad News!

• First a pinhole…
• Then a thin lens model….

Slide: L. Lazebnik
Lens Flaws: Radial Distortion
Lens imperfections cause distortions as a function
of distance from optical axis

Less common these days in consumer devices

Photo: Mark Fiala, U. Alberta


Tilt-shift photography
Tilt shift camera

Sensor

Shift Tilt

Sensor

You might also like