IEC Lab
IEC Lab
ELL832-IEC Lab-II
Submitted By,
Nishtha Phour (2023EEN2763)
Submitted to
Prof. Jayadeva
May 3, 2024
Contents
1 Introduction 3
1.1 Background of CMOS image sensor . . . . . . . . . . . . . . . . . . . . . . . 3
1.2 Imaging System . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 4
1.2.1 CCD Image sensor . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 4
1.2.2 CMOS Image sensor . . . . . . . . . . . . . . . . . . . . . . . . . . . . 5
1.3 Motivation and Objective . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 6
1.4 Outline . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 6
2 Photo-diode 7
2.1 Principle of Operation . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 7
2.2 Modelling of photodiode . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 7
2.3 Capacitor Modelling . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 8
2.3.1 Through diode . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 8
2.3.2 Through Real Capacitor . . . . . . . . . . . . . . . . . . . . . . . . . 9
2.4 Final Modelling . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 11
3 Photo-receptor 12
3.1 Principle of operation . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 12
3.2 Modelling of Photo-receptor . . . . . . . . . . . . . . . . . . . . . . . . . . . 13
3.2.1 Initial Photo-receptor . . . . . . . . . . . . . . . . . . . . . . . . . . . 13
3.2.2 Proposed photo-receptor . . . . . . . . . . . . . . . . . . . . . . . . . 13
5 Comparator 20
5.1 Utilization of Comparator . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 20
1
2
6 Array 32x32 23
7 Results 25
7.1 Photo-diode . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 25
7.2 Photo receptor . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 26
7.3 LMC circuit . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 27
7.4 Pulse detector . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 28
7.5 Array 32x32 . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 29
7.5.1 Analog output . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 29
7.5.2 Digital output . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 30
7.6 Image . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 32
7.6.1 Case 1 . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 32
7.6.2 Case 2 . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 32
8 Conclusion 35
Chapter 1
Introduction
Semiconductors, which are widely used worldwide, are essential in bringing modern soci-
ety into the age of electronics. Moore’s law has caused wafer sizes to increase over the
past 50 years to maintain cost competitiveness. The purpose of this project is to explore
the silicon retina. The main task of this project is to focus on one of the functions of
the human retina, which is detecting motion. In other words, this project is to build a
circuit to detect movement, i.e., optical motion sensor, which uses different photo-diodes
to receive and transmit the light intensity.
3
1.2. IMAGING SYSTEM 4
These days, CMOS image sensors have surpassed CCDs in the majority of fields. As an
integrated technology, a CMOS image sensor provides several functions, quick readout
times, low power consumption, affordability, and several improved qualities. Despite
the superior image capability of CCDs, good performance transistors are challenging to
install using CCD fabrication procedures since these processes are devoted to producing
photo sensor components rather than transistors. Consequently, integrating circuitry
blocks on a CCD chip is quite difficult. But if CMOS imagers can provide imaging
performance comparable to that of the sensor, it is even feasible to integrate all the
necessary functional blocks with the sensor—a camera-on-a-chip—which might greatly
enhance sensor performance and reduce costs. JPL successfully exhibited the first CMOS
image sensor in 1995 [5]. It had circuits for fixed pattern noise reduction, correlated double
sampling, control, and on-chip clocking.
The most advanced CMOS image sensor technology is represented by active pixel sensors,
which are integrated circuits made up of a signal processing unit and a range of pixels.
The next section goes into more depth about them. This article discusses crucial CMOS
image sensor characteristic parameters as well as test procedures for calculating and
assessing them. A CMOS image sensor should ideally have the following characteristics:
no optical cross talk, high frame rate, low noise, linear response, and 100% quantum
efficiency. [6]
by the photodiodes and then successively shifted from one pixel to the next using MOS
capacitors. An amplifier outside the pixel array transforms the electrons into a voltage
that increases linearly with light intensity. The analog signal is subsequently converted
to digital form using an off-chip high-resolution analog-to-digital converter (ADC).
CCD imagers can achieve low noise and full signal maintenance without distortion by
using a specific channel design . Excellent uniformity is promised by the use of a single
electronic conversion chain, which includes the amplifier and ADC, and the passive prin-
ciple of charge transfer. Moreover, a CCD image sensor outperforms a CMOS rival in
terms of homogeneity and fill factor. These benefits have kept CCD sensors at the top of
the high-end imaging market until recently, particularly for applications in science and
medicine.
Nevertheless, the CCD sensors’ maximum speed is limited by the sequential transfer and
readout technique of the electrons in each pixel. A high voltage is applied to the pixel’s
control clock in order to increase the efficiency of charge transfer; this procedure uses
a significant amount of electricity. More importantly, because the CCD image sensor is
incompatible with the CMOS process, system integration is not possible because other
electronics, like an ADC, programmable amplifier, and digital process circuitry, must be
manufactured on a different chip using the CMOS process. It follows that this raises both
the system’s cost and area. The unique charge transfer mechanism increases the mass
production risk that one damaged pixel can ruin the signal capture of the other pixels;
thus the yield of CCD sensor is lower, resulting in the higher cost of CCD sensor.
an in-pixel amplifier, which boosts both the randomaccess mechanism and readout speed.
These days, CMOS image sensors are comparable to their CCD cousin in terms of image
quality. They also provide the advantages of low cost, low power consumption, and
system integration.
1.4 Outline
This thesis is comprised of eight chapters. The organization of the thesis is arranged as
follows.
Chapter 2 gives a literature review. Based on a review of the fundamental principle
of photodetection, an overview of the CMOS image sensors is given. Different pixel
structures aimed for different applications are introduced.
Chapter 3 presents a theoretical analysis 3-T photoreceptor (or pixel structure)
In Chapter 4, based on the analysis of Chapter 3, a LMC circuit is made which basically
mimic the layered structure and connectivity of neural circuits in the biological retina.
In chapter 5, a comparator circuit is made to detect every change or movement.
In Chapter 6, a 4x4 array is made using both photoreceptor, LMC and comparator.
Chapter 7, a 32x32 array is tried.
Chapter 8 discusses about results.
Chapter 9 tells where I concluded my report
Chapter 2
Photo-diode
This chapter gives a brief introduction to the Photo-diode and its modelling.
7
2.3. CAPACITOR MODELLING 8
current of the photodiode. This current flows through the device even in the absence of
light. Although typically minimal, the dark current contributes to the overall behavior
of the photodiode.
Lastly, we include a capacitor in the circuit to account for the junction capacitance of
the photodiode. This capacitance arises due to the formation of a depletion region at the
semiconductor interface. It influences the photodiode’s frequency response and transient
behavior, particularly affecting its response time to changes in incident light.
By employing this simplified equivalent circuit, we aim to understand the photodiode’s
operation, including its response to varying light levels and its interaction with external
electronic circuits. This model serves as a valuable tool for our research endeavors, facili-
tating the design and optimization of photodiode-based systems for applications such as
light sensing, optical communication, and imaging.
However, it’s essential to acknowledge that incorporating a real capacitor into the pho-
todiode model may introduce complexity and increase circuit size and cost compared to
alternative approaches. Discrete capacitor components require additional board space
and may incur higher manufacturing expenses, particularly in high-volume production
scenarios.
In conclusion, while using a real capacitor in photodiode modeling offers advantages in
terms of precision, linearity, and stability, it also presents trade-offs in complexity and
cost. Understanding these considerations is crucial for informed decision-making in the
design and implementation of photodiode-based systems.
2.4. FINAL MODELLING 11
Photo-receptor
Photoreceptors are specialized cells found in the retina of the eye that play a fundamental
role in the visual process. Understanding the principle of operation of photoreceptors is
essential for comprehending the mechanisms underlying vision. This section aims to
elucidate the fundamental principles governing the operation of photoreceptors, focusing
on their response to light stimuli and the generation of neural signals.
12
3.2. MODELLING OF PHOTO-RECEPTOR 13
sium channels, leading to an efflux of potassium ions from the cell. As a result, the
photoreceptor cell’s membrane potential becomes more negative than its resting state.
4. Release of Neurotransmitter: The hyperpolarization of the photoreceptor cell decreases
the release of neurotransmitter molecules, primarily glutamate, at its synaptic terminals.
This modulation of neurotransmitter release alters the signaling to downstream neurons
in the retina, including bipolar cells and horizontal cells, initiating the processing of vi-
sual information.
The operation of photoreceptor cells involves the conversion of light stimuli into electrical
signals through a series of molecular and cellular processes. This electrical signaling is
fundamental to the transmission of visual information within the retina and forms the
basis of visual perception. Further research into the electrical properties of photoreceptor
cells holds promise for advancing our understanding of vision and developing innovative
approaches for restoring sight in individuals with visual impairments.
17
4.1. INITIAL LMC 18
Comparator
Image sensors are vital components in digital imaging devices, converting light signals into
digital data for processing and storage. Comparators, electronic circuits that compare
two analog voltages and produce a digital output based on their relative magnitudes,
play a significant role in the functionality of image sensors. This report examines the
various ways in which comparators are utilized in image sensors and their importance in
achieving accurate and efficient image capture and processing.
20
5.2. INITIAL DESIGN 21
Array 32x32
A 32x32 array of image sensors represents a grid of 1024 individual image sensors ar-
ranged in a 32x32 matrix configuration. Each image sensor within the array functions
as a discrete photodetector, capable of converting incident light into electrical signals for
subsequent processing to LMC and then conversion of analog output from LMC to Dig-
ital output. The use of an array configuration enables simultaneous capture of multiple
images or increased spatial resolution compared to a single sensor.
Following is the modeling of 32x32 array of the image sensor:-
23
24
Results
In this chapter, we’ll look into the results that we have got in previous chapters.
7.1 Photo-diode
The output of photodiode should be in such a way that it should provide current which
will be converted from current to voltage through photo receptor circuit. Photo-diode
will work in reverse bias. There will be a current which will flow to show that there
is an input applied or there is change in intensity. A resistor to allow the transistor to
discharge and a capacitor to model the junction caps of the photodiode.
Figure 7.1 represents photodiode output
25
7.2. PHOTO RECEPTOR 26
7.6 Image
By giving my photoreceptor input, I have simulated the circuit. Then I have exported
my csv file from the waveform. From that csv file, with the help of people working on
image sensor, I am successful in generating a image. Input is present that means output
is white whereas if input is not present then that means light is not present, i.e. absence
of light. So it will represent black colour.
7.6.1 Case 1
In this case, I have given input current to alternative rows and columns.
Figure 7.9 is output image for given input
7.6.2 Case 2
In this case, I have given input current to alternative columns.
Figure 7.10 is output image for given input
7.6. IMAGE 33
Conclusion
In wrapping up our exploration of image sensors, we’ve delved into a realm where pho-
todiodes, photoreceptors, and intricate signal processing, like the Local Maxima Count
(LMC) algorithm, converge to capture and interpret the visual world around us. Our
journey has been one of discovery, uncovering the nuanced interplay between these com-
ponents and their pivotal roles in converting light into meaningful electronic signals.
As we reflect on our findings, it’s clear that image sensors are not mere technological
artifacts; they’re the gatekeepers of vision in our digital age. From the photodiodes at
the heart of each pixel, tirelessly converting photons into electrons, to the photoreceptors
meticulously capturing the nuances of light and shadow, every component plays a crucial
part in the image acquisition process.
But it doesn’t stop there. The journey of light through the image sensor is only the
beginning. With the aid of sophisticated algorithms like the LMC, these raw electronic
signals are transformed into actionable data, enabling tasks as diverse as face recognition,
gesture detection, and pulse monitoring. It’s through this fusion of hardware and soft-
ware that image sensors transcend their physical form, becoming catalysts for innovation
and progress.
Yet, our exploration has also revealed challenges on the horizon. As we push the bound-
aries of sensor technology, issues such as pixel scaling limitations and thermal management
loom large, reminding us of the need for continued research and innovation. But with
each challenge comes opportunity, and the potential to unlock new frontiers in fields as
diverse as healthcare, transportation, and entertainment.
In conclusion, image sensors stand as testament to the ingenuity of human creativity,
bridging the gap between the analog world of light and the digital realm of data. As we
look to the future, let us embrace the possibilities that lie ahead, leveraging the power
35
36
of image sensors to illuminate our world in ways we’ve yet to imagine. After all, in the
dance of photons and electrons, the possibilities are endless, and the journey has only
just begun.
37
References
[1] G. P. Weckler, "Operation of p-n junction photodetectors in a photon flux integrating
mode," IEEE Journal of Solid-State Circuits, vol. 2, pp. 65-73, 1967.
[2] G. Weckler and R. Dyck, "Integrated arrays of silicon photodetectors for image sens-
ing," IEEE Trans. Electron Devices, Vols. ED-15, pp. 196-201, 1968.
[3] P. Noble, "Self-scanned silicon image detector arrays," IEEE Trans. Electron Devices,
Vols. ED-15, pp. 202-209, 1968
[4] D. Renshaw, P. B. Denyer, G. Wang and M. Lu, "ASIC image sensors," IEEE Inter-
national Symposium on Circuits and Systems, vol. 4, pp. 3038-3041, 1990
[5] R. Nixon, "128x128 CMOS Photodiode-Type Active Pixel Sensor with On-Chip Tim-
ing, Control and Signal Chain Electronics," Proceeding of SPIE, vol. 2415, pp. 117-123,
1995.
[6] A. Krymski, D. V. Blerkom, A. Andersson, N. Block, B. Mansoorian and E. R. Fos-
sum, "“A high speed, 500 frames/s, 1024 × 1024 CMOS active pixel sensor," Symp. VLSI
Circuits, p. 137–138, 1999
[7] Liu, Shih-Chii, MinHao Yang, Andreas Steiner, Rico Möckel, and Tobi Delbruck. "1
kHz 2D Visual Motion Sensor Using 20 X 20 Silicon Retina Optical Sensor and DSP Mi-
crocontroller." IEEE Transactions on Biomedical Circuits and Systems 9, no. 2 (2015):
207-216.
[8] Mead, C. (n.d.). Analog VLSI and Neural Systems. Addison Wesley Publishing Com-
pany.
[9] Shih-Chi Liu, "A neuromorphic aVLSI model of global motion processing in the fly,"
in IEEE Transactions on Circuits and Systems II: Analog and Digital Signal Processing,
vol. 47, no. 12, pp. 1458-1467, Dec. 2000, doi: 10.1109/82.899640.
[10] T. Delbruck and C. A. Mead, "Adaptive photoreceptor with wide dynamic range,"
Proceedings of IEEE International Symposium on Circuits and Systems - ISCAS ’94,
London, UK, 1994, pp. 339-342 vol.4, doi: 10.1109/ISCAS.1994.409266.
[11] S. Mehta and R. Etienne-Cummings, "A simplified normal optical flow measurement
CMOS camera," in IEEE Transactions on Circuits and Systems I: Regular Papers, vol.
53, no. 6, pp. 1223-1234, June 2006, doi: 10.1109/TCSI.2006.875169.