Unit-I ADAS
Unit-I ADAS
Unit I :
Introduction to ADAS
by
9/8/2023 2/70
Role of electronics in Automobile
Q.?
9/8/2023 3/70
Role of Electronics in Automobile
• Electronics play a crucial role in modern automobiles,
contributing to various aspects of vehicle functionality, safety,
efficiency, and comfort.
• The integration of electronics in automobiles has led to
significant advancements and improvements in the automotive
industry. Some key roles of electronics in automobiles include:
– Engine Control Unit (ECU)
– Safety Systems
– Infotainment and Connectivity
– Advanced Driver Assistance Systems (ADAS)
9/8/2023 4/70
Role of Electronics in Automobile
– Telematics
– Electric and Hybrid Vehicles
– Climate Control
– Lighting Systems
– Instrumentation and Displays
9/8/2023 5/70
Trends and Automatic Vehicle
Q. -5M
9/8/2023 6/70
Trends and Automatic Vehicle
• Advancements in Sensor Technology
• Artificial Intelligence and Machine Learning
• Connectivity and V2X Communication
• Autonomous Fleets and Mobility Services
• Regulation and Policy
• Simulations and Testing
• Partnerships and Collaborations
• Safety and Cybersecurity
• Incremental Automation
9/8/2023 7/70
Introduction to ADAS
Q.?
9/8/2023 8/70
Introduction to ADAS
9/8/2023 9/70
Introduction to ADAS
9/8/2023 10/70
General Block Diagram
Q. – 6M
9/8/2023 11/70
General Block Diagram of ADAS
Perception
Environment Processing and
(Information
(Outside or Sensors Decision
extraction from
inside Vehicle) Making
sensor data)
Actuation
9/8/2023 12/70
9/8/2023 13/70
Types of ADAS
9/8/2023 14/70
Types of ADAS
9/8/2023 15/70
Types of ADAS
1. Passive ADAS systems:
• In a passive ADAS system, the computer alerts the driver to a
dangerous circumstance despite the number or kind of sensors
deployed. The motorist must take steps to avoid an accident caused by
this circumstance.
• Typical warning systems include sirens, flashing lights, and, in some
cases, tactile input, such as a steering wheel that vibrates to alert the
driver that the zone they are entering is already taken by another car
(blind spot detection). The driver receives critical information that
allows him to make the best judgments on the road. Passive ADAS
provides real-time data about the driving environment and alerts
about possible risks via a human-machine interface (HMI).
• The data is transmitted in three modes: visual, auditory, and haptic.
Visual and audio alerts have traditionally been employed extensively
in the architecture of ADAS data presentation. Visual cues are
intuitive and may be used to transmit various messages using
symbolic information and color. This is the primary approach for
information distribution. Systems can show visual warnings on a
vehicle’s dashboard or center panel. However, doing so could induce
‘eye-off-road’ gaps in driver concentration.
9/8/2023 16/70
Types of ADAS
2. Active ADAS systems:
• The car takes active steps in these ADAS systems. To avoid worst-case
scenarios, the vehicle can take action on its own. Automatic
emergency braking (AEB) detects an impending accident and applies
the brakes without the driver’s assistance. Functional features include
adaptive cruise control (ACC), lane-keeping assist (LKA), lane
centering (LC), and traffic jam assist.
• In the event of a slower vehicle in its path, the Active ADAS System
automatically changes the host car’s speed from its pre-set setting (as
in regular cruise control). LKA and LC guide the vehicle automatically
to keep it inside the lane borders. Under traffic congestion situations,
traffic jam assist is a mix of adaptive cruise control (ACC) and lane
centering (LC). These automated elements serve as the foundation for
semi/fully autonomous vehicles.
9/8/2023 17/70
Importance of ADAS
9/8/2023 18/70
Importance of ADAS
• Adaptive Cruise Control (ACC)
• Rear Cross Traffic Alert (RCTA)
• Vehicle Exit Alert
• Front Cross Traffic Alert
• Forward Collision Warning
• Blind Spot Detection
• Parking Assistance System
• Intelligent Head Light Control
• Occupant Protection System
• Pedestrian Protection System
• Evasive Steering Support.
9/8/2023 19/70
Importance of ADAS
1. Automates the enhancement of safety systems
Automated adoption and upgrades of safety initiatives enhance driving
populations. ADAS is aimed to prevent collisions by warning drivers of
potential dangers or taking control of the vehicle to avoid them.
2. Actions adaptive features
Automated illumination, pedestrian collision avoidance mitigation (PCAM),
and adaptive cruise control are navigation systems that warn drivers of
possible threats, including cars in blind areas, lane departures, and others.
3. Helps in the perception of traffic context
The driver is in the center of the traffic-driver-vehicle cycle. The driver
perception system receives traffic situation as input, which causes it to
operate as a stimulus of the driver’s intention. Knowing the present traffic
scenario will therefore improve the intention inference system.
9/8/2023 20/70
Importance of ADAS
4. Understands and analyzes driving behavior
Before making a lane change, the most crucial signals are driver actions such
as checking mirrors. Before changing lanes, the driver must go through a
series of checks to ensure they are entirely aware of the situation. As a result,
driving behavior analysis is critical for determining driver intent. To anticipate
driver lane-changing intention, it is essential to comprehend the process of
human intention, including how the purpose is produced and what the
intention’s triggers are. The nature of driver intention is the first issue that
one must address.
5. Provides solutions for predictive maintenance
Predictive technology analyses hazards and sends data via the cloud to inform
customers of any vehicle problem by merging cloud computing, edge
computing, data collecting from sensors, and analytics. In-vehicle sensors are
fitted to monitor metrics such as fuel level, tire pressure, engine status,
navigation route, speed, temperature, and so on to alert the user of any
repair concerns and assure safety. Many maintenance difficulties may be
avoided by anticipating and setting performance targets ahead of time.
9/8/2023 21/70
Role of ADAS in Autonomous Vehicle
9/8/2023 22/70
Role of ADAS towards Autonomous Driving
(SAE 6 Levels of Driving Automation)
Q. -4M
9/8/2023 23/70
Role of ADAS in Autonomous Vehicle
Is ADAS autonomous driving?
• Many people use the terms “ADAS” and “autonomous
driving” interchangeably, but they are not actually the
same thing.
• ADAS stands for Advanced Driver Assistance Systems,
which is a suite of technologies that help drivers stay
safe on the road. These systems include features like lane
departure warning, adaptive cruise control, collision
avoidance systems and much more.
• The majority of cars are now equipped with these
features. For example, 30% of all vehicles have Automatic
Emergency Braking, whereas 13% come standard with
Lane Keeping As Adaptive Cruise Control is standard on
11% of cars. The number of cars with ADAS is only going
to increase in the future as more and more automakers
make these features standard on their vehicles.
9/8/2023 24/70
Role of ADAS in Autonomous Vehicle
9/8/2023 25/70
Role of ADAS in Autonomous Vehicle
9/8/2023 26/70
ARM 11 - Features
9/8/2023 27/70
ARM 11 - Features
9/8/2023 28/70
6 Levels of Driving Automation
• The SAE has thus defined 6 different levels of
autonomous driving:
1. Level 0: no driving automation
2. Level 1: driver assistance
3. Level 2: partial driving automation
4. Level 3: conditional driving automation
5. Level 4: high driving automation
6. Level 5: full driving automation
9/8/2023 29/70
•
6 Levels of Driving
Level 0: no driving automation
Automation
• As the title suggests at this level the vehicle possesses no automated
driving features, but that doesn’t necessarily exclude driver assistance
features. Indeed, the driving experience is entirely in the hands of the
driver, but the vehicle is equipped with a system which provides
momentary driving assistance, such as warning signals or emergency
safety actions. The driver therefore must drive the vehicle and monitor
any possible warnings or safety activities, and thus the driver is
responsible for braking, steering, accelerating etc. The following
technologies come under this category:
• ABS
• ESP
• cruise control
• blind spot warning
• automatic emergency braking
• frontal collision warning
• lane departure warning
• Driving is 100% manual. Example : 1967 Porche 911s
9/8/2023 30/70
6 Levels of Driving Automation
• Level 1: driver assistance
• Moving up one level, we are now talking about vehicles equipped with a
system which supplies constant assistance during acceleration, braking
and steering, whilst the driver is both involved and attentive.
• Also in this instance therefore, the driver has the task of driving the
vehicle and monitoring the system, which however - if activated - can
perform steering, acceleration and braking functions.
• Here are some examples of technologies installed in Level 1 vehicles:
– electronic adaptive speed regulator, or adaptive cruise control
– lane keeping assistance or lane centring assistance
– Compared to Level 0, these vehicles offer greater support to the driver, who however
must always play an active role in driving.
9/8/2023 31/70
6 Levels of Driving Automation
• Level 2: partial driving automation
• Level 2 applies to a large share of the autonomous vehicles that are on the
market today.
• They are equipped with advanced driving assistance systems (ADAS), and
this provides continual assistance both regarding acceleration/braking and
in steering, whilst the driver is 100% attentive and involved with the
possibility however of handing over control of combined longitudinal and
lateral functions.
• When active, the system can control steering, acceleration and braking.
Still, levels 0, 1 and 2 require the driver to be involved and aware, and
constantly monitoring the functionality of the support features offered by
the systems installed.
• Example : Tesla Autopilot
9/8/2023 32/70
6 Levels of Driving Automation
• Level 3: conditional driving automation
• At Level 3 we are definitely at a more advanced level, which is not
widespread in the market yet, and offers conditional driving automation
functions, whenever the driver allows the system to take over.
• Simply put, that means that when activated the system carries out all
aspects of the driving functions, however the driver must be seated in the
driver’s position and ready to take control when necessary or requested.
9/8/2023 33/70
6 Levels of Driving Automation
• Level 4: high driving automation
• The essential difference between Level 3 and Level 4 lies in the fact that
the systems which vehicles at this level are equipped with are able to
intervene in the instance of a malfunction without necessarily involving
the driver.
• The driver however, still has the power to take control of the vehicle
manually.
9/8/2023 34/70
6 Levels of Driving Automation
• Level 5: full driving automation
• Level 5 vehicles, according to SAE classification, reach the very highest
level of automation due the advanced technologies employed.
9/8/2023 35/70
Role of ADAS in Autonomous vehicle
• Adaptive Cruise Control (ACC)
• Rear Cross Traffic Alert (RCTA)
• Vehicle Exit Alert
• Front Cross Traffic Alert
• Forward Collision Warning
• Blind Spot Detection
• Parking Assistance System
• Intelligent Head Light Control
• Occupant Protection System
• Pedestrian Protection System
• Evasive Steering Support.
9/8/2023 36/70
Some terms and definitions
• Ego Vehicle
• Ego Coordinate System
• Target Vehicle
• Target Coordinate System
• Sensor Filed of View (SFOV)
• Sensor Coordinate System
9/8/2023 37/70
Integration of
ADAS Technology into Vehicle Electronics
9/8/2023 38/70
Integration of
ADAS Technology into Vehicle Electronics
9/8/2023 39/70
Automotive Electronics
• Automotive electronics are electronic systems used in vehicles,
including engine management, ignition, radio, carputers, telematics, in-car
entertainment systems, and others.
• Ignition, engine and transmission electronics are also found
in trucks, motorcycles, off-road vehicles, and other internal
combustion powered machinery such
as forklifts, tractors and excavators. Related elements for control of
relevant electrical systems are also found on hybrid vehicles and electric
cars.
• Electronic systems have become an increasingly large component of the
cost of an automobile, from only around 1% of its value in 1950 to around
30% in 2010.
• Modern electric cars rely on power electronics for the main propulsion
motor control, as well as managing the battery system.
Future autonomous cars will rely on powerful computer systems, an
array of sensors, networking, and satellite navigation, all of which will
require electronics.
9/8/2023 40/70
Automotive Electronics
9/8/2023 41/70
9/8/2023 42/70
Sensors
1. Crank Sensor
2. Cam sensor
3. Coolant Temperature Sensor
4. Accelerator pedal Sensor/ Throttle Position Sensors
5. Manifold Absolute Position Sensor (MAP)
6. Air mass flow (HFM)
7. Vehicle Speed Sensor
8. Oxygen Sensor
9. Parking Sensor
10. TPMS (Tyre Pressure Monitoring System) sensor
11. Wheel Speed Sensor (WSS)
12. Fuel Level Sensor
13. Ambient Temperature Sensor
14. Air Pressure
15. GPS
9/8/2023 43/70
1. Typically Displays
Clusters
2. Vehicle speed
3. Engine Speed
4. Coolant Temperature
5. Fuel Level
6. Oil Pressure
7. Battery Voltage
8. Distance Covered
9. Status of Head Lamp Indication
10. Status of Indicators Lamps
Market Trends
• Instrument clusters with 3D dials preferred
• Stepper motor-driven clusters are being used predominantly
• Increasing penetration of digital Instrument Clusters
• Increased number of telltales
• TFT Displays • Colored LCD displays
• Integrated displays
9/8/2023 44/70
9/8/2023 45/70
9/8/2023 46/70
Automotive Electronics
9/8/2023 47/70
9/8/2023 48/70
9/8/2023 49/70
9/8/2023 50/70
9/8/2023 51/70
9/8/2023 52/70
9/8/2023 53/70
Why is communication needed in automotive
systems?
• Right from vehicle startup till the driver leaves the car, all
the subsystems continuously transmit their status to, as well
as receive data from, other subsystems necessary to perform
a task. This is what enables, for example, the hazard lights on
the dashboard lighting up when a door is not properly closed.
9/8/2023 54/70
Communication Protocol importance
9/8/2023 55/70
What are the different communication
protocols available at this time?
The different protocols available can broadly be categorized into 3
types:
Datalink protocols: Datalink protocols take care of the physical
layer implementation. UART (serial port communication protocol),
SPI (serial peripheral interface), I2C, LIN (Local Interconnect
Network), CAN (Control Area Network, 90% of all vehicles use
CAN for their communication), Flex-Ray and Ethernet. (which are
used for higher bandwidth communication, used primarily in
relationship with surround sound systems and dashcams)
Application protocols: They use datalink protocols as the
underlying layer. UDS (used for diagnostics, uses CAN as the data
link), J1939, CAN-Open, MOST(used for media-related
communication, used over CAN)
Other protocols: Bluetooth, Wi-Fi, USB, 4G/5G (Vehicle2Network
- V2X)
9/8/2023 56/70
9/8/2023 57/70
9/8/2023 58/70
9/8/2023 59/70
9/8/2023 60
9/8/2023 61/70
9/8/2023 62/70
9/8/2023 63/70
9/8/2023 64/70
9/8/2023 65/70
9/8/2023 66/70
9/8/2023 67/70
9/8/2023 68/70
9/8/2023 69/70
9/8/2023 70/70
9/8/2023 71/70
• Automotive Ethernet - Previously mentioned automotive
networking protocols don’t offer everything vehicles might
need. Present-day vehicles require vehicle-to-everything
(V2X) connectivity along with greater bandwidth.
• Automotive Ethernet protocol satisfies automotive networking
demands and is widely adopted by the automotive industry.
• The automotive Ethernet is a fast four-wire standard
communication protocol that offers protection for in-vehicle
systems.
• Automotive Ethernet offers a cost-effective, lightweight
communication solution in automobiles using single
unshielded twisted-pair (UTP) cabling.
9/8/2023 72/70
9/8/2023 73/70
9/8/2023 74/70
Can you give me a concrete example to
demonstrate how this stuff works?
• To take an example, consider the case study of reverse
parking. The moment the car is put in reverse, the rear-view
camera will be activated and the camera module will start
recording data. The camera module is connected to Park
Assist ECU using Ethernet. Now, Park Assist provides the
live video feed over Ethernet to Infotainment or Instrument
Cluster for displaying to the driver. As part of this, it also
provides an overlay to the live feed: “We are ten minutes
away from crashing into the curb” or some such.
• Ethernet is chosen because a huge amount of data shall be
sent continuously.
• The network design has to be chosen with respect to the
network packaging, how we want to send the data.
9/8/2023 75/70
Non-Passenger Car Advanced
Driver Assistance Systems and
Autonomous Operation
9/8/2023 76/70
Non-Passenger Car Advanced Driver Assistance
Systems and Autonomous Operation
Passenger Vehicle:
• Passenger vehicle means a motor vehicle (other than a
motor cycle or invalid carriage) constructed solely for the
carriage of passengers and their effects.
Non-Passenger Vehicle:
• Non-passenger vehicle means any vehicle used primarily
to perform a work task while incidentally transporting
individuals and their equipment from one location to
another location.
9/8/2023 77/70
Non-Passenger Car Advanced Driver Assistance
Systems and Autonomous Operation
Non-Passenger Car ADAS:
• Non-passenger car ADAS (Advanced Driver Assistance
Systems) refers to a set of technologies and features
designed to enhance safety, improve efficiency, and assist
drivers in vehicles other than traditional passenger cars.
9/8/2023 78/70
Non-Passenger Car Advanced Driver Assistance
Systems and Autonomous Operation
Some common non-passenger car ADAS features include:
1. Adaptive Cruise Control (ACC): This feature automatically
adjusts the vehicle's speed to maintain a safe following
distance from the vehicle ahead, especially useful for long-
haul trucks and buses on highways.
2. Lane-Keeping Assistance: This system helps drivers stay
within their lane by providing gentle steering inputs or
warning alerts if the vehicle starts to drift unintentionally.
3. Blind Spot Monitoring (BSM): BSM uses sensors to detect
vehicles in the blind spots and alerts the driver if it's unsafe
to change lanes.
4. Automatic Emergency Braking (AEB): AEB can detect
potential collisions and automatically apply the brakes to
mitigate or avoid accidents, especially important for large
and heavy vehicles.
9/8/2023 79/70
Non-Passenger Car Advanced Driver Assistance
Systems and Autonomous Operation
5.Collision Avoidance Systems: These systems can detect
potential collisions with other vehicles, pedestrians, or objects
and take proactive measures to avoid accidents or reduce the
severity of impact.
6.Driver Fatigue Monitoring: Using various sensors, cameras,
and algorithms, this system monitors the driver's behavior for
signs of fatigue or distraction and alerts them to take a break if
necessary.
7.Traffic Sign Recognition: The system recognizes and interprets
traffic signs (e.g., speed limits, stop signs) and displays them to
the driver, reducing the likelihood of unintentional traffic
violations.
9/8/2023 80/70
Non-Passenger Car Advanced Driver Assistance
Systems and Autonomous Operation
8. Semi-Autonomous Features: Some non-passenger car ADAS
may have semi-autonomous capabilities, such as automated
parking assistance or highway driving assistance, where the
vehicle can handle specific tasks with limited driver
intervention.
9. Vehicle Stability Control: This system helps maintain stability
during cornering or slippery road conditions, essential for
large vehicles with high centers of gravity.
10. Telematics and Fleet Management: Many commercial
vehicle ADAS systems incorporate telematics technology to
provide real-time data on vehicle performance, location, and
driver behavior, allowing for efficient fleet management and
monitoring.
9/8/2023 81/70
Intelligent Vehicles
9/8/2023 82/70
Intelligent Vehicles
9/8/2023 83/70
Intelligent Vehicles
Definition:
• An intelligent vehicle, also known as a smart vehicle or
connected vehicle, refers to an automobile that is
equipped with advanced technologies, sensors, and
communication systems to enhance safety, convenience,
and overall driving experience.
9/8/2023 84/70
Intelligent Vehicles
Working:
The working of an intelligent vehicle involves the integration of
various advanced technologies and systems that work together
to enhance safety, efficiency, and convenience for the driver and
passengers. Here's a general overview of how an intelligent
vehicle operates:
1.Sensors and Perception: Intelligent vehicles are equipped with
a variety of sensors, such as cameras, radar, lidar (Light Detection
and Ranging), ultrasonic sensors, and other environmental
sensors. These sensors continuously monitor the vehicle's
surroundings, collecting data about road conditions, obstacles,
other vehicles, pedestrians, and traffic signs.
9/8/2023 85/70
Intelligent Vehicles
9/8/2023 86/70
Intelligent Vehicles
9/8/2023 87/70
Intelligent Vehicles
6. Autonomous Capabilities: In more advanced intelligent vehicles,
when operating in conditions suitable for autonomous driving, the
vehicle's computer takes full control of the driving task. It uses the
data from sensors and advanced algorithms to navigate, avoid
obstacles, follow traffic rules, and make real-time decisions
without human intervention.
7. Human-Machine Interface (HMI): The vehicle's HMI provides the
driver with information about the vehicle's status, navigation
instructions, and alerts from ADAS features. It allows the driver to
interact with the vehicle through touchscreens, voice commands,
and other intuitive controls.
8. Cybersecurity and Safety: Intelligent vehicles prioritize
cybersecurity to protect against potential hacking and
unauthorized access to critical systems. Safety is paramount, and
the vehicle continuously monitors the system's performance and
sensor reliability to ensure safe operation.
9/8/2023 88/70
Intelligent Vehicles
• An intelligent vehicle is also commonly referred to as an
autonomous vehicle.
• While not all intelligent vehicles are fully autonomous, they may
include some level of autonomous capabilities depending on the
integration of ADAS technologies.
9/8/2023 89/70
Which cars have ADAS feature?
9/8/2023 91/70
Questions
➢ Why is communication needed in automotive systems?
➢ What are the different communication protocols available at
this time?
➢ What are the career paths available to an engineer in the
automotive communication protocol domain?
➢ What are the leading Protocol Stack companies?
➢ What are the job roles available in the automotive
communication protocol domain?
9/8/2023 92/70
Thank You!!!
9/8/2023 93/70