NUTAN MAHARASHTRA VIDYA PRASARAK MANDAL’S

NUTAN COLLEGE OF ENGINEERING & RESEARCH (NCER)

Department of Computer Science & Engineering
--------------------------------------------------------------------------------------------------------------------------------------

BTCOE603(B)

Lecture
Topic to be covered
Number

Unit 1: Introduction (06Hrs)

1 ⮚ Introduction, What Is AI?,

⮚ The History of Artificial Intelligence

2

⮚ Agents and Environments Good Behavior

3

⮚ The Concept of Rationality

4

⮚ The Nature of Environments

5

⮚ ,The Structure of Agents.

6

: Submitted by:
Prof. S. B. Mehta

ASST PROF:- S.B.MEHTA NCER, BATU UNIVERSITY, LONERE

 DEPARTMENT OF
COMPUTER SCIENCE
Nutan College Of Engineering &
& ENGINEERING
Research, Talegaon Dabhade, Pune-410507

Artificial Intelligence

Unit 1: Introduction of AI

Artificial Intelligence:
• In today's world, technology is growing very fast, and we are getting in touch with different new
technologies day by day Here, one of the booming technologies of computer science is Artificial
Intelligence which is ready to create a new revolution in the world by making intelligent machines.
• The Artificial Intelligence is now all around us. It is currently working with a variety of subfields,
ranging from general to specific, such as self-driving cars, playing chess, proving theorems, playing
music, Painting, etc.
• One of the greatest innovators in the field of machine learning was John McCarthy, widely
recognized as the "Father of Artificial Intelligence".
• In the mid-1950s, McCarthy coined the term "Artificial Intelligence" and defined it as "the science of
making intelligent machines
• According to the father of Artificial Intelligence, John McCarthy, it is “The science and
engineering of making intelligent machines, especially intelligent computer programs”.
• Artificial Intelligence is a way of making a computer, a computer-controlled robot, or a software
think intelligently, in the similar manner the intelligent humans think.
• AI is accomplished by studying how human brain thinks, and how humans learn, decide, and work
while trying to solve a problem, and then using the outcomes of this study as a basis of developing
intelligent software and systems.
• Artificial Intelligence suggest that machines can mimic humans in:
Talking
Thinking
Learning
Planning
Understanding
• Artificial Intelligence is composed of two words Artificial and Intelligence, where Artificial defines
"man-made," and intelligence defines "thinking power", hence AI means "a man-made thinking
power."

ASST PROF:- S.B.MEHTA NCER, BATU UNIVERSITY, LONERE

 • "It is a branch of computer science by which we can create intelligent machines which can
behave like a human, think like humans, and able to make decisions.

Why Artificial Intelligence:

Before Learning about Artificial Intelligence, we should know that what is the importance of AI and
why should we learn it. Following are some main reasons to learn about AI:

• With the help of AI, you can create such software or devices which can solve real-world problems
very easily and with accuracy such as health issues, marketing, traffic issues, etc.
• With the help of AI, you can create your personal virtual Assistant, such as Cortana, Google
Assistant, Siri, etc.
• With the help of AI, you can build such Robots which can work in an environment where survival of
humans can be at risk.
• AI opens a path for other new technologies, new devices, and new Opportunities.

Goals of Artificial Intelligence

1. It helps you reduce the amount of time needed to perform specific tasks.
2. Making it easier for humans to interact with machines.
3. Facilitating human-computer interaction in a way that is more natural and efficient.
4. Improving the accuracy and speed of medical diagnoses.
5. Helping people learn new information more quickly.
6. Enhancing communication between humans and machines.

Types of Artificial Intelligence

ASST PROF:- S.B.MEHTA NCER, BATU UNIVERSITY, LONERE

 1. Artificial narrow intelligence (ANI), which has a narrow range of abilities;
• Narrow AI is a type of AI which is able to perform a dedicated task with intelligence.The most
common and currently available AI is Narrow AI in the world of Artificial Intelligence.
• Artificial narrow intelligence (ANI), also referred to as weak AI or narrow AI, is the only type of
artificial intelligence we have successfully realized to date. Narrow AI is goal-oriented, designed to
perform singular tasks - i.e. facial recognition, speech recognition/voice assistants, driving a car, or se •
While these machines may seem intelligent, they operate under a narrow set of constraints and
limitations, which is why this type is commonly referred to as weak AI. Narrow AI doesn’t mimic or
replicate human intelligence, it merely simulates human behaviour based on a narrow range of parameters
and contexts.
• Consider the speech and language recognition of the Siri virtual assistant on iPhones, vision
recognition of self-driving cars, and recommendation engines that suggest products you make like based
on your purchase history. These systems can only learn or be taught to complete specific tasks.
• Narrow AI’s machine intelligence comes from the use of natural language processing (NLP) to
perform tasks. NLP is evident in chatbots and similar AI technologies. By understanding speech and text
in natural language, AI is programmed to interact with humans in a natural, personalized manner. Arching
the internet - and is very intelligent at completing the specific task it is programmed to do.
Examples of narrow AI:
• Rankbrain by Google / Google Search
• Siri by Apple, Alexa by Amazon, Cortana by Microsoft and other virtual assistants
• IBM’s Watson
• Image / facial recognition software
• Disease mapping and prediction tools
• Manufacturing and drone robots
• Email spam filters / social media monitoring tools for dangerous content
• Entertainment or marketing content recommendations based on watch/listen/purchase behaviour
• Self-driving cars
2. Artificial General Intelligence (AGI) / Strong AI / Deep AI : which is on par with
human capabilities
•Artificial general intelligence (AGI), also referred to as strong AI or deep AI, is the concept of a
machine with general intelligence that mimics human intelligence and/or behaviors, with the ability to
learn and apply its intelligence to solve any problem. AGI can think, understand, and act in a way that is
indistinguishable from that of a human in any given situation.

ASST PROF:- S.B.MEHTA NCER, BATU UNIVERSITY, LONERE

 •The machines will not require humans to input programming to function. For all intents and purposes,
this would be when machines act, feel, respond and think just like humans. We will be able to say strong
AI has a mind of its own and will be able to accomplish any task it sets out to complete, just like any
human.
•AI researchers and scientists have not yet achieved strong AI. To succeed, they would need to find a
way to make machines conscious, programming a full set of cognitive abilities. Machines would have to
take experiential learning to the next level, not just improving efficiency on singular tasks, but gaining
the ability to apply experiential knowledge to a wider range of different problems.
•Currently, Most AI examples that you hear about- from chess-playing computers, self-driving cars to
understanding speech or text delivered in natural language rely on deep learning and natural
language processing
•Currently, there is no such system exist which could come under general AI and can perform any task as
perfect as a human.
•The worldwide researchers are now focused on developing machines with General AI.
•As systems with general AI are still under research, and it will take lots of efforts and time to develop
such systems
3. Artificial Super intelligence (ASI) : which is more capable than a human
•Artificial super intelligence (ASI), is the hypothetical AI that doesn’t just mimic or understand human
intelligence and behaviour; ASI is where machines become self-aware and surpass the capacity of human
intelligence and ability.
•In addition to replicating the multi-faceted intelligence of human beings, ASI would theoretically be
exceedingly better at everything we do; math, science, sports, art, medicine, hobbies, emotional
relationships, everything. ASI would have a greater memory and a faster ability to process and analyses
data and stimuli. Consequently, the decision-making and problem solving capabilities of super intelligent
beings would be far superior than those of human beings
Artificial Intelligence type-2: Based on functionality

1. Reactive Machines
• Purely reactive machines are the most basic types of Artificial Intelligence.
• This type of machine reacts depending on the present moment .
• Such AI systems do not store memories or past experiences for future actions.
• These machines only focus on current scenarios and react on it as per possible best action.
• IBM's Deep Blue system is an example of reactive machines.
• Google's AlphaGo is also an example of reactive machines
• Example: Chess Player Machine this type of machine greate with playing games has ability to

ASST PROF:- S.B.MEHTA NCER, BATU UNIVERSITY, LONERE

 recognize which move would be best
2. Limited Memory
• Limited memory machines can store past experiences or some data for a short period of time.
• These machines can use stored data for a limited time period only.
• Self-driving cars are one of the best examples of Limited Memory systems. These cars can store
recent speed of nearby cars, the distance of other cars, speed limit, and other information to navigate the
road. E.g Traffic light , chat Robots
3. Theory of Mind
• Theory of Mind AI should understand the human emotions, people, beliefs, and be able to interact
socially like humans.
• This type of AI machines is still not developed, but researchers are making lots of efforts and
improvement for developing such AI machines.
• This type of AI Machine more intelligent as it reacts according to understood people thought &
emotions, these machines can adjust with people around, build social interactions, predict how people
expect to be Treats & thus behave according of these expectations.
• Example : Robot Sofia – Camera present in Sophia’s eves combined with computer algorithms allow
her to see , sustain eye contact , recognize individual & follow faces
4. Self-Awareness
• Self-awareness AI is the future of Artificial Intelligence. These machines will be super intelligent, and
will have their own consciousness, sentiments, and self-awareness.
• These machines will be smarter than human mind. More aware of their needs and internal sense than
human being
• Self-Awareness AI does not exist in reality still and it is a hypothetical concept. Such system
understands their internal traits, states & conditions and perceives human emotion.
• This type of AI will not only be to understand and evoke emotions in those it interact with but also
have emotions, needs and beliefs of it’s own.
History of Artificial Intelligence

ASST PROF:- S.B.MEHTA NCER, BATU UNIVERSITY, LONERE

Maturation of Artificial Intelligence (1943-1952)

o Year 1943: The first work which is now recognized as AI was done by Warren McCulloch and
Walter pits in 1943. They proposed a model of artificial neurons.
o Year 1949: Donald Hebb demonstrated an updating rule for modifying the connection strength
between neurons. His rule is now called Hebbian learning.
o Year 1950: The Alan Turing who was an English mathematician and pioneered Machine learning in
1950. Alan Turing publishes "Computing Machinery and Intelligence" in which he proposed a
test. The test can check the machine's ability to exhibit intelligent behavior equivalent to human
intelligence, called a Turing test.

The birth of Artificial Intelligence (1952-1956)

o Year 1955: An Allen Newell and Herbert A. Simon created the "first artificial intelligence
program"Which was named as "Logic Theorist". This program had proved 38 of 52 Mathematics
theorems, and find new and more elegant proofs for some theorems.
o Year 1956: The word "Artificial Intelligence" first adopted by American Computer scientist John
McCarthy at the Dartmouth Conference. For the first time, AI coined as an academic field.

At that time high-level computer languages such as FORTRAN, LISP, or COBOL were invented. And the
enthusiasm for AI was very high at that time.

The golden years-Early enthusiasm (1956-1974)

o Year 1966: The researchers emphasized developing algorithms which can solve mathematical
problems. Joseph Weizenbaum created the first chatbot in 1966, which was named as ELIZA.
o Year 1972: The first intelligent humanoid robot was built in Japan which was named as WABOT-1.

ASST PROF:- S.B.MEHTA NCER, BATU UNIVERSITY, LONERE

The first AI winter (1974-1980)

o The duration between years 1974 to 1980 was the first AI winter duration. AI winter refers to the
time period where computer scientist dealt with a severe shortage of funding from government for AI
researches.
o During AI winters, an interest of publicity on artificial intelligence was decreased.

A boom of AI (1980-1987)

o Year 1980: After AI winter duration, AI came back with "Expert System". Expert systems were
programmed that emulate the decision-making ability of a human expert.
o In the Year 1980, the first national conference of the American Association of Artificial
Intelligence was held at Stanford University.

The second AI winter (1987-1993)

o The duration between the years 1987 to 1993 was the second AI Winter duration.
o Again Investors and government stopped in funding for AI research as due to high cost but not
efficient result. The expert system such as XCON was very cost effective.

The emergence of intelligent agents (1993-2011)

o Year 1997: In the year 1997, IBM Deep Blue beats world chess champion, Gary Kasparov, and
became the first computer to beat a world chess champion.
o Year 2002: for the first time, AI entered the home in the form of Roomba, a vacuum cleaner.
o Year 2006: AI came in the Business world till the year 2006. Companies like Facebook, Twitter, and
Netflix also started using AI.

Deep learning, big data and artificial general intelligence (2011-present)

o Year 2011: In the year 2011, IBM's Watson won jeopardy, a quiz show, where it had to solve the
complex questions as well as riddles. Watson had proved that it could understand natural language
and can solve tricky questions quickly.
o Year 2012: Google has launched an Android app feature "Google now", which was able to provide
information to the user as a prediction.
o Year 2014: In the year 2014, Chatbot "Eugene Goostman" won a competition in the infamous
"Turing test."
o Year 2018: The "Project Debater" from IBM debated on complex topics with two master debaters
and also performed extremely well.

ASST PROF:- S.B.MEHTA NCER, BATU UNIVERSITY, LONERE

 o Google has demonstrated an AI program "Duplex" which was a virtual assistant and which had taken
hairdresser appointment on call, and lady on other side didn't notice that she was talking with the
machine.

Application of AI
Artificial Intelligence has various applications in today's society. It is becoming essential for today's time
because it can solve complex problems with an efficient way in multiple industries, such as Healthcare,
entertainment, finance, education, etc. AI is making our daily life more comfortable and fast.Following are
some sectors which have the application of Artificial Intelligence:

1. AI in Astronomy
• Artificial Intelligence can be very useful to solve complex universe problems. AI technology can
be helpful for understanding the universe such as how it works, origin, etc.
2. AI in Healthcare:
In the last, five to ten years, AI becoming more advantageous for the healthcare industry and going to
have a significant impact on this industry.
• Healthcare Industries are applying AI to make a better and faster diagnosis than humans. AI can
help doctors with diagnoses and can inform when patients are worsening so that medical help can
reach to the patient before hospitalization.

ASST PROF:- S.B.MEHTA NCER, BATU UNIVERSITY, LONERE

 3. AI in Gaming
• AI can be used for gaming purpose. The AI machines can play strategic games like chess, where
the machine needs to think of a large number of possible places.
4. AI in Finance
• AI and finance industries are the best matches for each other. The finance industry is
implementing automation, chatbot, adaptive intelligence, algorithm trading, and machine learning
into financial processes.
5. AI in Data Security
• The security of data is crucial for every company and cyber-attacks are growing very rapidly in
the digital world. AI can be used to make your data more safe and secure. Some examples such as
AEG bot, AI2 Platform,are used to determine software bug and cyber-attacks in a better way.
6. AI in Social Media
• Social Media sites such as Facebook, Twitter, and Snapchat contain billions of user profiles,
which need to be stored and managed in a very efficient way. AI can organize and manage
massive amounts of data. AI can analyze lots of data to identify the latest trends, hashtag, and
requirement of different users.
7. AI in Travel & Transport
• AI is becoming highly demanding for travel industries. AI is capable of doing various travel
related works such as from making travel arrangement to suggesting the hotels, flights, and best
routes to the customers. Travel industries are using AI-powered chatbots which can make human-
like interaction with customers for better and fast response.
8. AI in Automotive Industry
• Some Automotive industries are using AI to provide virtual assistant to their user for better
performance. Such as Tesla has introduced TeslaBot, an intelligent virtual assistant.
• Various Industries are currently working for developing self-driven cars which can make your
journey more safe and secure.
9. AI in Robotics:
• Artificial Intelligence has a remarkable role in Robotics. Usually, general robots are programmed
such that they can perform some repetitive task, but with the help of AI, we can create intelligent
robots which can perform tasks with their own experiences without pre-programmed.
• Humanoid Robots are best examples for AI in robotics, recently the intelligent Humanoid robot
named as Erica and Sophia has been developed which can talk and behave like humans.
10. AI in Entertainment
• We are currently using some AI based applications in our daily life with some entertainment
services such as Netflix or Amazon. With the help of ML/AI algorithms, these services show the
recommendations for programs or shows.
11. AI in Agriculture
• Agriculture is an area which requires various resources, labor, money, and time for best result.
Now a day's agriculture is becoming digital, and AI is emerging in this field. Agriculture is
applying AI as agriculture robotics, solid and crop monitoring, predictive analysis. AI in
agriculture can be very helpful for farmers.
12. AI in E-commerce
• AI is providing a competitive edge to the e-commerce industry, and it is becoming more
demanding in the e-commerce business. AI is helping shoppers to discover associated products
with recommended size, color, or even brand.
13. AI in education:

ASST PROF:- S.B.MEHTA NCER, BATU UNIVERSITY, LONERE

 • AI can automate grading so that the tutor can have more time to teach. AI chatbot can
communicate with students as a teaching assistant.
• AI in the future can be work as a personal virtual tutor for students, which will be accessible
easily at any time and any place.

AI Examples
Artificial Intelligence Samples:

• Self Driving Cars

• E-Payment
• Google Maps
• Text Autocorrect
• Automated Translation
• Chatbots
• Social Media
• Face Detection
• Search Algorithms
• Robots
• Automated Investment
• NLP - Natural Language Processing
• Flying Drones
• Dr. Watson
• Apple Siri
• Microsoft Cortana
• Amazon Ale

Advantages of Artificial Intelligence

• High Accuracy with less errors: AI machines or systems are prone to less errors and high accuracy
as it takes decisions as per pre-experience or information.
• High-Speed: AI systems can be of very high-speed and fast-decision making, because of that AI
systems can beat a chess champion in the Chess game.
• High reliability: AI machines are highly reliable and can perform the same action multiple times
with high accuracy.
• Useful for risky areas: AI machines can be helpful in situations such as defusing a bomb, exploring
the ocean floor, where to employ a human can be risky.
• Digital Assistant: AI can be very useful to provide digital assistant to the users such as AI
technology is currently used by various E-commerce websites to show the products as per customer
requirement.
• Useful as a public utility: AI can be very useful for public utilities such as a self-driving car which
can make our journey safer and hassle-free, facial recognition for security purpose, Natural language
processing to communicate with the human in human-language, etc.

ASST PROF:- S.B.MEHTA NCER, BATU UNIVERSITY, LONERE

 Disadvantages of Artificial Intelligence

• High Cost: The hardware and software requirement of AI is very costly as it requires lots of
maintenance to meet current world requirements.
• Can't think out of the box: Even we are making smarter machines with AI, but still they cannot
work out of the box, as the robot will only do that work for which they are trained, or programmed.
• No feelings and emotions: AI machines can be an outstanding performer, but still it does not have
the feeling so it cannot make any kind of emotional attachment with human, and may sometime be
harmful for users if the proper care is not taken.
• Increase dependency on machines: With the increment of technology, people are getting more
dependent on devices and hence they are losing their mental capabilities.
• No Original Creativity: As humans are so creative and can imagine some new ideas but still AI
machines cannot beat this power of human intelligence and cannot be creative and imaginative

What are Agent and Environment?

An AI system can be defined as the study of the rational agent and its environment. The agents sense
the environment through sensors and act on their environment through actuators. An AI agent can
have mental properties such as knowledge, belief, intention, etc.

What is an Agent?
An agent can be anything that perceive its environment through sensors and act upon that
environment through actuators. An Agent runs in the cycle of perceiving, thinking, and acting. An
agent can be: An agent is anything that can perceive its environment through sensors and acts upon
that environment through effectors.

• Human-Agent: A human agent has eyes, ears, and other organs which work for sensors and
hand, legs, vocal tract work for actuators.
• Robotic Agent: A robotic agent can have cameras, infrared range finder, NLP for sensors
and various motors for actuators.
• Software Agent: Software agent can have keystrokes, file contents as sensory input and act
on those inputs and display output on the screen. A software agent has encoded bit strings as
its programs and actions.

ASST PROF:- S.B.MEHTA NCER, BATU UNIVERSITY, LONERE

 Hence the world around us is full of agents such as thermostat, cellphone, camera, and even we are also
agents.

Before moving forward, we should first know about sensors, effectors, and actuators.

• Sensor: Sensor is a device which detects the change in the environment and sends the
information to other electronic devices. An agent observes its environment through sensors.
• Actuators: Actuators are the component of machines that converts energy into motion. The
actuators are only responsible for moving and controlling a system. An actuator can be an electric
motor, gears, rails, etc.
• Effectors: Effectors are the devices which affect the environment. Effectors can be legs, wheels,
arms, fingers, wings, fins, and display screen.

Agent Terminology
• Performance Measure of Agent − It is the criteria, which determines how successful an agent is.

• Behavior of Agent − It is the action that agent performs after any given sequence of percepts.

• Percept − It is agent’s perceptual inputs at a given instance.

• Percept Sequence − It is the history of all that an agent has perceived till date.

• Agent Function − It is a map from the precept sequence to an action.

Intelligent Agents:
An intelligent agent is an autonomous entity which acts upon an environment using sensors and
actuators for achieving goals. An intelligent agent may learn from the environment to achieve their
goals. A thermostat is an example of an intelligent agent.

ASST PROF:- S.B.MEHTA NCER, BATU UNIVERSITY, LONERE

 Following are the main four rules for an AI agent:
Rule 1: An AI agent must have the ability to perceive the environment.
Rule 2: The observation must be used to make decisions.
Rule 3: Decision should result in an action.
Rule 4: The action taken by an AI agent must be a rational action.

The Concept of Rationality:

Rationality is nothing but status of being reasonable, sensible, and having good sense of judgment.
Rationality is concerned with expected actions and results depending upon what the agent has
perceived. Performing actions with the aim of obtaining useful information is an important part of
rationality.
The rationality of an agent is measured by its performance measure. Rationality can be judged on the
basis of following points:
• Performance measure which defines the success criterion.
• Agent prior knowledge of its environment.
• Best possible actions that an agent can perform.
• The sequence of percepts.

Rational Agent:
Rational agent is an agent which has clear preference, models uncertainty, and acts in a way to
maximize its performance measure with all possible actions.
• A rational agent is said to perform the right things. AI is about creating rational agents to use for
game theory and decision theory for various real-world scenarios.
• For an AI agent, the rational action is most important because in AI reinforcement learning
algorithm, for each best possible action, agent gets the positive reward and for each wrong
action, an agent gets a negative reward.

An ideal rational agent is the one, which is capable of doing expected actions to maximize its
performance measure, on the basis of −
• Its percept sequence
• Its built-in knowledge base

Rationality of an agent depends on the following −

• The performance measures, which determine the degree of success.
• Agent’s Percept Sequence till now.
• The agent’s prior knowledge about the environment.

ASST PROF:- S.B.MEHTA NCER, BATU UNIVERSITY, LONERE

 • The actions that the agent can carry out.

A rational agent always performs right action, where the right action means the action that causes the
agent to be most successful in the given percept sequence. The problem the agent solves is characterized
by Performance Measure, Environment, Actuators, and Sensors (PEAS).

Agent Environment in AI
An environment is everything in the world which surrounds the agent, but it is not a part of an agent
itself. An environment can be described as a situation in which an agent is present.
The environment is where agent lives, operate and provide the agent with something to sense and act
upon it. An environment is mostly said to be non-feministic.
Type (Features) of Environment
An environment in artificial intelligence is the surrounding of the agent. The agent takes input from the
environment through sensors and delivers the output to the environment through actuators. There are
several types of environmentsStep-1: Select random K data points from the training set.

1. Fully observable vs Partially Observable

2. Static vs Dynamic
3. Discrete vs Continuous
4. Deterministic vs Stochastic
5. Single-agent vs Multi-agent
6. Episodic vs sequential
7. Known vs Unknown
8. Accessible vs Inaccessible

1. Fully observable vs Partially Observable:

• If an agent sensor can sense or access the complete state of an environment at each point of time then
it is a fully observable environment, else it is partially observable.
• A fully observable environment is easy as there is no need to maintain the internal state to keep track
history of the world.
• Maintaining a fully observable environment is easy as there is no need to keep track of the history of
the surrounding.
• An environment is called unobservable when the agent has no sensors in all environments.

Examples:
Chess – the board is fully observable, so are the opponent’s moves.
Driving – the environment is partially observable because what’s around the corner is not known.

ASST PROF:- S.B.MEHTA NCER, BATU UNIVERSITY, LONERE

 2. Deterministic vs Stochastic:
• If When a uniqueness an agent's current state and selected action can completely determine the next
state of the environment, then such environment is called a deterministic environment.
• In a deterministic, fully observable environment, agent does not need to worry about uncertainty.
• The stochastic environment is random in nature which is not unique and cannot be completely
determined by the agent.

Examples:
Chess – there would be only a few possible moves for a coin at the current state and these moves can be
determined.
Self-Driving Cars – the actions of a self-driving car are not unique, it varies time to time.
3. Episodic vs Sequential:
• In an episodic environment, there is a series of one-shot actions, and only the current percept is
required for the action.
• In Episodic task environment, each of the agents action is divided into an atomic incidents or
episodes. There is no dependency between current and previous incident. In each incident agent
receives input from environment and then performs corresponding action.
• Example: Consider an example of Pick and Place robot, which is used to detect defective parts
from conveyer belt. Here, every time robot(agent) will make decision on current part i.e. there is no
dependency between current and previous decision.
• However, in Sequential environment, an agent requires memory of past actions to determine the next
best actions.
• In Sequential environment, previous decision can affect all future decisions. The next action of agent
depends on what action he has taken previously and what action he is supposed to take in future.

Example:
Checkers- Where previous move can affect all the following moves.

4. Single-agent vs Multi-agent
• If only one agent is involved in an environment, and operating by itself then such an environment is
called single agent environment.
• However, if multiple agents are operating in an environment, then such an environment is called a
multi-agent environment.
• The agent design problems in the multi-agent environment are different from single agent
environment consisting of only one agent is said to be a single-agent environment.
• A person left alone in a maze is an example of the single-agent system.

ASST PROF:- S.B.MEHTA NCER, BATU UNIVERSITY, LONERE

 • An environment involving more than one agent is a multi-agent environment.
• The game of football is multi-agent as it involves 11 players in each team.vironment.

5. Static vs Dynamic:
• If the environment can change itself while an agent is deliberating then such environment is called a
dynamic environment else it is called a static environment.
• Static environments are easy to deal because an agent does not need to continue looking at the world
while deciding for an action.
• However for dynamic environment, agents need to keep looking at the world at each action.
• Taxi driving is an example of a dynamic environment whereas Crossword puzzles are an example
of a static environment.
• An environment that keeps constantly changing itself when the agent is up with some action is said
to be dynamic.
• A roller coaster ride is dynamic as it is set in motion and the environment keeps changing every
instant.
• An idle environment with no change in its state is called a static environment.
• An empty house is static as there’s no change in the surroundings when an agent enters.

6. Discrete vs Continuous:
• If in an environment there are a finite number of percepts and actions that can be performed within it,
then such an environment is called a discrete environment else it is called continuous environment.
• A chess game comes under discrete environment as there is a finite number of moves that can be
performed.
• A self-driving car is an example of a continuous environment.
• If an environment consists of a finite number of actions that can be deliberated in the environment to
obtain the output, it is said to be a discrete environment.
• The game of chess is discrete as it has only a finite number of moves. The number of moves might
vary with every game, but still, it’s finite.
• The environment in which the actions performed cannot be numbered i.e.. is not discrete, is said to
be continuous.
• Self-driving cars are an example of continuous environments as their actions are driving, parking,
etc. which cannot be numbered

7. Known vs Unknown
• Known and unknown are not actually a feature of an environment, but it is an agent's state of

ASST PROF:- S.B.MEHTA NCER, BATU UNIVERSITY, LONERE

 knowledge to perform an action.
• In a known environment, the results for all actions are known to the agent. While in unknown
environment, agent needs to learn how it works in order to perform an action.
• It is quite possible that a known environment to be partially observable and an Unknown
environment to be fully observable.
8. Accessible vs Inaccessible
• If an agent can obtain complete and accurate information about the state's environment, then such
an environment is called an Accessible environment else it is called inaccessible.
• An empty room whose state can be defined by its temperature is an example of an accessible
environment.
• Information about an event on earth is an example of Inaccessible environment.

The Structure of Intelligent Agents

The task of AI is to design an agent program which implements the agent function. The
structure of an intelligent agent is a combination of architecture and agent program. It can be viewed
as:

Agent = Architecture + Agent program

Following are the main three terms involved in the structure of an AI agent:

Architecture: Architecture is machinery that an AI agent executes on.

Agent Function: Agent function is used to map a percept to an action.

Agent program: Agent program is an implementation of agent function. An agent program executes
on the physical architecture to produce function f.

Agent’s structure can be viewed as −

• Agent = Architecture + Agent Program

• Architecture = the machinery that an agent executes on.

• Agent Program = an implementation of an agent function.

ASST PROF:- S.B.MEHTA NCER, BATU UNIVERSITY, LONERE

 Types of AI Agents

Agents can be grouped into five classes based on their degree of perceived intelligence and
capability. All these agents can improve their performance and generate better action over the time.
These are given below:

1. Simple Reflex Agent

2. Model-based reflex agent
3. Goal-based agents
4. Utility-based agent
5. Learning agent

1. Simple Reflex agent:

• The Simple reflex agents are the simplest agents. These agents take decisions on the basis of the
current precepts and ignore the rest of the percept history.
• These agents only succeed in the fully observable environment.
• The Simple reflex agent does not consider any part of percepts history during their decision and
action process.

ASST PROF:- S.B.MEHTA NCER, BATU UNIVERSITY, LONERE

 • The Simple reflex agent works on Condition-action rule, which means it maps the current state to
action. Such as a Room Cleaner agent, it works only if there is dirt in the room.
• Problems for the simple reflex agent design approach:
o They have very limited intelligence
o They do not have knowledge of non-perceptual parts of the current state
o Mostly too big to generate and to store.
o Not adaptive to changes in the environment.

2. Model-based reflex agent

• The Model-based agent can work in a partially observable environment, and track the situation.
• A model-based agent has two important factors:
o Model: It is knowledge about "how things happen in the world," so it is called a Model-based
agent.
o Internal State: It is a representation of the current state based on percept history.
• These agents have the model, "which is knowledge of the world" and based on the model they
perform actions.
• Updating the agent state requires information about:
o How the world evolves
o How the agent's action affects the world.

ASST PROF:- S.B.MEHTA NCER, BATU UNIVERSITY, LONERE

 3. Goal-based agents

• The knowledge of the current state environment is not always sufficient to decide for an agent to
what to do.
• The agent needs to know its goal which describes desirable situations.
• Goal-based agents expand the capabilities of the model-based agent by having the "goal"
information.
• They choose an action, so that they can achieve the goal.
• These agents may have to consider a long sequence of possible actions before deciding whether
the goal is achieved or not. Such considerations of different scenario are called searching and
planning, which makes an agent proactive.

4. Utility-based agents

ASST PROF:- S.B.MEHTA NCER, BATU UNIVERSITY, LONERE

 • These agents are similar to the goal-based agent but provide an extra component of utility
measurement which makes them different by providing a measure of success at a given state.
• Utility-based agent act based not only goals but also the best way to achieve the goal.
• The Utility-based agent is useful when there are multiple possible alternatives, and an agent has
to choose in order to perform the best action.
• The utility function maps each state to a real number to check how efficiently each action
achieves the goals.
5. Learning Agents

ASST PROF:- S.B.MEHTA NCER, BATU UNIVERSITY, LONERE

 • A learning agent in AI is the type of agent which can learn from its past experiences, or it has
learning capabilities.
• It starts to act with basic knowledge and then able to act and adapt automatically through learning.
• A learning agent has mainly four conceptual components, which are:
o Learning element: It is responsible for making improvements by learning from environment
o Critic: Learning element takes feedback from critic which describes that how well the agent
is doing with respect to a fixed performance standard.
o Performance element: It is responsible for selecting external action
o Problem generator: This component is responsible for suggesting actions that will lead to
new and informative experiences.
• Hence, learning agents are able to learn, analyse performance, and look for new ways to improve the
performance.

(Subject In-charge)
Prof.S.B.Mehta)

ASST PROF:- S.B.MEHTA NCER, BATU UNIVERSITY, LONERE