Scribd
Upload
1K views

Properties of Task Environment

The document describes various properties of task environments that can affect an agent's behavior and performance. It discusses whether environments are fully or partially observable, deterministic or stochastic, episodic or sequential, static or dynamic, and whether they involve single agents or multiple agents. It also provides examples for each property. The structure of an intelligent agent is described as consisting of an architecture with sensors and actuators, an agent function that maps perceptions to actions, and an agent program that implements the agent function. Finally, it lists different types of agents including simple reflex agents, model-based reflex agents, goal-based reflex agents, utility-based reflex agents, and learning agents.

Uploaded by

Jatadhar
Copyright
© © All Rights Reserved
Available Formats
Download as DOCX, PDF, TXT or read online on Scribd
1K views

Properties of Task Environment

The document describes various properties of task environments that can affect an agent's behavior and performance. It discusses whether environments are fully or partially observable, deterministic or stochastic, episodic or sequential, static or dynamic, and whether they involve single agents or multiple agents. It also provides examples for each property. The structure of an intelligent agent is described as consisting of an architecture with sensors and actuators, an agent function that maps perceptions to actions, and an agent program that implements the agent function. Finally, it lists different types of agents including simple reflex agents, model-based reflex agents, goal-based reflex agents, utility-based reflex agents, and learning agents.

Uploaded by

Jatadhar
Copyright
© © All Rights Reserved
Available Formats
Download as DOCX, PDF, TXT or read online on Scribd
You are on page 1/ 2

Properties Of Task Environment

1] Fully observable Vs Partially Observable.


If an agents sensors give it access to the complete state of the environment at each point in time,
then we say that the task environment is fully observable. A task environment is effectively fully
observable if the sensors detect all aspects that are relevor to the choice of action, relevance
depends on the performance measure. Fully observable environments are convenient because the
agent need not maintain any internal state to keep track of the world. An environment might be
partially observable because of noisy and inaccurate sensors missing from the sensor data.
Example: A vacuum agent with only a local dirt sensor cannot tell whether there is dirt in other
squares.
2] Deterministic Vs stochastic.
If the next state of the environment is completely determined by the current state and the action
executed by the agent then we say the environment is deterministic otherwise it is stochastic.
3] Episodic Vs Sequential.
In an episodic task environment, the agent experience is divided into atomic episodes each
episode consists of the agent perceiving and then performing a single action. Crucially, the next
episode does not depend on the actions taken in previous episodes. In episodic environment, the
choice of action in each episode depends only on the episode itself. Many classification tasks are
episodes.
Example: An agent that has to spot defective parts on an assembly line bases each decision on
the current part, regardless of previous decisions moreover, the current decision doesn’t affect
whether the next part is defective. In sequential environments, the current decision could affect
all future decisions.
Example: Chess and taxi driving are sequential, in both cases, short term actions can have long
term consequences.
Episodic environment are much simpler than sequential environments because the agent does not
need to think ahead.
4] Static Vs Dynamics.
If the environment can change white an agent is delebrating then we say the environment is
dynamic for that agent otherwise, it is static. Static environments are easy to deal with because
the agent need not keep looking at the world while it is deciding on an action, nor need it worry
about the passage of time. Dynamic environments are continuously asking the agent what it
wants to do, if it has not decided yet , that counts as deciding to do nothing. If the environment
itself does not change with the passage of time but the agents performance score does, then we
say the environment is semi dynamic.
Example: Taxi driving is clearly dynamic, the other cars and the taxi itself keep moving while
the driving algorithm dithers about what to do next. Chess when played with a clock is semi
dynamic crossword, puzzles are static.
5] Single Agent Vs Multi Agent.
The distinction between single agent and multi agent environment may seen simple enough.
Example: An agent solving a crossword puzzle by itself is clearly in a single agent chess is in a
two agents environment. Chess is a competitive multi agent environment. In a taxi driving
environment, avoiding collisions maximizes the performance measure. Of all agents, so it is
partially cooperative multi agent environment.

STRUCTURE OF AGENT: The AI structure consists of three main parts: architecture, agent


function, and agent program. Architecture: This refers to machinery or devices that consists of
actuators and sensors. The intelligent agent executes on this machinery.

Agent program is an implementation of an agent function. An agent function is a map from
the percept sequence(history of all that an agent has perceived to date) to an action.

DIFFERENT TYPES OF AGENT:

1) SIMPLE REFLEX AGENT: In artificial intelligence, a simple reflex agent is a type of
intelligent agent that performs actions based solely on the current situation, with
an intelligent agent generally being one that perceives its environment and then acts The
agent cannot learn or take past percepts into account to modify its behavior.
2) MODEL BASED REFLEX AGENT: Model-based reflex agents are made to deal with partial
accessibility; they do this by keeping track of the part of the world it can see now. It
does this by keeping an internal state that depends on what it has seen before so it
holds information on the unobserved aspects of the current state.
3) GOAL BASED REFLEX AGENT:  A Goal-Based Agent is capable of thinking beyond the
present moment to decide the best actions to take in order to achieve its goal.
4) UTILITY BASED REFLEX AGENT: A utility-based agent is an agent that acts based not only on
what the goal is, but the best way to reach that goal. In short, it's the usefulness (or utility) of
the agent that makes itself distinct from its counterparts.
5) LEARNING AGENT: A learning agent is a tool in AI that is capable of learning from its
experiences. Unlike intelligent agents that act on information provided by a
programmer, learning agents are able to perform tasks, analyze performance, and look
for new ways to improve on those tasks - all on their own.

You might also like