Scribd
Upload
10 views3 pages

Quiz#1 to prepare for Ads tedt

The document outlines different types of environments in relation to agents, categorizing them as fully or partially observable, deterministic or stochastic, episodic or sequential, static or dynamic, discrete or continuous, and single or multiagent. It provides examples for each category, such as vacuum cleaners and taxi drivers, to illustrate the concepts. Part B requires the identification of environment characteristics for specific scenarios, including flying a helicopter, solving a crossword puzzle, and using a mathematics assistant.

Uploaded by

jamsbdndjhahalid
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd
10 views3 pages

Quiz#1 to prepare for Ads tedt

The document outlines different types of environments in relation to agents, categorizing them as fully or partially observable, deterministic or stochastic, episodic or sequential, static or dynamic, discrete or continuous, and single or multiagent. It provides examples for each category, such as vacuum cleaners and taxi drivers, to illustrate the concepts. Part B requires the identification of environment characteristics for specific scenarios, including flying a helicopter, solving a crossword puzzle, and using a mathematics assistant.

Uploaded by

jamsbdndjhahalid
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd
You are on page 1/ 3

Quiz#1

Part A
Environmental Types

1. Fully observable vs. partially observable:

• An environment is fully observable if an agent's sensors


give it access to the complete state of the environment at
each point in time.
• Fully observable environments are convenient, because the
agent need not maintain any internal state to keep track of
the world
• An environment might be partially observable because of
noisy and inaccurate sensors or because parts of the state
are simply missing from the sensor data
• Examples: vacuum cleaner with local dirt sensor, taxi
driver

2. Deterministic vs. stochastic:

• The environment is deterministic if the next state of the


environment is completely determined by the current state
and the action executed by the agent.
• In principle, an agent need not worry about uncertainty in a
fully observable, deterministic environment
• If the environment is partially observable then it could
appear to be stochastic

Examples: Vacuum world is deterministic while taxi driver


is not
• If the environment is deterministic except for the actions of
other agents, then the environment is strategic

3. Episodic vs. sequential:

• In episodic environments, the agent's experience is divided


into atomic "episodes" (each episode consists of the agent
perceiving and then performing a single action), and the
choice of action in each episode depends only on the
episode itself.
• Examples: classification tasks

• In sequential environments, the current decision could


affect all future decisions
• Examples: chess and taxi driver
4. Static vs. dynamic:

• The environment is unchanged while an agent is deliberating.


• Static environments are easy to deal with because the agent need not
keep looking at the world while it is deciding on the action or need it
worry about the passage of time
• Dynamic environments continuously ask the agent what it wants to do
• The environment is semi-dynamic if the environment itself does not
change with the passage of time but the agent's performance score
does
• Examples: taxi driving is dynamic, chess when played with a clock is
semi-dynamic, crossword puzzles are static

5. Discrete vs. continuous:

• A limited number of distinct, clearly defined states, percepts and


actions.
• Examples: Chess has finite number of discrete states, and has
discrete set of percepts and actions. Taxi driving has continuous
states, and actions

6. Single agent vs. multiagent:

• An agent operating by itself in an environment is single agent


• Examples: Crossword is a single agent while chess is two-agents
• Examples: Chess is a competitive multiagent environment while taxi
• driving is a partially cooperative multiagent environment

Part B

Write the environment characteristics of the following

1. Flying a Helicopter from one point to another


2. Crossword Puzzle
3. Mathematics Assistant.

Answer:
1. Fully Stochastic Sequential Dynamic Continuous Single
2. Fully Deterministic Sequential Static Discrete Single
3. Fully Deterministic Sequential Semi Discrete Multi

You might also like