CHAPTER ONE


INTRODUCTION
To
 Contents
Definition of AI
Goal of AI 
Approaches of AI
Types of AI
Foundation of AI
History and state of art
Application of AI
Defi nition of AI

“Intelligence: T h e ability to learn and solve problems”
Webster’s Dictionary.
“Artificial intelligence ( A I ) is the intelligence exhibited
by machines or software’
Wikipedia.
“ T h e science and engineering of making intelligent
machines”
McCarthy.

“ T h e study and design of intelligent agents, where an

intelligent agent is a system t h a t perceives its environment
and takes actions t h a t maximize its chances of success.”
Russel and Norvig AI book
 Why AI?
“ Just

as the Industrial Revolution freed up a lot of
humanity from physical work, I think A I has the potential
to free up humanity from a lot of the mental work.”
Andrew Ng
The Goal of AI
 Implementing human intelligence in machine
 To develop problem solving ability
 To allow learning continuously
 To encourage social intelligence and promote creativity
 A p p r o a c h o f AI
Four schools of thoughts that help us to have clear and
concise understanding on AI

Thinking humanly  Thinking rationally

“The exciting new e↵ort to “The study of mental faculties
make
computers think... machines through the use of computational
with
minds, in the full and literal sense.” models.” (Charniak and McDermott,
(Haugeland, 1985) 1985

Acting humanly Acting rationally

“The study of how to make “Computational Intelligence is the
com-
puters do things which, at the mo- study of the design of intelligent
ment, people are better.” (Rich agents.” (Poole et al., 1998)
and
Knight, 1991)
 Approaches of
AI..
Thinking humanly: cognitive approach

Requires to determine how humans think!

1960’s “cognitive revolution”.
Requires scientific theories of internal
activities of the brain
• What level of abstraction?
“Knowledge” or “circuits”?
• How to validate?

Today, Cognitive Science and Artificial Intelligence

are distinct disciplines.
 Approaches of
AI..
Acting humanly:

• Turing

test (Alan Turing 1 9 5 0 ) : A computer passes
the test of intelligence, if it can fool a human interrogator.

Credit: From Russel and Norvig slides.

• Major components of AI: knowledge, reasoning,

language, understanding, learning.
 Approaches of
AI..
Thinking rationally: Laws of thoughts .
• Codify “right thinking” with logic.

• Several Greek schools developed various forms of logic:notation
and rules of derivation for thoughts.
• Problems:
1. Not all knowledge can be expressed with logical notations.
2. Computational blow up.
 Approaches of
AI..
Acting rationally:

• The

right thing: that which is expected maximize goal
to achievement, given the available information.

• A rational agent is one that acts so as to achieve the best

outcome, or when there is uncertainty, the best expected out-
come.

• Aristotle (Nicomachean Ethics):

“Ever y art and every inquiry, and similarly every action
and pursuit, is thought t o aim at some go o d .”
 Types of AI


AI can be broadly divided into two categories:
 AI based on capability and AI based on
functionality.
Foundation of AI

 Foundation of AI
• Philosophy


– Logic, methods of reasoning.
– Mind as physical system that operates as a set of rules.
– Foundations of learning, language, rationality.
• Mathematics
– Logic: Formal representation and proof.
– Computation, algorithms.
– Probability.
• Economics
– Formal theory of rational decisions.
– Combined decision theory and probability theory for decision
making under uncertainty.
– Game theory.
– Markov decision processes.
 Foundation of AI
• Neuroscience
– How do brains process information?

– Study of brain functioning.
– How brains and computers are (dis)similar.
• Psychology
– How do we think and act?
– Cognitive psychology perceives the brain as an information
processing machine.
– Led to the development of the field cognitive science: how
could computer models be used to study language,
memory, and thinking from a psychological perspective.
• Computer engineering
– Cares about how to build powerful machines to make AI
possible.
– E.g., Self-driving cars are possible today thanks to advances in
computer engineering.
 Foundation of AI
• Control theory and cybernetics


• How can artifacts operate under their own
control?
– Design simple optimal agents receiving feedback from the
environment.
– Modern control theory design systems that maximize
an objective function over time.
• Linguistics
• How does language relate to thought?
– How are language and thinking related.
– Modern linguistics + AI = Computational linguistics
(Nat- ural language processing).
 History of AI
• 1940-1950: Gestation of AI
– McCulloch & Pitts: Boolean circuit to model of brain
– Turing’s Computing Machinery and Intelligence
• 1 9 5 0 - 1970: Early enthusiasm, great expectations
– Early AI programs, Samuel’s checkers program
– Birth of AI @ Dartmouth meeting 1956.
• 1 9 7 0 - 1990: Knowledge-based AI
– Expert systems, AI becomes an industry
– AI winter
 History of AI

– Neural Networks:

• 1990- present: Scientific approaches
le retour
– The emergence of intelligent agents

– AI becomes “scientific”, use of probability to model uncer-

tainty
– AI Spring!
– The availability of very large datasets.
 Data will drive future discoveries and alleviate the
com- plexity in AI.
 S t a t e - of-the- art
applications
• Speech recognition • Fraud detection
• Autonomous and • Recommendation systems
planning scheduling
• Financial forecasting
• Game playing, video games
 • Web search engines
• Autonomous cars
• Energy optimization
• Spam fighting • Question answering
• Logistics planning systems
• Robotics (household, surgery, • Social network analysis
navigation) • Medical diagnosis, imaging
• Machine translation • Route finding
• Information extraction • Traveling salesperson
• V LSI layout • Protein design
• Automatic assembly • Document summarization
• Sentiment analysis • Transportation/scheduling
• Computer animation
M a n y more!
 Applications of AI
Speech recognition
• Virtual assistants:

Siri (Apple),
Echo (Amazon), Google Now, Cor-
tana (Microsoft).

• “They” helps get things done: send an

email, make an appointment, find a
restaurant, tell you the weather and
more.

• Leverage deep neural networks to handle

speech recognition and natural
language understanding .
 Applications of AI
Handwriting recognition (check, zipcode )


 Applications of AI
Machine translation

• Historical motivation: translate Russian to English.

• First systems using mechanical translation (one-

to-one cor- respondence) failed!
• “Out of sight, out of mind” “Invisible, imbecile”.
 Applications of AI
Machine translation

• M T has gone through ups and downs.

• Today, Statistical Machine Translation leverages the vast

amounts of available translated corpuses.

• While there is room for improvement, machine translation has

made significant progress.
 Applications of AI
Machine translation: Google translator with 1 0 0 +
languages

 Applications of AI
Robotics: Awesome robots today! NAO, ASIMO, and more!

Credit: By Momotarou2012, via Wikimedia Commons.

 Applications of AI
Recommendation systems (collaborative filtering)

Applications of AI

 Search engines

Applications of AI

 Applications of AI
Email


 Applications of AI
Face detection

Viola-Jones m e t h o d .
 Applications of AI
Face detection

Viola-Jones m e t h o d .
 Applications of AI
Face recognition


 Applications of AI
Detection of breast cancer in mammography images

Applications of AI

 Applications of AI
Chess ( 1 9 9 7 ) : Kasparov vs. I B M Deep Blue

(Left) Copyright 2007, S.M.S.I., Inc. - Owen Williams, The Kasparov Agency, via Wikimedia

Commons (Right) By James the photographer, via Wikimedia Commons

Powerful search algorithms!

 Applications of AI
Jeopardy! ( 2 0 11 ) : H u man s vs. I B M Wa t s o n

By Rosemaryetoufee (Own work), via Wikimedia Commons

Natural Language Understanding and information extraction!

 Applications of AI
Go ( 2 0 1 6 ) : Lee Sedol versus Google AlphaGo

(Left) By L G Electronics, via Wikimedia Commons (Right) By Google DeepMind, via

Wikimedia Commons

Deep Learning, reinforcement learning, and search algorithms!

Autonomous driving

By User Spaceape on en.wikipedia, via Wikimedia Commons

• DARPA Grand Challenge

– 2005: 132 miles
– 2007: Urban challenge
– 2009: Google self-driving car
 Summary

• AI is a hard (computational complexity, language, vision, etc),
and a broad field with high impact on humanity and society.
• What can AI do for us is already amazing!
• AI systems do not have to model human/nature but can act
like or be inspired by human/nature.
• How human think is beyond the scope of this course.
• Rational (do the right thing) agents are central to our
approach of AI.
• Note that rationality is not always possible in complicated
en- vironment but we will still aim to build rational agents.
 Summary
• AI may be perceived as a scary area! Is AI a threat to our
humankind?

• Professor Stephen Hawking, eminent scientist told BBC:
“ T h e development of full artificial intelligence
could spell the end of the human race.”
• AI is a flourishing and exciting field: everyone can contribute.
• Looking forward for an exciting journey together!
 
Read Assignment : History and application
of AI