Introduction To Natural Language Processing-03-01-2024
Introduction To Natural Language Processing-03-01-2024
Dr. H. K. Azad
Natural Language Processing
• Syllabus–Textbooks
1/24/2024 NLP 3
Motivation for NLP
4
1/24/2024 5
Introduction to Natural Language Processing
(NLP)
• NLP is the intersection of Linguistic Science, Computer
Science and Artificial Intelligence.
• It deals with the processing and understanding of human
languages by computer.
• The process of computer analysis of input provided in
a human language (natural language), and conversion
of this input into a useful form of representation.
• The field of NLP is primarily concerned with getting
computers to perform useful and interesting tasks
with human languages.
• The field of NLP is secondarily concerned with helping
us come to a better understanding of human
language.
1/24/2024 6
Introduction to Natural Language Processing
(NLP)
• A natural language is a human spoken language, such as
English Arabic, French, … etc.
• One of the aims of Artificial Intelligence (AI) is to build
machines that can "understand" commands in natural
language, written or spoken.
1/24/2024 NLP 7
Introduction to Natural Language Processing
(NLP)
• It is not an easy task to teach a person or computer a natural
language.
• The main problems are syntax (the rules governing the way in
which words are arranged), and understanding context to
determine the meaning of a word.
1/24/2024 NLP 8
Introduction to Natural Language Processing (NLP)
1/24/2024 NLP 9
1/24/2024 10
1/24/2024 11
1/24/2024 12
1/24/2024 13
1/24/2024 14
Applications for Natural Language Processing : Summary
• Machine Translation
• Fact Extraction.
• Information Retrieval / Search Engines:
• Retrieval, Categorization, Filtering, Summarization
• Question Answering Systems
• Speech Recognition & Spoken Language Understanding
• Intelligent Tutoring Systems
• Database Query Interfaces
1/24/2024 NLP 15
Major NLP Accomplishments
1/24/2024 NLP 17
NLP Terminology
1/24/2024 18
Processing Stages in NLP System
• Phonological Analysis
• Morphological or Lexical Analysis
• Syntactic Analysis
• Semantic Analysis
• Pragmatic Analysis
1/24/2024 NLP 19
Processing Stages in NLP System
(1) Phonological Analysis
• Phonetics: deals with the physical building blocks of a language
sound system.
Ex. sounds of ‘k’, ‘t’ and ‘e’ in ‘kite’
• Phonology: organization of speech sounds within a language.
Ex. (1) different ‘k’ sounds in ‘kite’ vs ‘coat’
(2) different ‘t’ and ‘p’ sounds in ‘top’ vs ‘pot’
1/24/2024 NLP 20
Five Processing Stages in NLP System
• It is concerned with inflection. (i.e The various forms of the same basic
word. eg. run-ran, dog-dogs, etc)
• It is also concerned with derivation of new words from existing ones, eg.
lighthouse (formed from light & house).
• In NLP, words are also known as lexicon items and a set of words form a
lexicon.
1/24/2024 NLP 21
Processing Stages in NLP System
(2) Morphological Analysis
• Any NL analysis system needs a lexicon {a module that tells what words
there are and what properties they have}.
• Simplest model is a full form dictionary that lists every word explicitly.
• No dictionary contains all the words, one is likely to encounter in real input.
• Noun combination.
1/24/2024 NLP 22
Processing Stages in NLP System
(3)Syntactic Analysis
• Syntactic analysis is concerned with the construction of sentences.
• It involves analysing the meaning of words and phrases to understand the purpose of a
sentence or paragraph.
• Syntactic structure indicates how the words are related to each other.
• Syntax tree is assigned by a grammar and a lexicon. Lexicon indicates syntactic category of
words.
1/24/2024 NLP 23
Processing Stages in NLP System
(4)Semantic Analysis
• Semantic analysis is concerned with the meaning of the languages.
• This stage uses the meanings of the word to extend and perhaps disambiguate the result
returned by the syntactic parse.
• The first step in any semantic processing system is to look up the individual words in a
dictionary (or lexicon) and extract their meanings. Unfortunately, many words have
several meanings, for example, the word ‘diamond’ might have the following set of
meanings:
(1) a geometrical shape with four equal sides.
(2) a baseball field
(3) an extremely hard and valuable gemstone
• To select the correct meaning for the word ‘diamond’ in the sentence John saw Susan's
diamond shining across the room.
1/24/2024 NLP 24
Processing Stages in NLP System
(4)Semantic Analysis
• It is necessary to know that neither geometrical shapes nor baseball fields shimmer,
whereas gemstones do (process of elimination).
• The process of determining the correct meaning of an individual word is call word
sense disambiguation or lexical disambiguation.
• It is done by associating, with each word in the lexicon, information about the
contexts in which each of the word’s senses may appear.
1/24/2024 NLP 25
Processing Stages in NLP System
(5)Pragmatic Analysis
• Pragmatic analysis focuses on the effects of context on meaning.
• An important analysis for understanding texts and dialogues.
• There are many important relationships that may hold between phrases and
parts of their discourse context, as outlined below.
1/24/2024 NLP 26
Thanks
1/24/2024 27