Natural Language Processing
Natural Language Processing
LANGUAGE
PROCESSING
S
CONTENT
TABLE OF
01 INTRODUCTION
02 WHAT IS NLP?
03 EVOLUTION OF NLP
05 APPLICATIONS OF NLP
TABLE OF
S
CONTENT NLP USE CASES
06
IMPORTANCE OF NLP
07
BENEFITS OF NLP
08
INDUSTRIES USING NLP
09
SIX IMPORTANT MODELS OF NLP 10
S
CONTENT
TABLE OF
PROGRAMMING LANGUAGES,
11 LIBRARIES, AND
FRAMEWORKS FOR NLP
13 CONCLUSION
Can you Guess?
X T T E
Written or spoken content.
Can you Guess?
T E X T
Written or spoken content.
Can you Guess?
YN I DA TRO I C
D I C T I ON A R Y
A RMG A RM
Rules for sentence structure.
Can you Guess?
GR AMMA R
Rules for sentence structure.
Can you Guess?
T O B A T C H
A program designed to simulate conversation
with human users.
Can you Guess?
C H A T B O T
A program designed to simulate conversation
with human users.
Can you Guess?
T ANE T S L RA
To convert text from one language to another.
Can you Guess?
TRANS L A T E
To convert text from one language to another.
Introduction
01
Natural Language Processing (NLP) is
one of the hottest areas of artificial
intelligence (AI) thanks to applications
like text generators that compose
coherent essays, chatbots that fool
people into thinking they’re sentient,
and text-to-image programs that produce
photorealistic images of anything you
can describe.
N
INTRODUCTIO
Recent years have brought a revolution in the ability of
computers to understand human languages, programming languages,
and even biological and chemical sequences, such as DNA and protein
structures, that resemble language. The latest AI models are unlocking
these areas to analyze the meanings of input text and generate
meaningful, expressive output.
02 What is NLP?
Natural language processing
(NLP) is a branch of artificial
intelligence (AI) that enables
computers to comprehend,
generate, and manipulate
human language.
NLP uses either rule-based or machine learning approaches to understand the
structure and meaning of text. It plays a role in chatbots, voice assistants, text-based
scanning programs, translation applications and enterprise software that aids in business
operations, increases productivity and simplifies different processes.
A branch of artificial intelligence (AI), NLP lies at the heart of applications and devices
that can:
NLP
EVOLUTION OF
Natural language processing has its NLP was largely rules-based, using handcrafted
roots in this decade, when Alan rules developed by linguists to determine how
Turing developed the Turing Test to computers would process language. The
determine whether or not a computer Georgetown-IBM experiment in 1954 became a
is truly intelligent. The test involves notable demonstration of machine translation,
automated interpretation and the automatically translating more than 60 sentences
generation of natural language as a from Russian to English. The 1980s and 1990s
criterion of intelligence. saw the development of rule-based parsing,
morphology, semantics and other forms of natural
language understanding.
1990s 2000-2020s
The top-down, language-first approach to natural language Natural language processing saw dramatic growth
processing was replaced with a more statistical approach because in popularity as a term. NLP processes using
advancements in computing made this a more efficient way of unsupervised and semi-supervised machine learning
developing NLP technology. Computers were becoming faster and algorithms were also explored. With advances in
could be used to develop rules based on linguistic statistics
without a linguist creating all the rules. Data-driven natural
computing power, natural language processing has
language processing became mainstream during this decade. also gained numerous real-world applications. NLP
Natural language processing shifted from a linguist-based also began powering other applications like
approach to an engineer-based approach, drawing on a wider chatbots and virtual assistants. Today, approaches to
variety of scientific disciplines instead of delving into linguistics. NLP involve a combination of classical linguistics
and statistical methods.
How does NLP
work?
04
NLP work?
How does
Natural language processing includes many different
techniques for interpreting human language, ranging from statistical
and machine learning methods to rules-based and algorithmic
approaches. We need a broad array of approaches because the text-
and voice-based data varies widely, as do the practical applications.
Basic NLP tasks include tokenization and parsing,
lemmatization/stemming, part-of-speech tagging, language detection
and identification of semantic relationships.
How does NLP work?
A linguistic-based document summary,
including search and indexing, content alerts CONTENT
and duplication detection. CATEGORIZATION
IMPROVE SEARCH
NLP can improve on keyword matching search for document and FAQ retrieval by
disambiguating word senses based on context (for example, “carrier” means
something different in biomedical and industrial contexts), matching synonyms (for
example, retrieving documents mentioning “car” given a search for “automobile”),
and taking morphological variation into account (which is important for non-
English queries). Effective NLP-powered academic search systems can
dramatically improve access to relevant cutting-edge research for doctors, lawyers,
and other specialists.
of NLP
Applications
SEARCH ENGINE
OPTIMIZATION
NLP is a great tool for getting your business ranked
higher in online search by analyzing searches to
optimize your content. Search engines use NLP to rank
their results—and knowing how to effectively use
these techniques makes it easier to be ranked above
your competitors. This will lead to greater visibility for
your business.
MARKET INSIGHTS
With NLP working to analyze the language of your business’
customers, you’ll have a better handle on what they want, and also a
better idea of how to communicate with them. Aspect-oriented
sentiment analysis detects the sentiment associated with specific
aspects or products in social media (for example, “the keyboard is
great, but the screen is too dim”), providing directly actionable
information for product design and marketing.
of NLP
Applications
MODERATING CONTENT
If your business attracts large amounts of
user or customer comments, NLP enables
you to moderate what’s being said in order
to maintain quality and civility by analyzing
not only the words, but also the tone and
intent of comments.
NLP Use Cases
06
NLP Use Cases Spam Detection
You may not think of spam detection as an NLP solution, but the
best spam detection technologies use NLP's text classification capabilities
to scan emails for language that often indicates spam or phishing. These
indicators can include overuse of financial terms, characteristic bad
grammar, threatening language, inappropriate urgency, misspelled company
names, and more. Spam detection is one of a handful of NLP problems that
experts consider 'mostly solved' (although you may argue that this doesn’t
match your email experience).
NLP Use Cases
Machine Translation
07 Matter?
Businesses use large amounts of
unstructured, text-heavy data and need
a way to efficiently process it. Much
of the information created online and
stored in databases is natural human
language, and until recently,
businesses couldn't effectively
analyze this data. This is where
natural language processing is useful.
Matter?
Why does NLP
The advantages of natural language processing can be seen
when considering the following two statements: "Cloud computing
insurance should be part of every service-level agreement" and "A
good SLA ensures an easier night's sleep -- even in the cloud." If a user
relies on natural language processing for search, the program will
recognize that cloud computing is an entity, that cloud is an
abbreviated form of cloud computing, and that SLA is an industry
acronym for service-level agreement.
NLP is an integral part of everyday life and becoming more so as
language technology is applied to diverse fields like retailing (for instance, in
customer service chatbots) and medicine (interpreting or summarizing
electronic health records). Conversational agents such as Amazon’s Alexa and
Apple’s Siri utilize NLP to listen to user queries and find answers. The most
sophisticated such agents — such as GPT-3, which was recently opened for
commercial applications — can generate sophisticated prose on a wide variety
of topics as well as power chatbots that are capable of holding coherent
conversations. Google uses NLP to improve its search engine results, and social
networks like Facebook use it to detect and filter hate speech.
Matter?
Why does NLP
NLP is growing increasingly sophisticated, yet
much work remains to be done. Current systems are prone to
bias and incoherence, and occasionally behave erratically.
Despite the challenges, machine learning engineers have
many opportunities to apply NLP in ways that are ever more
central to a functioning society.
08
BENEFITS OF NLP
Benefits of NLP
Offers improved Enables an
accuracy and organization to
efficiency of use chatbots for
documentation. customer support.
09
Using NLP
Industries
HEALTHCARE LEGAL
As healthcare To prepare for a case,
systems all over the lawyers must often spend
hours examining large
world move to
collections of documents
electronic medical and searching for
records, they are material relevant to a
encountering large specific case. NLP
amounts of technology can automate
unstructured data. the process of legal
discovery, cutting down
NLP can be used to
on both time and human
analyze and gain error by sifting through
new insights into large volumes of
health records. documents.
Using NLP
Industries
CUSTOME
R
FINANCE SERVICE
The financial world moves Many large
extremely fast, and any companies are using
competitive advantage is
virtual assistants or
important. In the financial
field, traders use NLP chatbots to help
technology to answer basic
automatically mine customer inquiries
information from and information
corporate documents and requests (such as
news releases to extract
FAQs), passing on
information relevant to
their portfolios and trading complex questions
decisions. to humans when
necessary.
Using NLP
Industries
INSURANCE
Large insurance companies are using NLP to sift through
documents and reports related to claims, in an effort to
streamline the way business gets done.
Six Important
Models of NLP
Over the years, many NLP models have
made waves within the AI community,
and some have even made headlines in
the mainstream news. The most famous
of these have been chatbots and
10
language models
NLP Models
Six Important
Eliza
Was developed in the mid-1960s to try to
solve the Turing Test; that is, to fool
people into thinking they’re conversing
with another human being rather than a
machine. Eliza used pattern matching and
a series of rules without encoding the
context of the language.
Tay
A chatbot that Microsoft launched in 2016. It
was supposed to tweet like a teen and learn
from conversations with real users on Twitter.
The bot adopted phrases from users who
tweeted sexist and racist comments, and
Microsoft deactivated it not long afterward.
Tay illustrates some points made by the
“Stochastic Parrots” paper, particularly the
danger of not debiasing data.
NLP Models
Six Important
BERT
and his Muppet friends: Many deep
learning models for NLP are named after
Muppet characters, including ELMo,
BERT, Big BIRD, ERNIE, Kermit, Grover,
RoBERTa, and Rosita. Most of these
models are good at providing contextual
embeddings and enhanced knowledge
representation.
Generative Pre-Trained
Transformer 3 (GPT-3)
NLP Models
Six Important
Applications (LaMDA)
a conversational chatbot developed by Google. LaMDA is a
transformer-based model trained on dialogue rather than the usual
web text. The system aims to provide sensible and specific
responses to conversations. Google developer Blake Lemoine
came to believe that LaMDA is sentient. Lemoine had detailed
conversations with AI about his rights and personhood. During one
of these conversations, the AI changed Lemoine’s mind about Isaac
Asimov’s third law of robotics. Lemoine claimed that LaMDA was
sentient, but the idea was disputed by many observers and
commentators. Subsequently, Google placed Lemoine on
administrative leave for distributing proprietary information and
ultimately fired him.
Mixture of Experts
(MoE)
While most deep learning models use the same
set of parameters to process every input, MoE
models aim to provide different parameters for
different inputs based on efficient routing
algorithms to achieve higher performance.
Switch Transformer is an example of the MoE
approach that aims to reduce communication and
computational costs.
Other common
examples of NLP
OF NLP
OTHER EXAMPLES
Google translate Siri and Alexa Grammarly
Google Translate is a widely- Apple's Siri and Amazon's Alexa Grammarly is a writing
used translation service that are virtual assistants that use voice assistant that helps with
converts text and speech recognition to perform tasks like grammar, punctuation, and
from one language to another setting reminders, playing music, style suggestions.
in real time. and answering questions.
11 Languages, Libraries,
And Frameworks For
Natural Language
Processing (NLP)
Many languages and libraries
support NLP.
● Python is the most-used programming language to tackle NLP tasks.
Most libraries and frameworks for deep learning are written for Python. Programming
Here are a few that practitioners may find helpful: Languages, Libraries
And Frameworks For
○ Natural Language Toolkit (NLTK) is one of the first NLP
NLP
libraries written in Python. It provides easy-to-use interfaces to
corpora and lexical resources such as WordNet. It also provides a
suite of text-processing libraries for classification, tagging,
stemming, parsing, and semantic reasoning.
13 N
Natural Language Processing (NLP)
stands at the forefront of artificial
intelligence, driving innovations that
transform our interactions with
technology. From its historical roots
in the 1950s to the sophisticated
applications we see today, NLP has
evolved significantly, leveraging
advances in computational power and
machine learning.
This evolution has enabled a wide array of
CONCLUSION
applications, from improving customer service through
chatbots to enhancing search engine results, translating
languages, and analyzing social media sentiment. NLP's
impact extends across various industries, including
healthcare, finance, legal, and customer service, where
it automates processes, enhances decision-making, and
extracts valuable insights from vast amounts of
unstructured data.
S
REFERENCE
2. https://www.sas.com/en_ph/insights/analytics/what-is-natural-language-processing-nlp.html
3. https://www.deeplearning.ai/resources/natural-language-processing/
4. https://www.oracle.com/ph/artificial-intelligence/what-is-natural-language-processing/
5.
https://www.techtarget.com/searchenterpriseai/definition/natural-language-processing-NLP#:~:text=N
atural%20language%20processing%20(NLP)%20is,in%20the%20field%20of%20linguistics
.
6. https://www.ibm.com/topics/natural-language-processing
7. https://youtu.be/CMrHM8a3hqw?si=Mi-0ewZ6IYbXYqrI
8. https://youtu.be/d4gGtcobq8M?si=V6ElGNhHegwTPZfx