0% found this document useful (0 votes)
22 views

Natural Language Processing

Natural Language Process Presentation

Uploaded by

juboysabulao
Copyright
© © All Rights Reserved
Available Formats
Download as PPTX, PDF, TXT or read online on Scribd
0% found this document useful (0 votes)
22 views

Natural Language Processing

Natural Language Process Presentation

Uploaded by

juboysabulao
Copyright
© © All Rights Reserved
Available Formats
Download as PPTX, PDF, TXT or read online on Scribd
You are on page 1/ 73

NATURAL

LANGUAGE
PROCESSING
S
CONTENT
TABLE OF
01 INTRODUCTION

02 WHAT IS NLP?

03 EVOLUTION OF NLP

04 HOW DOES NLP WORK?

05 APPLICATIONS OF NLP
TABLE OF

S
CONTENT NLP USE CASES
06
IMPORTANCE OF NLP
07
BENEFITS OF NLP
08
INDUSTRIES USING NLP
09
SIX IMPORTANT MODELS OF NLP 10
S
CONTENT
TABLE OF
PROGRAMMING LANGUAGES,
11 LIBRARIES, AND
FRAMEWORKS FOR NLP

12 CONTROVERTIES USING NLP

13 CONCLUSION
Can you Guess?

X T T E
Written or spoken content.
Can you Guess?

T E X T
Written or spoken content.
Can you Guess?

YN I DA TRO I C

Collection of word meanings.


Can you Guess?

D I C T I ON A R Y

Collection of word meanings.


Can you Guess?

A RMG A RM
Rules for sentence structure.
Can you Guess?

GR AMMA R
Rules for sentence structure.
Can you Guess?

T O B A T C H
A program designed to simulate conversation
with human users.
Can you Guess?

C H A T B O T
A program designed to simulate conversation
with human users.
Can you Guess?

T ANE T S L RA
To convert text from one language to another.
Can you Guess?

TRANS L A T E
To convert text from one language to another.
Introduction

01
Natural Language Processing (NLP) is
one of the hottest areas of artificial
intelligence (AI) thanks to applications
like text generators that compose
coherent essays, chatbots that fool
people into thinking they’re sentient,
and text-to-image programs that produce
photorealistic images of anything you
can describe.
N
INTRODUCTIO
Recent years have brought a revolution in the ability of
computers to understand human languages, programming languages,
and even biological and chemical sequences, such as DNA and protein
structures, that resemble language. The latest AI models are unlocking
these areas to analyze the meanings of input text and generate
meaningful, expressive output.
02 What is NLP?
Natural language processing
(NLP) is a branch of artificial
intelligence (AI) that enables
computers to comprehend,
generate, and manipulate
human language.
NLP uses either rule-based or machine learning approaches to understand the
structure and meaning of text. It plays a role in chatbots, voice assistants, text-based
scanning programs, translation applications and enterprise software that aids in business
operations, increases productivity and simplifies different processes.

A branch of artificial intelligence (AI), NLP lies at the heart of applications and devices
that can:

• translate text from one language to another


• respond to typed or spoken commands
• recognize or authenticate users based on voice
• summarize large volumes of text
• assess the intent or sentiment of text or speech
• generate text or graphics or other content on demand
03
EVOLUTION OF NLP
1950s 1950s-1990s

NLP
EVOLUTION OF
Natural language processing has its NLP was largely rules-based, using handcrafted
roots in this decade, when Alan rules developed by linguists to determine how
Turing developed the Turing Test to computers would process language. The
determine whether or not a computer Georgetown-IBM experiment in 1954 became a
is truly intelligent. The test involves notable demonstration of machine translation,
automated interpretation and the automatically translating more than 60 sentences
generation of natural language as a from Russian to English. The 1980s and 1990s
criterion of intelligence. saw the development of rule-based parsing,
morphology, semantics and other forms of natural
language understanding.

1990s 2000-2020s
The top-down, language-first approach to natural language Natural language processing saw dramatic growth
processing was replaced with a more statistical approach because in popularity as a term. NLP processes using
advancements in computing made this a more efficient way of unsupervised and semi-supervised machine learning
developing NLP technology. Computers were becoming faster and algorithms were also explored. With advances in
could be used to develop rules based on linguistic statistics
without a linguist creating all the rules. Data-driven natural
computing power, natural language processing has
language processing became mainstream during this decade. also gained numerous real-world applications. NLP
Natural language processing shifted from a linguist-based also began powering other applications like
approach to an engineer-based approach, drawing on a wider chatbots and virtual assistants. Today, approaches to
variety of scientific disciplines instead of delving into linguistics. NLP involve a combination of classical linguistics
and statistical methods.
How does NLP
work?

04
NLP work?
How does
Natural language processing includes many different
techniques for interpreting human language, ranging from statistical
and machine learning methods to rules-based and algorithmic
approaches. We need a broad array of approaches because the text-
and voice-based data varies widely, as do the practical applications.
Basic NLP tasks include tokenization and parsing,
lemmatization/stemming, part-of-speech tagging, language detection
and identification of semantic relationships.
How does NLP work?
A linguistic-based document summary,
including search and indexing, content alerts CONTENT
and duplication detection. CATEGORIZATION

BERT-based classification is used to capture


the context and meaning of words in a text to LARGE LANGUAGE
improve accuracy compared to traditional MODEL (LLM)-BASED
models. CLASSIFICATION

Understand corpus and document structure through


output statistics for tasks such as sampling
effectively, preparing data as input for further CORPUS ANALYSIS
models and strategizing modeling approaches.
How does NLP work?
CONTEXTUAL Automatically pull structured information
from text-based sources.
EXTRACTION

Identifying the mood or subjective opinions


within large amounts of text, including
SENTIMENT
average sentiment and opinion mining.
ANALYSIS

SPEECH-TO-TEXT AND Transforming voice commands into written


TEXT-TO-SPEECH text, and vice versa.
CONVERSION
How does NLP work?
Automatically generating synopses of large
bodies of text and detect represented languages DOCUMENT
in multi-lingual corpora (documents). SUMMARIZATION

Automatic translation of text or speech from MACHINE


one language to another. TRANSLATION
Applications of NLP
Natural language processing is the
driving force behind machine
intelligence in many modern real-
world applications.
05
of NLP
Applications
AUTOMATE ROUTINE TASKS
Chatbots powered by NLP can process a large number
of routine tasks that are handled by human agents
today, freeing up employees to work on more
challenging and interesting tasks. For example,
chatbots and Digital Assistants can recognize a wide
variety of user requests, match them to the appropriate
entry in a corporate database, and formulate an
appropriate response to the user.

IMPROVE SEARCH
NLP can improve on keyword matching search for document and FAQ retrieval by
disambiguating word senses based on context (for example, “carrier” means
something different in biomedical and industrial contexts), matching synonyms (for
example, retrieving documents mentioning “car” given a search for “automobile”),
and taking morphological variation into account (which is important for non-
English queries). Effective NLP-powered academic search systems can
dramatically improve access to relevant cutting-edge research for doctors, lawyers,
and other specialists.
of NLP
Applications
SEARCH ENGINE
OPTIMIZATION
NLP is a great tool for getting your business ranked
higher in online search by analyzing searches to
optimize your content. Search engines use NLP to rank
their results—and knowing how to effectively use
these techniques makes it easier to be ranked above
your competitors. This will lead to greater visibility for
your business.

ANALYZING AND ORGANIZING LARGE


DOCUMENT COLLECTIONS
NLP techniques such as document clustering and topic modeling
simplify the task of understanding the diversity of content in large
document collections, such as corporate reports, news articles, or
scientific documents. These techniques are often used in legal
discovery purposes.
of NLP
Applications
SOCIAL MEDIA ANALYTICS
NLP can analyze customer reviews and social media
comments to make better sense of huge volumes of
information. Sentiment analysis identifies positive and
negative comments in a stream of social-media
comments, providing a direct measure of customer
sentiment in real time. This can lead to huge payoffs
down the line, such as increased customer satisfaction
and revenue.

MARKET INSIGHTS
With NLP working to analyze the language of your business’
customers, you’ll have a better handle on what they want, and also a
better idea of how to communicate with them. Aspect-oriented
sentiment analysis detects the sentiment associated with specific
aspects or products in social media (for example, “the keyboard is
great, but the screen is too dim”), providing directly actionable
information for product design and marketing.
of NLP
Applications
MODERATING CONTENT
If your business attracts large amounts of
user or customer comments, NLP enables
you to moderate what’s being said in order
to maintain quality and civility by analyzing
not only the words, but also the tone and
intent of comments.
NLP Use Cases
06
NLP Use Cases Spam Detection
You may not think of spam detection as an NLP solution, but the
best spam detection technologies use NLP's text classification capabilities
to scan emails for language that often indicates spam or phishing. These
indicators can include overuse of financial terms, characteristic bad
grammar, threatening language, inappropriate urgency, misspelled company
names, and more. Spam detection is one of a handful of NLP problems that
experts consider 'mostly solved' (although you may argue that this doesn’t
match your email experience).
NLP Use Cases
Machine Translation

Google Translate is an example of widely available NLP technology at


work. Truly useful machine translation involves more than replacing words in one
language with words of another. Effective translation has to capture accurately the
meaning and tone of the input language and translate it to text with the same meaning
and desired impact in the output language. Machine translation tools are making good
progress in terms of accuracy. A great way to test any machine translation tool is to
translate text to one language and then back to the original. An oft-cited classic
example: Not long ago, translating “The spirit is willing but the flesh is weak” from
English to Russian and back yielded “The vodka is good but the meat is rotten.”
Today, the result is “The spirit desires, but the flesh is weak,” which isn’t perfect, but
inspires much more confidence in the English-to-Russian translation.
NLP Use Cases Virtual Agents and Chatbots
Virtual agents such as Apple's Siri and Amazon's Alexa use
speech recognition to recognize patterns in voice commands and natural
language generation to respond with appropriate action or helpful
comments. Chatbots perform the same magic in response to typed text
entries. The best of these also learn to recognize contextual clues about
human requests and use them to provide even better responses or options
over time. The next enhancement for these applications is question
answering, the ability to respond to our questions—anticipated or not—with
relevant and helpful answers in their own words.
NLP Use Cases
Social Media Sentiment Analysis

NLP has become an essential business tool for


uncovering hidden data insights from social media channels.
Sentiment analysis can analyze language used in social media
posts, responses, reviews, and more to extract attitudes and
emotions in response to products, promotions, and events–
information companies can use in product designs, advertising
campaigns, and more.
NLP Use Cases
Text Summarization
Text summarization uses NLP techniques to digest huge
volumes of digital text and create summaries and synopses for
indexes, research databases, or busy readers who don't have time to
read full text. The best text summarization applications use
semantic reasoning and natural language generation (NLG) to add
useful context and conclusions to summaries.
Why does NLP

07 Matter?
Businesses use large amounts of
unstructured, text-heavy data and need
a way to efficiently process it. Much
of the information created online and
stored in databases is natural human
language, and until recently,
businesses couldn't effectively
analyze this data. This is where
natural language processing is useful.
Matter?
Why does NLP
The advantages of natural language processing can be seen
when considering the following two statements: "Cloud computing
insurance should be part of every service-level agreement" and "A
good SLA ensures an easier night's sleep -- even in the cloud." If a user
relies on natural language processing for search, the program will
recognize that cloud computing is an entity, that cloud is an
abbreviated form of cloud computing, and that SLA is an industry
acronym for service-level agreement.
NLP is an integral part of everyday life and becoming more so as
language technology is applied to diverse fields like retailing (for instance, in
customer service chatbots) and medicine (interpreting or summarizing
electronic health records). Conversational agents such as Amazon’s Alexa and
Apple’s Siri utilize NLP to listen to user queries and find answers. The most
sophisticated such agents — such as GPT-3, which was recently opened for
commercial applications — can generate sophisticated prose on a wide variety
of topics as well as power chatbots that are capable of holding coherent
conversations. Google uses NLP to improve its search engine results, and social
networks like Facebook use it to detect and filter hate speech.
Matter?
Why does NLP
NLP is growing increasingly sophisticated, yet
much work remains to be done. Current systems are prone to
bias and incoherence, and occasionally behave erratically.
Despite the challenges, machine learning engineers have
many opportunities to apply NLP in ways that are ever more
central to a functioning society.
08
BENEFITS OF NLP
Benefits of NLP
Offers improved Enables an
accuracy and organization to
efficiency of use chatbots for
documentation. customer support.

Provides an organization Lets organizations


with the ability to
automatically make a
analyze structured
readable summary of a and unstructured
larger, more complex data.
original text.
Benefits of NLP
Enables personal Makes it easier for
assistants such as organizations to
Alexa to understand perform sentiment
the spoken word. analysis.

Organizations can use Provides advanced


NLP to better understand insights from analytics
lead generation, social that were previously
media posts, surveys and unreachable due to data
reviews. volume.
Industries
Using NLP

09
Using NLP
Industries
HEALTHCARE LEGAL
As healthcare To prepare for a case,
systems all over the lawyers must often spend
hours examining large
world move to
collections of documents
electronic medical and searching for
records, they are material relevant to a
encountering large specific case. NLP
amounts of technology can automate
unstructured data. the process of legal
discovery, cutting down
NLP can be used to
on both time and human
analyze and gain error by sifting through
new insights into large volumes of
health records. documents.
Using NLP
Industries
CUSTOME
R
FINANCE SERVICE
The financial world moves Many large
extremely fast, and any companies are using
competitive advantage is
virtual assistants or
important. In the financial
field, traders use NLP chatbots to help
technology to answer basic
automatically mine customer inquiries
information from and information
corporate documents and requests (such as
news releases to extract
FAQs), passing on
information relevant to
their portfolios and trading complex questions
decisions. to humans when
necessary.
Using NLP
Industries
INSURANCE
Large insurance companies are using NLP to sift through
documents and reports related to claims, in an effort to
streamline the way business gets done.
Six Important
Models of NLP
Over the years, many NLP models have
made waves within the AI community,
and some have even made headlines in
the mainstream news. The most famous
of these have been chatbots and
10
language models
NLP Models
Six Important
Eliza
Was developed in the mid-1960s to try to
solve the Turing Test; that is, to fool
people into thinking they’re conversing
with another human being rather than a
machine. Eliza used pattern matching and
a series of rules without encoding the
context of the language.

Tay
A chatbot that Microsoft launched in 2016. It
was supposed to tweet like a teen and learn
from conversations with real users on Twitter.
The bot adopted phrases from users who
tweeted sexist and racist comments, and
Microsoft deactivated it not long afterward.
Tay illustrates some points made by the
“Stochastic Parrots” paper, particularly the
danger of not debiasing data.
NLP Models
Six Important
BERT
and his Muppet friends: Many deep
learning models for NLP are named after
Muppet characters, including ELMo,
BERT, Big BIRD, ERNIE, Kermit, Grover,
RoBERTa, and Rosita. Most of these
models are good at providing contextual
embeddings and enhanced knowledge
representation.
Generative Pre-Trained
Transformer 3 (GPT-3)

A 175 billion parameter model that can write original prose


with human-equivalent fluency in response to an input
prompt. The model is based on the transformer
architecture. The previous version, GPT-2, is open source.
Microsoft acquired an exclusive license to access GPT-3’s
underlying model from its developer OpenAI, but other
users can interact with it via an application programming
interface (API). Several groups including EleutherAI and
Meta have released open source interpretations of GPT-3.
Language Model for Dialogue

NLP Models
Six Important
Applications (LaMDA)
a conversational chatbot developed by Google. LaMDA is a
transformer-based model trained on dialogue rather than the usual
web text. The system aims to provide sensible and specific
responses to conversations. Google developer Blake Lemoine
came to believe that LaMDA is sentient. Lemoine had detailed
conversations with AI about his rights and personhood. During one
of these conversations, the AI changed Lemoine’s mind about Isaac
Asimov’s third law of robotics. Lemoine claimed that LaMDA was
sentient, but the idea was disputed by many observers and
commentators. Subsequently, Google placed Lemoine on
administrative leave for distributing proprietary information and
ultimately fired him.

Mixture of Experts
(MoE)
While most deep learning models use the same
set of parameters to process every input, MoE
models aim to provide different parameters for
different inputs based on efficient routing
algorithms to achieve higher performance.
Switch Transformer is an example of the MoE
approach that aims to reduce communication and
computational costs.
Other common
examples of NLP
OF NLP
OTHER EXAMPLES
Google translate Siri and Alexa Grammarly
Google Translate is a widely- Apple's Siri and Amazon's Alexa Grammarly is a writing
used translation service that are virtual assistants that use voice assistant that helps with
converts text and speech recognition to perform tasks like grammar, punctuation, and
from one language to another setting reminders, playing music, style suggestions.
in real time. and answering questions.

Microsoft Google Search


Word’s Editor Autocomplete Duolingo
The Editor feature in Google's search engine predicts Duolingo is a language
Microsoft Word provides and suggests queries as you type, learning app that uses NLP
spelling, grammar, and helping users complete their to provide language
stylistic suggestions to searches faster. exercises and feedback on
improve writing. pronunciation and grammar.
Programming

11 Languages, Libraries,
And Frameworks For
Natural Language
Processing (NLP)
Many languages and libraries
support NLP.
● Python is the most-used programming language to tackle NLP tasks.
Most libraries and frameworks for deep learning are written for Python. Programming
Here are a few that practitioners may find helpful: Languages, Libraries
And Frameworks For
○ Natural Language Toolkit (NLTK) is one of the first NLP
NLP
libraries written in Python. It provides easy-to-use interfaces to
corpora and lexical resources such as WordNet. It also provides a
suite of text-processing libraries for classification, tagging,
stemming, parsing, and semantic reasoning.

○ spaCy is one of the most versatile open source NLP libraries. It


supports more than 66 languages. spaCy also provides pre-trained
word vectors and implements many popular models like BERT.
spaCy can be used for building production-ready systems for
named entity recognition, part-of-speech tagging, dependency
parsing, sentence segmentation, text classification, lemmatization,
morphological analysis, entity linking, and so on.
○ Deep Learning libraries: Popular deep learning Programming
libraries include TensorFlow and PyTorch, which Languages, Libraries
make it easier to create models with features like And Frameworks For
automatic differentiation. These libraries are the most NLP
common tools for developing NLP models.

○ Hugging Face offers open-source implementations


and weights of over 135 state-of-the-art models. The
repository enables easy customization and training of
the models.

○ Gensim provides vector space modeling and topic


modeling algorithms.
Programming
Languages, Libraries
And Frameworks For
● R: Many early NLP models were written in R, and R is still NLP
widely used by data scientists and statisticians. Libraries in R
for NLP include TidyText, Weka, Word2Vec, SpaCyR,
TensorFlow, and PyTorch.

● Many other languages including JavaScript, Java, and Julia have


libraries that implement NLP methods.
Controversies
Surrounding NLP
NLP has been at the center of a number of
controversies. Some are centered directly on
the models and their outputs, others on
second-order concerns, such as who has
access to these systems, and how training
12
them impacts the natural world.
Surrounding NLP
Controversies
Stochastic parrots:
A 2021 paper titled “On the Dangers of Stochastic Parrots: Can Language
Models Be Too Big?” by Emily Bender, Timnit Gebru, Angelina McMillan-Major,
and Margaret Mitchell examines how language models may repeat and amplify biases
found in their training data. The authors point out that huge, uncurated datasets
scraped from the web are bound to include social biases and other undesirable
information, and models that are trained on them will absorb these flaws. They
advocate greater care in curating and documenting datasets, evaluating a model’s
potential impact prior to development, and encouraging research in directions other
than designing ever-larger architectures to ingest ever-larger datasets.
Surrounding NLP
Controversies
Coherence versus sentience:
Recently, a Google engineer tasked with evaluating the
LaMDA language model was so impressed by the quality of its
chat output that he believed it to be sentient. The fallacy of
attributing human-like intelligence to AI dates back to some of the
earliest NLP experiments.
Surrounding NLP
Controversies
Environmental impact:
Large language models require a lot of energy during
both training and inference. One study estimated that training a
single large language model can emit five times as much carbon
dioxide as a single automobile over its operational lifespan.
Another study found that models consume even more energy
during inference than training. As for solutions, researchers have
proposed using cloud servers located in countries with lots of
renewable energy as one way to offset this impact.
Surrounding NLP
Controversies
High cost leaves out non-corporate researchers:
The computational requirements needed to train or
deploy large language models are too expensive for many small
companies. Some experts worry that this could block many capable
engineers from contributing to innovation in AI.
Surrounding NLP
Controversies
Black box:
When a deep learning model renders an output, it’s difficult or
impossible to know why it generated that particular result. While traditional models
like logistic regression enable engineers to examine the impact on the output of
individual features, neural network methods in natural language processing are
essentially black boxes. Such systems are said to be “not explainable,” since we can’t
explain how they arrived at their output. An effective approach to achieve
explainability is especially important in areas like banking, where regulators want to
confirm that a natural language processing system doesn’t discriminate against some
groups of people, and law enforcement, where models trained on historical data may
perpetuate historical biases against certain groups.
NLP Limitations!
NLP can be used for a
wide variety of applications but it's
far from perfect. In fact, many NLP
tools struggle to interpret sarcasm,
emotion, slang, context, errors, and
other types of ambiguous statements.
This means that NLP is mostly
limited to unambiguous situations
that don't require a significant
amount of interpretation.
VIDEO
PRESENTATIO
N
CONCLUSIO

13 N
Natural Language Processing (NLP)
stands at the forefront of artificial
intelligence, driving innovations that
transform our interactions with
technology. From its historical roots
in the 1950s to the sophisticated
applications we see today, NLP has
evolved significantly, leveraging
advances in computational power and
machine learning.
This evolution has enabled a wide array of

CONCLUSION
applications, from improving customer service through
chatbots to enhancing search engine results, translating
languages, and analyzing social media sentiment. NLP's
impact extends across various industries, including
healthcare, finance, legal, and customer service, where
it automates processes, enhances decision-making, and
extracts valuable insights from vast amounts of
unstructured data.

Despite its profound benefits, NLP faces ongoing


challenges such as bias in data, environmental impact,
and issues related to the explainability of models. These
challenges highlight the need for careful development
and ethical considerations as the field progresses.
Moreover, the rapid advancements in NLP technology
continue to push the boundaries of what machines can
understand and generate, fostering a closer and more
intuitive relationship between humans and computers.
CONCLUSION
As NLP technologies become more
sophisticated and integrated into everyday life,
their potential to revolutionize industries and
improve efficiency and accuracy in various
applications is immense. However, it is crucial to
address the associated ethical, environmental,
and accessibility concerns to ensure that the
advancements in NLP are both responsible and
inclusive. The future of NLP promises continued
innovation and deeper integration into our daily
lives, making it an essential area of research and
development within artificial intelligence.
THANKS!
Does anyone have any
questions?
CREDITS
This is where you give credit to the ones who are part of this project.

⎯ Presentation template by Slidesgo


⎯ Icons by Flaticon
⎯ Infographics by Freepik
⎯ Images created by Freepik
1. https://www.coursera.org/articles/natural-language-processing

S
REFERENCE
2. https://www.sas.com/en_ph/insights/analytics/what-is-natural-language-processing-nlp.html

3. https://www.deeplearning.ai/resources/natural-language-processing/

4. https://www.oracle.com/ph/artificial-intelligence/what-is-natural-language-processing/

5.
https://www.techtarget.com/searchenterpriseai/definition/natural-language-processing-NLP#:~:text=N
atural%20language%20processing%20(NLP)%20is,in%20the%20field%20of%20linguistics
.

6. https://www.ibm.com/topics/natural-language-processing

7. https://youtu.be/CMrHM8a3hqw?si=Mi-0ewZ6IYbXYqrI

8. https://youtu.be/d4gGtcobq8M?si=V6ElGNhHegwTPZfx

You might also like