Page 375 - AI Ver 3.0 class 10_Flipbook
P. 375
#Creativity
21 st Century
Skills #Media Literacy
GAME NovelAI
A text-based adventure game where AI dynamically generates the story based on
your inputs. Play here: https://www.novelai.net/
Stages of Natural Language Processing (NLP)
The process of understanding human language is quite difficult for a machine. This process is divided into five
major stages.
Lexical Syntactic Semantic Discourse Pragmatic
Analysis Analysis Analysis Integration Analysis
These stages of NLP can be explained as follows:
• Lexical Analysis: In this stage, an AI machine identifies and analyses the structure of words in a speech and
converts them into text. This text is then converted into paragraphs, sentences and words by lexical analyser.
Lexicon refers for a collection of the various words and phrases used in a language.
The agile deer leaped over the sluggish bear
The agile deer leaped over the sluggish bear
Lexical Analysis
In the above example the lengthy text is broken down into individual words.
• Syntactic Analysis: In this stage, the converted words and sentences are arranged according to the grammar
of the language. This arrangement highlights the relationships between words. For example, if you are using the
English language, the syntactic analyser will reject unorganised sentences like “deer over leaped the sluggish bear”.
The agile deer over leaped the sluggish bear
WRONG
The agile deer leaped over the sluggish bear
RIGHT
In the above example, the grammar is checked.
Natural Language Processing (Theory) 373

