Page 240 - Ai_C10_Flipbook
P. 240
• Each word and sentence in the statement is analysed, broken down, and categorised based on its relevance.
They are marked in different colours, representing how the data has been segmented and understood
by the API.
• The relevance of the data can be assessed under various categories. Depending on the requirements for model
training, the analysed data from these categories can be utilised.
• You can try creating your own statement and analysing it using the API.
Stages of Natural Language Processing (NLP)
The process of understanding human language is quite difficult for a machine. This process is divided into five
major stages.
These stages of NLP can be explained as follows:
• Lexical Analysis: In this stage, an AI machine
identifies and analyses the structure of words The agile deer leaped over the sluggish bear
in a speech and converts them into text.
This text is then converted into paragraphs,
The agile deer leaped over the sluggish bear
sentences and words by lexical analyser.
Lexicon refers for a collection of the various
words and phrases used in a language.
Lexical Analysis
238 Artificial Intelligence Play (Ver 1.0)-X

