Page 382 - Ai_V3.0_c11_flipbook
P. 382
Lexical Analysis
Stemming
This step involves studying and identifying a language’s word structure. The text is
divided into words, phrases, and paragraphs. Words are frequently reduced to their leafs leaf
most basic forms using lexical normalisation techniques like lemmatisation and
stemming.
leaves leave
• Stemming reduces words to their root form, such as removing suffixes like "ing",
"ly", "es", and "s".
Lemmatisation
• Lemmatisation reduces words to their dictionary form, considering factors like
Parts of Speech (POS) to determine their meaning in context. leafs
leaf
leaves
Syntactic Analysis
Syntactic analysis is the second stage of NLP. Syntactic analysis, often known as parsing, is the act of examining grammar,
word arrangement, identifying word relationships and determining if the sentence make sense. The approach involves
examining all the words and phrases in a sentence as well as the structures that connect them.
A syntax tree is created as part of the procedure to visually represent semantic links. This method ensures that the
structure, sequence, and grammar of sentences to make sense. Syntactic analysis also includes tagging words and
sentences with POS (Parts of Speech) tags.
Sentence
Noun Phrase Verb Phrase
Determiner Noun Verb Noun Phrase
the girl plays Noun
badminton
For example, Badminton plays the girl: makes no sense, hence it is rejected in this stage. To properly analyse the
words in a sentence for grammar, we use Syntactical parsing. Dependency Grammar and Part of Speech (POS)
tags are significant syntactic elements. The above image shows the correct syntactical parsing of words done
during this stage.
Semantic Analysis
Semantic analysis is the third stage of NLP, which aims at determining the appropriate meaning behind a statement in a
clear and concise manner. A semantic system integrates entities, concepts, relations, and predicates to add more context
to language, allowing machines to understand text data more accurately.
Semantic analysis extracts meaning from language and serves as the foundation for a semantic system that aids robots
in interpreting meaning. This involves mapping the syntactic structure and ensuring that the presented relationships
between entities, words, phrases, and sentences in the text are logical.
380 Touchpad Artificial Intelligence (Ver. 3.0)-XI

