Page 382 - AI_Ver_3.0_class_11
P. 382

Lexical Analysis
                                                                                                      Stemming
                This step involves studying and identifying a language’s word structure. The text is
              divided into words, phrases, and paragraphs. Words are frequently reduced to their   leafs         leaf
              most  basic  forms  using  lexical  normalisation  techniques  like  lemmatisation  and
              stemming.
                                                                                               leaves            leave
                 • Stemming reduces words to their root form, such as removing suffixes like "ing",
                 "ly", "es", and "s".

                                                                                                    Lemmatisation
                 •  Lemmatisation  reduces  words  to  their  dictionary  form,  considering  factors  like
                 Parts of Speech (POS) to determine their meaning in context.                   leafs
                                                                                                                 leaf
                                                                                               leaves



              Syntactic Analysis
              Syntactic analysis is the second stage of NLP. Syntactic analysis, often known as parsing, is the act of examining grammar,
              word arrangement, identifying word relationships and determining if the sentence make sense. The approach involves
              examining all the words and phrases in a sentence as well as the structures that connect them.

                A syntax tree is created as part of the procedure to visually represent semantic links. This method ensures that the
              structure,  sequence,  and  grammar  of  sentences  to  make  sense.  Syntactic  analysis  also  includes  tagging  words  and
              sentences with POS (Parts of Speech) tags.
                                                             Sentence




                                             Noun Phrase                   Verb Phrase



                                     Determiner           Noun       Verb          Noun Phrase



                                        the                girl     plays              Noun


                                                                                    badminton
              For example, Badminton plays the girl: makes no sense, hence it is rejected in this stage. To properly analyse the
              words  in a sentence for grammar, we use Syntactical parsing. Dependency Grammar and Part of Speech (POS)
              tags  are  significant  syntactic  elements.  The  above  image  shows  the  correct  syntactical  parsing  of  words  done
              during this stage.

              Semantic Analysis
                Semantic analysis is the third stage of NLP, which aims at determining the appropriate meaning behind a statement in a
              clear and concise manner. A semantic system integrates entities, concepts, relations, and predicates to add more context
              to language, allowing machines to understand text data more accurately.
                Semantic analysis extracts meaning from language and serves as the foundation for a semantic system that aids robots
              in interpreting meaning. This involves mapping the syntactic structure and ensuring that the presented relationships
              between entities, words, phrases, and sentences in the text are logical.




                    380     Touchpad Artificial Intelligence (Ver. 3.0)-XI
   377   378   379   380   381   382   383   384   385   386   387