Page 375 - AI Ver 3.0 class 10_Flipbook
P. 375

#Creativity
                                                                                           21 st  Century
                                                                                               Skills  #Media Literacy
                                      GAME                             NovelAI


                        A text-based adventure game where AI dynamically generates the story based on
                      your inputs. Play here: https://www.novelai.net/




                         Stages of Natural Language Processing (NLP)


                 The process of understanding human language is quite difficult for a machine. This process is divided into five
                 major stages.

                          Lexical            Syntactic           Semantic            Discourse           Pragmatic
                          Analysis            Analysis            Analysis          Integration           Analysis


                  These stages of NLP can be explained as follows:
                    • Lexical Analysis: In this stage, an AI machine identifies and analyses the structure of words in a speech and
                   converts them into text. This text is then converted into paragraphs, sentences and words by lexical analyser.
                   Lexicon refers for a collection of the various words and phrases used in a language.




                                            The agile deer leaped over the sluggish bear



                                            The agile deer leaped over the sluggish      bear



                                                           Lexical Analysis



                   In the above example the lengthy text is broken down into individual words.
                    • Syntactic Analysis: In this stage, the converted words and sentences are arranged according to the grammar
                   of the language. This arrangement highlights the relationships between words. For example, if you are using the
                   English language, the syntactic analyser will reject unorganised sentences like “deer over leaped the sluggish bear”.



                                               The agile deer over leaped the sluggish bear


                                                               WRONG



                                               The agile deer leaped over the sluggish bear


                                                                RIGHT



                   In the above example, the grammar is checked.

                                                                          Natural Language Processing (Theory)  373
   370   371   372   373   374   375   376   377   378   379   380