.png)
Natural Language Processing
- Joseph Krisnanto
- Apr 12
- 2 min read
AI technology is a very complex system. It requires many different specific systems that act in unison in order to create a machine that can adapt to its environment. One of these systems is called NLP, or natural language processing.
Natural language processing is something that AI uses to understand human language as a whole. You can think of it as a translation between words and code. The computer cannot directly understand words and speech, so it must be able to convert words using certain letters into a coding language that it can read. NLP requires two different subsystems to function, data preprocessing and algorithm development.
Data preprocessing involves attempting to properly interpret text. One way this is done is through eliminating simple words that are usually used in all sentences, like “the” or “it”. This results in leaving words that are more sentence specific, which provide a greater insight into what the sentence may be asking/saying. Words are also processed and categorized, which helps the computer to differentiate between verbs, nouns, adjectives, etc.
Once the data has been collected and organized, it now needs to be processed into a readable format. This is done through algorithm development. Algorithms used to be created from linguistic rules, so a word correlates to a specific code. However, this has slowly changed. Algorithms have now become more advanced, which enables computers to make inferences of what word means what based on previous data fed to the computer. This is the essence of AI, but incorporated into the language processing aspect. Because AI can now make inferences based on what words it’s fed, AI like chatGPT is capable of understanding modern slang, or slight typos in words.
NLP is just one of the many systems used by AI in order to function properly, which proves how advanced the technology is. Just like how algorithm development has seen improvements which greatly increase the functionality of AI, other systems will be improved to allow AI to function at a higher level.
Works Cited
Comments