Which words should the next word depend on? Every sentence has certain key words. Change those key words and the entire meaning could change....

We need some way to represent meaning. Some way for the LLM to know that certain words are related. We do that by converting the tokens into embeddings...

Machine learning algorithms require both the inputs and outputs have to be numbers. On the other hand, an LLM takes text as input and returns text as output. Therefore, we need some mechanism to convert text into numbers and vice versa....

To a lot of people, machine learning and artificial intelligence seems like magic. Many people think that the computer actually becomes sentient. And it seems that way when we use tools like ChatGPT! In reality, machine learning algorithms are just a sequence of maths operations on numbers....