Which words should the next word depend on? Every sentence has certain key words. Change those key words and the entire meaning could change....
We need some way to represent meaning. Some way for the LLM to know that certain words are related. We do that by converting the tokens into embeddings...
Machine learning algorithms require both the inputs and outputs have to be numbers. On the other hand, an LLM takes text as input and returns text as output. Therefore, we need some mechanism to convert text into numbers and vice versa....
To a lot of people, machine learning and artificial intelligence seems like magic. Many people think that the computer actually becomes sentient. And it seems that way when we use tools like ChatGPT! In reality, machine learning algorithms are just a sequence of maths operations on numbers....
I will be posting a series of articles on this topic right here on Playful Python. I'm looking to build an intuitive understanding of what is going on, rather than lean on rigorous maths....
This year I got the opportunity to be a speaker at PyCon Italia held in Florence. It was my first time speaking at a Python conference outside of India, and I had a great time there. Here are some of my takeaways from the conference....