Word Guessing Machines?

Important Note: OpenAI has changed the OpenAI Playground and it unfortunately no longer has the option to show you the token probabilities that I use in this lesson. I'm working on an alternative solution for you, but in the meantime don't worry - while you won't be able to play around with this feature yourself, the important part is that you understand how tokens work and what is meant when people say LLMs are "word guessing machines". We'll be talking a lot more about this in upcoming lessons too!