Zipf’s Law

Do most words in a corpus occur with average frequency? Absolutely not! This video discusses a surprising regularity about word frequencies in corpora. And at the end, we’ll make a trip to Hogwarts and see if Zipf’s Law applies also in the world of wizards. If you want to follow along, here are the word list files: Request the Potter corpus: