NLP #1: What Is a Word?
Originally published on almoghagbi.com, where the figures are interactive. I'm taking an introductory natural language processing (NLP) course this Speech and Language Processing This first post covers sections 2.1–2.2. Before a model can read text, someone has to decide what Each post has three parts: Intuition (no math needed), The math Exercises (to check yourself). Take one sentence, our running example for the whole post: The bakery's cinnamon rolls were so good, I bought more rolls for th…