W5 Tokenization
Introduction
You can get the slides of this class here.
Implementing our Tokenizer / Regular Expressions
The exact same “story” of this entire class can be followed in
this jupyter notebook: link
Motivating Regular Expressions
Regular Expressions
Implementing our naïve Tokenizer
Last words on Tokenization