Schedule is tentative. Check regularly for updates. Readings beginning with “E” are from Eisenstein’s Natural Language Processing, while readings beginning with “JM” are from Jurafsky and Martin’s Speech and Language Processing.
| DATE | TOPIC | READINGS | ASSIGNMENT | LINKS |
| 1/18 | Two Cultures of Linguistics | E1 | ||
| 1/21 | More Two Cultures of Linguistics and Naive Bayes | E2.1-2.2;4.3-4.4; JM4 | ||
| 1/25 | More Naive Bayes and Logistic Regression | E2.5-2.7; JM5 | HW1 out | |
| 1/28 | Stochastic Gradient Descent | |||
| 2/1 | Perceptrons | E2.3-2.4;2.8 | ||
| 2/4 | Multilayer Perceptrons | E3.1-3.3; JM7 | HW1 Due | |
| 2/8 | Computation Graphs | |||
| 2/11 | More Computation Graphs | |||
| 2/15 | N-grams and Vector Semantics | E6.1-6.2;6.4-6.5; JM3 | ||
| 2/18 | Distributional Semantics and Word Vectors | E14; JM6 | ||
| 3/1 | Singular Value Decomposition | |||
| 3/4 | Hidden Markov Models | E7.1-7.4;8.1; JM8;A | ||
| 3/8 | Quiz | |||
| 3/11 | Conditional Random Fields | E7.5 | ||
| 3/15 | Structured Perceptrons and Review of Neural Networks | Bengio 1999; Collins 2002 | ||
| 3/18 | Recurrent Neural Networks | E6.3;7.6; JM9 | ||
| 3/22 | Fancy RNNs | |||
| 3/25 | Syntactic Theory (Constituent) | E9.2; JM12 | ||
| 3/29 | Earley Algorithm | |||
| 4/1 | CKY Algorithm | E10; JM13;C | ||
| 4/5 | CKY Algorithm (Part 2) | |||
| 4/8 | Dependency Parsing | E11; JM14 | displaCy | |
| 4/12 | Machine Translation | E18; JM11 | ||
| 4/26 | Attention | |||
| 4/29 | Transformers | |||
| 5/3 | Quiz |