Course Schedule

Schedule is tentative. Check regularly for updates. Readings beginning with “E” are from Eisenstein’s Natural Language Processing, while readings beginning with “JM” are from Jurafsky and Martin’s Speech and Language Processing.

DATE TOPIC READINGS ASSIGNMENT LINKS
1/18 Two Cultures of Linguistics E1
1/21 More Two Cultures of Linguistics and Naive Bayes E2.1-2.2;4.3-4.4; JM4
1/25 More Naive Bayes and Logistic Regression E2.5-2.7; JM5 HW1 out
1/28 Stochastic Gradient Descent
2/1 Perceptrons E2.3-2.4;2.8
2/4 Multilayer Perceptrons E3.1-3.3; JM7 HW1 Due
2/8 Computation Graphs
2/11 More Computation Graphs
2/15 N-grams and Vector Semantics E6.1-6.2;6.4-6.5; JM3
2/18 Distributional Semantics and Word Vectors E14; JM6
3/1 Singular Value Decomposition
3/4 Hidden Markov Models E7.1-7.4;8.1; JM8;A
3/8 Quiz
3/11 Conditional Random Fields E7.5
3/15 Structured Perceptrons and Review of Neural Networks Bengio 1999; Collins 2002
3/18 Recurrent Neural Networks E6.3;7.6; JM9
3/22 Fancy RNNs
3/25 Syntactic Theory (Constituent) E9.2; JM12
3/29 Earley Algorithm
4/1 CKY Algorithm E10; JM13;C
4/5 CKY Algorithm (Part 2)
4/8 Dependency Parsing E11; JM14 displaCy
4/12 Machine Translation E18; JM11
4/26 Attention
4/29 Transformers
5/3 Quiz