Neural Networks I
Lecture Slides Lecture Slides (pdf) Lecture Slides (ipynb)
Tutorial Exercise Tutorial Exercise (pdf) Tutorial Exercise (ipynb)
This week we will look at the mechanics of fitting word embeddings, focussing on neural network architecture.
Required Readings
- Jurafsky and Martin 2026 Ch 6 Neural Networks
- LeCun, Yann, Yoshua Bengio, and Geoffrey Hinton. 2015. “Deep Learning.” Nature 521 (7553): 436–44. https://doi.org/10.1038/nature14539.
Additional Readings
- Goodfellow, Ian, Yoshua Bengio and Aaron Courville. 2016. Deep Learning. MIT Press. Ch 6 Deep Feedforward Networks
Tutorial
- Applying stochastic gradient descent