Week 8: Recurrent neural networks

DATA 441/641 · Week 8

Notes

• 8.1 Loopy Recurrent Neural Networks(slides)
• 8.2 RNNs for Text Classification(slides)

Additional

• Handling sequential data(PDF)
• Recurrent neural networks(PDF)
• LSTMs(PDF)
• GRUs(PDF)

Additional readings

• Chollet, Deep Learning with Python: RNNs
• Understanding LSTM networks (Olah)

Discussion

• What information does the hidden state have to carry to the last token?
• When is a bidirectional RNN worth the extra compute?