Week 12: Chatbots and dialog systems

DATA 441/641 · Week 12

Notes

• 12.1 Chatbot Applications and Taxonomy(slides)
• 12.2 Basic Components of a Chatbot(slides)
• 12.3 Dialog Systems(slides)

Additional

• Transformers(PDF)
• BERT(PDF)
• GPT(PDF)
• Prompt engineering(PDF)
• Token-by-token training(PDF)
• Sentiment with multi-head attention(PDF)
• Pretraining(PDF)
• Fine-tuning(PDF)
• Transfer learning(PDF)

Additional readings

• Practical NLP, Ch. 6 (chatbots)
• Rasa: Conversational AI

Discussion

• When is a retrieval bot safer than a generative one?
• What belongs in dialogue state for a pizza-order bot?