Week 7: Multimodal learning, CCA, and IVA

DATA 442/642 · Week 7

Module 4 — Multimodal learning, CCA, IVA

Notes

• 7.1 Multimodal Learning(slides)
• 7.2 Canonical Correlation Analysis(slides)
• 7.3 Independent Vector Analysis(slides)

Additional

• Independent component analysis(PDF)
• ICA (extended notes)(PDF)
• Independent vector analysis(PDF)
• Canonical correlation analysis(PDF)
• Multimodal learning(PDF)
• Multimodal methods(PDF)
• CLIP(PDF)
• Image embeddings(PDF)

Discussion

• CCA needs two views of the same objects. Name a pair.
• What extra assumption does IVA add on top of ICA?