The course content and sequence may be adjusted based on the duration of the lecture and the interests of the students. Additional readings, assignments, and projects may also be included to enhance the learning experience.
Week
Date
Topics
Lecturer
Material
1
6 Sep
Introduction
Jin-Hwa Kim
2
13 Sep
Multimodal Tasks and Datasets
Jiyoung Lee
3
20 Sep
Multimodal Representation Learning
Jin-Hwa Kim
4
27 Sep
Multimodal Reasoning and Interpretability
Jiyoung Lee
5
4 Oct
Multimodal Generation
Junho Kim (Guest lecturer)
6
11 Oct
Self-supervised Learning
Sangdoo Yun
7
18 Oct
Multimodal Pre-training
Sangdoo Yun
9
25 Oct
Project Proposal A & B
-
8
1 Nov
Advanced Topics in Multimodal Models
Sangdoo Yun
10
8 Nov
Multimodal Generation: Advanced Topics in Audio/Video
Jiyoung Lee
11
15 Nov
Neural Graphics
Jin-Hwa Kim
12
22 Nov
Topics in Neural Graphics
Jin-Hwa Kim
13
29 Nov
Final presentations A
-
14
6 Dec
Final presentations B
-
15
13 Dec
Topics in Trustworthy AI -- Safety, Ethics, and Privacy