10-423 / 10-623 / 10-723Generative AI

Lecture 1: RNN LMs / Autodiff Lecture 2: Transformer LMs Lecture 3: Learning LLMs / Decoding Lecture 4: Pre-training, fine-tuning / Modern Transformers Lecture 5: Computer Vision: CNNs / Encoder-only Transformers / Vision Transformers Lecture 6: Variational Autoencoders (VAEs) / PGM Lecture 7: Diffusion models (Part I)Lecture 8: Diffusion models (Part II) / Score Matching Lecture 9: GANs / Continuous Normalizing Flows / Flow Matching Lecture 10: Parameter-efficient fine tuning Lecture 11: In-Context Learning / Prompt Engineering / Instruction Fine-tuning / Reinforcement learning with human feedback (RLHF)Lecture 12: Direct Preference Optimization (DPO) / Tool Use / On-Policy Distillation (OPD)Lecture 13: Vision-language models Lecture 14: Cross-Attention / Diffusion Transformer / Prompt-to-Prompt Lecture 15: Querying Transformer / Scaling Laws Lecture 16: Mixture of Experts Lecture 17: Distributed training Lecture 18: Flash Attention / Efficient decoding strategies Lecture 19: Long Context in LLM / RAG Lecture 20: Reasoning Models Lecture 21: State Space Models / Hybrid Models Lecture 22: Real-world Issues and Considerations / What can go wrong? / Safety Lecture 23: Audio understanding and synthesis Lecture 24: Code Generation / Autonomous Agents Lecture 25: Generative Models for Videos Lecture 26: Interactive World Models

Multimodal foundation models › Vision-language models

Lecture 13: Vision-language models

Wed, Oct 7

Loading PDF…

PDF not available