10-423 / 10-623 / 10-723
Sign in

About › The Course

Schedule

Course Schedule

Date
CategoryTopicStatusContext
1
Mon, Jan 12
Lectures
Mon, Jan 12Lecture 1: RNN LMs / AutodiffModule: Generative models of text
Wed, Jan 14
Homeworks
Wed, Jan 14Homework 0: PyTorch PrimerModule: Generative models of text
RELEASED
Pre-training, fine-tuning / Modern Transformers
Lectures
Wed, Jan 14Lecture 2: Transformer LMsModule: Generative models of text
Fri, Jan 16
Recitations
Fri, Jan 16Recitation: HW0Module: Generative models of text
Pre-training, fine-tuning / Modern Transformers
2
Wed, Jan 21
Lectures
Wed, Jan 21Lecture 3: Learning LLMs / DecodingModule: Generative models of text
3
Mon, Jan 26
Homeworks
Mon, Jan 26Homework 1: Large Language ModelsModule: Generative models of text
RELEASED
Pre-training, fine-tuning / Modern Transformers
Lectures
Mon, Jan 26Lecture 4: Pre-training, fine-tuning / Modern TransformersModule: Generative models of text
Homeworks
Mon, Jan 26Homework 0: PyTorch Primer (Slot A)Module: Generative models of text
DUE
Pre-training, fine-tuning / Modern Transformers
Wed, Jan 28
Lectures
Wed, Jan 28Lecture 5: Computer Vision: CNNs / Encoder-only Transformers / Vision TransformersModule: Generative models of images
Quizzes
Wed, Jan 28Quiz 1 (L1-L4)Module: Generative models of images
Computer Vision: CNNs / Encoder-only Transformers / Vision Transformers
Fri, Jan 30
Recitations
Fri, Jan 30Recitation: HW1Module: Generative models of text
Pre-training, fine-tuning / Modern Transformers
Sun, Feb 1
Homeworks
Sun, Feb 1Homework 0: PyTorch Primer (Slot B)Module: Generative models of text
DUE
Pre-training, fine-tuning / Modern Transformers
4
Mon, Feb 2
Lectures
Mon, Feb 2Lecture 6: Generative Adversarial Networks (GANs) / PGMModule: Generative models of images
Wed, Feb 4
Lectures
Wed, Feb 4Lecture 7: Diffusion models (Part I)Module: Generative models of images
5
Mon, Feb 9
Homeworks
Mon, Feb 9Homework 2: Image GenerationModule: Generative models of images
RELEASED
Diffusion models (Part II)
Lectures
Mon, Feb 9Lecture 8: Diffusion models (Part II)Module: Generative models of images
Homeworks
Mon, Feb 9Homework 1: Large Language Models (Slot A)Module: Generative models of text
DUE
Pre-training, fine-tuning / Modern Transformers
Wed, Feb 11
Lectures
Wed, Feb 11Lecture 9: Variational Autoencoders (VAEs)Module: Applying and adapting foundation models
Fri, Feb 13
Recitations
Fri, Feb 13Recitation: HW2Module: Generative models of images
Diffusion models (Part II)
6
Mon, Feb 16
Quizzes
Mon, Feb 16Quiz 2 (L5-L9)Module: Applying and adapting foundation models
Parameter-efficient fine tuning
Lectures
Mon, Feb 16Lecture 10: Parameter-efficient fine tuningModule: Applying and adapting foundation models
Tue, Feb 17
Homeworks
Tue, Feb 17Homework 1: Large Language Models (Slot B)Module: Generative models of text
DUE
Pre-training, fine-tuning / Modern Transformers
Wed, Feb 18
Lectures
Wed, Feb 18Lecture 11: In-Context Learning / Prompt Engineering / Instruction Fine-tuning / Reinforcement learning with human feedback (RLHF)Module: Applying and adapting foundation models
Fri, Feb 20
Recitations
Fri, Feb 20Recitation: HW3Module: Multimodal foundation models
Direct Preference Optimization (DPO) / Text-to-image generation / Latent diffusion model
Sat, Feb 21
Homeworks
Sat, Feb 21Homework 3: Applying and Adapting LLMsModule: Multimodal foundation models
RELEASED
Direct Preference Optimization (DPO) / Text-to-image generation / Latent diffusion model
Homeworks
Sat, Feb 21Homework 2: Image Generation (Slot A)Module: Generative models of images
DUE
Diffusion models (Part II)
7
Mon, Feb 23
Lectures
Mon, Feb 23Lecture 12: Direct Preference Optimization (DPO) / Text-to-image generation / Latent diffusion modelModule: Multimodal foundation models
Wed, Feb 25
Quizzes
Wed, Feb 25Quiz 3 (L9-L12)Module: Multimodal foundation models
Direct Preference Optimization (DPO) / Text-to-image generation / Latent diffusion model
Programming Tests
Wed, Feb 25Programming Test (HW1/HW2)Module: Multimodal foundation models
Direct Preference Optimization (DPO) / Text-to-image generation / Latent diffusion model
Fri, Feb 27
Lectures
Fri, Feb 27Lecture 13: Vision-language modelsModule: Multimodal foundation models
Sun, Mar 1
Homeworks
Sun, Mar 1Homework 2: Image Generation (Slot B)Module: Generative models of images
DUE
Diffusion models (Part II)
9
Mon, Mar 9
Lectures
Mon, Mar 9Lecture 14: Cross-Attention / Diffusion Transformer / Prompt-to-PromptModule: Multimodal foundation models
Wed, Mar 11
Lectures
Wed, Mar 11Lecture 15: Querying Transformer / Scaling LawsModule: Scaling Up
Thu, Mar 12
Homeworks
Thu, Mar 12Homework 4: Multimodal Foundation ModelsModule: Multimodal foundation models
RELEASED
Cross-Attention / Diffusion Transformer / Prompt-to-Prompt
Homeworks
Thu, Mar 12Homework 3: Applying and Adapting LLMs (Slot A)Module: Multimodal foundation models
DUE
Direct Preference Optimization (DPO) / Text-to-image generation / Latent diffusion model
Fri, Mar 13
Recitations
Fri, Mar 13Recitation: HW4Module: Multimodal foundation models
Cross-Attention / Diffusion Transformer / Prompt-to-Prompt
Project
Fri, Mar 13Project team formation due
DUE
10
Mon, Mar 16
Quizzes
Mon, Mar 16Quiz 4 (L12-L15)Module: Scaling Up
Mixture of Experts
Lectures
Mon, Mar 16Lecture 16: Mixture of ExpertsModule: Scaling Up
Wed, Mar 18
Lectures
Wed, Mar 18Lecture 17: Distributed trainingModule: Scaling Up
Fri, Mar 20
Homeworks
Fri, Mar 20Homework 3: Applying and Adapting LLMs (Slot B)Module: Multimodal foundation models
DUE
Direct Preference Optimization (DPO) / Text-to-image generation / Latent diffusion model
11
Mon, Mar 23
Lectures
Mon, Mar 23Lecture 18: Flash Attention / Efficient decoding strategiesModule: Scaling Up
Homeworks
Mon, Mar 23Homework 623: (10-623 and 10-723 only)Module: Advanced Topics
RELEASED
Interactive World Models + Science of Alignment
Homeworks
Mon, Mar 23Homework 4: Multimodal Foundation Models (Slot A)Module: Multimodal foundation models
DUE
Cross-Attention / Diffusion Transformer / Prompt-to-Prompt
Wed, Mar 25
Lectures
Wed, Mar 25Lecture 19: Long Context in LLMModule: Advanced Topics
Fri, Mar 27
Programming Tests
Fri, Mar 27Programming Test (HW3/HW4)Module: Advanced Topics
Long Context in LLM
12
Mon, Mar 30
Lectures
Mon, Mar 30Lecture 20: Reasoning ModelsModule: Advanced Topics
Exams
Mon, Mar 30ExamModule: Advanced Topics
EXAM
Reasoning Models
Homeworks
Mon, Mar 30Homework 4: Multimodal Foundation Models (Slot B)Module: Multimodal foundation models
DUE
Cross-Attention / Diffusion Transformer / Prompt-to-Prompt
Wed, Apr 1
Lectures
Wed, Apr 1Lecture 21: State Space Models / Hybrid ModelsModule: Advanced Topics
Fri, Apr 3
Project
Fri, Apr 3Project proposal due
DUE
13
Mon, Apr 6
Lectures
Mon, Apr 6Lecture 22: Real-world Issues and Considerations / What can go wrong?Module: Advanced Topics
Quizzes
Mon, Apr 6Quiz 5 (L16-L20)Module: Advanced Topics
Real-world Issues and Considerations / What can go wrong?
Wed, Apr 8
Lectures
Wed, Apr 8Lecture 23: Code Generation / Autonomous AgentsModule: Advanced Topics
14
Mon, Apr 13
Lectures
Mon, Apr 13Lecture 24: Audio understanding and synthesisModule: Advanced Topics
Project
Mon, Apr 13Project midway update due
DUE
Wed, Apr 15
Lectures
Wed, Apr 15Lecture 25: Generative Models for VideosModule: Advanced Topics
15
Mon, Apr 20
Quizzes
Mon, Apr 20Quiz 6 (L21-L24)Module: Advanced Topics
Interactive World Models + Science of Alignment
Lectures
Mon, Apr 20Lecture 26: Interactive World Models + Science of AlignmentModule: Advanced Topics
Homeworks
Mon, Apr 20Homework 623: (10-623 and 10-723 only) (Slot A)Module: Advanced Topics
DUE
Interactive World Models + Science of Alignment
Sun, Apr 26
Project
Sun, Apr 26Project final poster due
DUE
16
Tue, Apr 28
Project
Tue, Apr 28Project Final Presentations
Thu, Apr 30
Project
Thu, Apr 30Project final report due
DUE