10-423 / 10-623 / 10-723
Sign in

About › The Course

Schedule

Course Schedule

Date
CategoryTopicStatus
1
Mon, Aug 24
Lectures
Mon, Aug 24Lecture 1: RNN LMs / AutodiffModule: Generative models of text
Wed, Aug 26
Lectures
Wed, Aug 26Lecture 2: Transformer LMsModule: Generative models of text
Homeworks
Wed, Aug 26Homework 0: PyTorch PrimerModule: Generative models of text
RELEASED
Fri, Aug 28
Recitations
Fri, Aug 28Recitation: HW0Module: Generative models of text
2
Mon, Aug 31
Lectures
Mon, Aug 31Lecture 3: Learning LLMs / DecodingModule: Generative models of text
Wed, Sep 2
TODAY
Lectures
Wed, Sep 2Lecture 4: Pre-training, fine-tuning / Modern TransformersModule: Generative models of text
Thu, Sep 3
Homeworks
Thu, Sep 3Homework 0: PyTorch Primer (Slot A)Module: Generative models of text
DUE
Sun, Sep 6
Homeworks
Sun, Sep 6Homework 0: PyTorch Primer (Slot B)Module: Generative models of text
DUE
Homeworks
Sun, Sep 6Homework 1: Large Language ModelsModule: Generative models of text
RELEASED
3
Wed, Sep 9
Lectures
Wed, Sep 9Lecture 5: Computer Vision: CNNs / Encoder-only Transformers / Vision TransformersModule: Generative models of images
Quizzes
Wed, Sep 9Quiz 1 (L1-L4)Module: Generative models of images
QUIZZES
Fri, Sep 11
Recitations
Fri, Sep 11Recitation: HW1Module: Generative models of text
4
Mon, Sep 14
Lectures
Mon, Sep 14Lecture 6: Generative Adversarial Networks (GANs) / PGMModule: Generative models of images
Wed, Sep 16
Lectures
Wed, Sep 16Lecture 7: Diffusion models (Part I)Module: Generative models of images
Fri, Sep 18
Homeworks
Fri, Sep 18Homework 1: Large Language Models (Slot A)
DUE
5
Mon, Sep 21
Lectures
Mon, Sep 21Lecture 8: Diffusion models (Part II) / Score MatchingModule: Generative models of images
Homeworks
Mon, Sep 21Homework 1: Large Language Models (Slot B)
DUE
Homeworks
Mon, Sep 21Homework 2: Image GenerationModule: Generative models of images
RELEASED
Wed, Sep 23
Lectures
Wed, Sep 23Lecture 9: Variational Autoencoders (VAEs) / Continuous Normalizing Flows / Flow MatchingModule: Applying and adapting foundation models
Fri, Sep 25
Recitations
Fri, Sep 25Recitation: HW2Module: Generative models of images
6
Mon, Sep 28
Lectures
Mon, Sep 28Lecture 10: Parameter-efficient fine tuningModule: Applying and adapting foundation models
Quizzes
Mon, Sep 28Quiz 2 (L5-L9)Module: Applying and adapting foundation models
QUIZZES
Wed, Sep 30
Lectures
Wed, Sep 30Lecture 11: In-Context Learning / Prompt Engineering / Instruction Fine-tuning / Reinforcement learning with human feedback (RLHF)Module: Applying and adapting foundation models
Homeworks
Wed, Sep 30Homework 2: Image Generation (Slot A)
DUE
Fri, Oct 2
Recitations
Fri, Oct 2Recitation: HW3Module: Multimodal foundation models
Sat, Oct 3
Homeworks
Sat, Oct 3Homework 2: Image Generation (Slot B)
DUE
Homeworks
Sat, Oct 3Homework 3: Applying and Adapting LLMsModule: Multimodal foundation models
RELEASED
7
Mon, Oct 5
Lectures
Mon, Oct 5Lecture 12: Direct Preference Optimization (DPO) / Text-to-image generation / Latent diffusion modelModule: Multimodal foundation models
Wed, Oct 7
Lectures
Wed, Oct 7Lecture 13: Vision-language modelsModule: Multimodal foundation models
Fri, Oct 9
Programming Tests
Fri, Oct 9Programming Test (HW1/HW2)Module: Multimodal foundation models
TESTS
Quizzes
Fri, Oct 9Quiz 3 (L9-L12)Module: Multimodal foundation models
QUIZZES
9
Mon, Oct 19
Lectures
Mon, Oct 19Lecture 14: Cross-Attention / Diffusion Transformer / Prompt-to-PromptModule: Multimodal foundation models
Homeworks
Mon, Oct 19Homework 3: Applying and Adapting LLMs (Slot A)Module: Multimodal foundation models
DUE
Wed, Oct 21
Lectures
Wed, Oct 21Lecture 15: Querying Transformer / Scaling LawsModule: Scaling Up
Thu, Oct 22
Homeworks
Thu, Oct 22Homework 3: Applying and Adapting LLMs (Slot B)Module: Multimodal foundation models
DUE
Homeworks
Thu, Oct 22Homework 4: Multimodal Foundation ModelsModule: Multimodal foundation models
RELEASED
Fri, Oct 23
Recitations
Fri, Oct 23Recitation: HW4Module: Multimodal foundation models
Project
Fri, Oct 23Project: Team Formation
DUE
10
Mon, Oct 26
Lectures
Mon, Oct 26Lecture 16: Mixture of ExpertsModule: Scaling Up
Quizzes
Mon, Oct 26Quiz 4 (L12-L15)Module: Scaling Up
QUIZZES
Wed, Oct 28
Lectures
Wed, Oct 28Lecture 17: Distributed trainingModule: Scaling Up
Fri, Oct 30
Homeworks
Fri, Oct 30Homework 4: Multimodal Foundation Models (Slot A)
DUE
11
Mon, Nov 2
Lectures
Mon, Nov 2Lecture 18: Flash Attention / Efficient decoding strategiesModule: Scaling Up
Homeworks
Mon, Nov 2Homework 4: Multimodal Foundation Models (Slot B)
DUE
Homeworks
Mon, Nov 2Homework 623: (10-623 and 10-723 only)Module: Advanced Topics
RELEASED
Wed, Nov 4
Lectures
Wed, Nov 4Lecture 19: Long Context in LLM / RAGModule: Advanced Topics
Fri, Nov 6
Programming Tests
Fri, Nov 6Programming Test (HW3/HW4)Module: Advanced Topics
TESTS
12
Mon, Nov 9
Lectures
Mon, Nov 9Lecture 20: Reasoning ModelsModule: Advanced Topics
Exams
Mon, Nov 9ExamModule: Advanced Topics
EXAM
Wed, Nov 11
Lectures
Wed, Nov 11Lecture 21: State Space Models / Hybrid ModelsModule: Advanced Topics
Fri, Nov 13
Project
Fri, Nov 13Project: Proposal
DUE
13
Mon, Nov 16
Lectures
Mon, Nov 16Lecture 22: Real-world Issues and Considerations / What can go wrong? / SafetyModule: Advanced Topics
Quizzes
Mon, Nov 16Quiz 5 (L16-L20)Module: Advanced Topics
QUIZZES
Wed, Nov 18
Lectures
Wed, Nov 18Lecture 23: Audio understanding and synthesisModule: Advanced Topics
14
Mon, Nov 23
Lectures
Mon, Nov 23Lecture 24: Code Generation / Autonomous AgentsModule: Advanced Topics
Project
Mon, Nov 23Project: Midway Update
DUE
15
Mon, Nov 30
Lectures
Mon, Nov 30Lecture 25: Generative Models for VideosModule: Advanced Topics
Quizzes
Mon, Nov 30Quiz 6 (L21-L24)Module: Advanced Topics
QUIZZES
Homeworks
Mon, Nov 30Homework 623: (10-623 and 10-723 only) (Slot A)Module: Advanced Topics
DUE
Wed, Dec 2
Lectures
Wed, Dec 2Lecture 26: Interactive World ModelsModule: Advanced Topics
Fri, Dec 4
Project
Fri, Dec 4Project Final Presentations
Sun, Dec 6
Project
Sun, Dec 6Project: Final Poster
DUE
16
Thu, Dec 10
Project
Thu, Dec 10Project: Final Report
DUE