Session	Topics	Materials
Week 1
1 Monday Nov 29	Course Overview Introduction to Reinforcement Learning	Syllabus
2 Tuesday Nov 30	Lab: Cross-Entropy Method
Linux Installation DUE Wednesday 12/01/21 11:55 pm Submit Here
3 Thursday Dec 02	Lab: Cross-Entropy Method (cnt.)	Instruction Lab Submission Guideline
4 Friday Dec 03	Markov Reward Process Bellman Equation	Coding Activity
Lab CEM DUE Friday 12/03/21 11:55 pm Submit Here
Week 2
5 Monday Dec 06	Markov Decision Process	Coding Activity
6 Tuesday Dec 07	Dynamic Programming Value Iteration Policy Iteration
7 Thursday Dec 09	Demo: Policy Iteration
8 Friday Dec 10	Lab: Value Iteration	Instruction
Lab Value Iteration DUE Friday 12/10/21 11:55 pm Submit Here
Week 3
9 Monday Dec 13	Model-free Prediction and Control N-step MC and TD
10 Tuesday Dec 14	Lab/Demo: SARSA	Instruction
11 Thursday Dec 16	Lab/Demo: SARSA (continue)
Lab Sarsa DUE Thursday 12/16/21 11:55 pm Submit Here
12 Friday Dec 17	Deep Learning in One Day
Week 4
13 Monday Jan 03	BackProp Algorithms	A Great Article on BP
14 Tuesday Jan 04	PyTorch Tutorial	NN Regression Code
15 Thursday Jan 06	Lab: PyTorch Lab	Instruction Regression
16 Friday Jan 07	Lab/Demo: PyTorch Lab	Train a Classifier
Lab Pytorch DUE Friday 01/07/22 11:55 pm Submit Here
Week 5
17 Monday Jan 10	Q learning On-policy v.s. Off-policy	Q learning for FrozenLake
18 Tuesday Jan 11	DQN	DQN Code
19 Thursday Jan 13	Lab: DDPG	Instruction
20 Friday Jan 14	Lab: DDPG (continue)
Lab DDPG DUE Friday 01/14/22 11:55 pm Submit Here
Week 6
21 Monday Jan 17	Policy Gradient	REINFORCE Code
22 Tuesday Jan 18	A2C	A2C Code
23 Thursday Jan 20	Lab: Enhanced A2C	Instruction
24 Friday Jan 21	Lab: Enhanced A2C (continue)
Lab Enhanced A2C DUE Friday 01/21/22 11:55 pm Submit Here
Week 7
25 Monday Jan 24	PPO I	OpenAI tutorial on PPO
26 Tuesday Jan 25	PPO II	PPO Demo Code
27 Thursday Jan 27	Lab: SAC	Instruction You need to start preparing Paper Reading/Presentation
28 Friday Jan 28	Lab: SAC (continue)
Lab SAC DUE Friday 01/28/22 11:55 pm Submit Here
Week 8
29 Monday Jan 31	Model-Based RL	LQR Demo Code
30 Tuesday Feb 01	Model-Based RL II	PETS Paper
31 Thursday Feb 03	Project Prep Day
32 Friday Feb 04	Project Proposal (no class)	Each group needs to meet with me by the end of today.
Project Proposal Meeting DUE Friday 02/04/22 11:55 pm
Week 9
33 Monday Feb 07	Seminar: AlphaGo
34 Tuesday Feb 08	Project Work Time/Seminar (TBD)
35 Thursday Feb 10	Project Work Time
36 Friday Feb 11	Paper Presentation
Week 10
37 Monday Feb 14	Project Work Time
38 Tuesday Feb 15	Project Work Time
39 Thursday Feb 17	Final Presentation	Team 1 and Team 2
40 Friday Feb 18	No Class