Date 
Week 
Qz 
Title / Post 
Lecture PDF 
Focus 
Video (Split2Modules) 
Study Note 
0825 
W1 

Introduction 
Slides: S0Intro 
basics 
M1 / M2 / M3 
Numpy Tutorial 
Extra 
Extra 

Algebra Review 
Slides: S0AlgbReview 
prerequisite 
scikitlearn tutorials 
Khanacademy Math + CMU study note 
Extra 
Extra 

ProbReview 
Slides: S0ProbReview 
prerequisite 
old video 
scikitlearn code examples 
Platform 
Platform 

Scikitlearn 
Slides: S0scikitlearn 
library 
How install 
basic tutorial 
Section 1  Basics Supervised & On Tabular Input Type

0827 
W1 

Machine Learning in a Nutshell 
Slides: S1nutshell 
basics 
M1 / M2 / M3 
two modes running example 
0901 
W2 
Q1 
Linear Regression 
Slides: S1LinearReg 
tabular 
M1 / M2 / M3 / M4 
linear regression coderun + regression on COVID19 
0903 
W2 

GD and SGD for LR 
Slides: S1LROptimization 
tabular 
M1 + M2 
SGD Jupyter notebook + numpy linalg 
0908 
W3 
Q2 
LR with basis 
Slides: S1LRSelectExtend 
tabular 
M1 + M2 
polynomial regression notebook + RBF regression notebook 
0910 
W3 

Workflow for model selection 
Slides: S1ModelSelect 
tabular 
video 
hyperpara select notebook + flow API 
0915 
W4 
Q3 
Linear Prediction with Regularization 
Slides: S1lrRegularized 
tabular 
M1 + M2 
notebook regularized RBF regression + old video on advanced 
0917 
W4 

KNN and Theory 
Slides: S1KNN 
tabular 
M1 + M2 
kNN notebook 
0922 
W5 
Q4 
Bias Variance Tradeoff 
Slides: S1biasVariance 
theory 
M1 + M2 
notebook validation and learning curves 
Platform 
Platform 

machine leanring in the AWS cloud 
Slides: S1CloudML 
library 
video 
Invited Speaker Teach 
Extra 
Extra 

Lasso and Elastic Net 
Slides: S1lrSparse 
tabular 
video 
Elastic paper 
Section 2  Deep Supervised and on 2D Grid Type (e.g. Imaging)

0924 
W5 

ProbReview + MLE 
Slides: S2MLE 
basics 
video 
Error Metrics 
WE ARE HERE 
0929 
W6 
Q5 
Logistic and NN 
Slides: S2LogisticReg 
structured 
video 
code + compare classifiers 
1001 
W6 

NN and Deep Learning 
Slides: S2basicDeepNN 
structured 
MLP video 

1006 
W7 
Q6 
CNN 
Slides: S2CovNN 
2d(vision) 
video 
CNN 
1008 
W7 

PCA, TSNE, UMAP 
Slides: S2PCAVAE 
tabular 

DNN Cheatsheets 
Extra 
Extra 

semisupervised 
Slides: S2semiselflearning 
advanced 


Extra 
Extra 

auto differentiation 
Slides: S2autograd 
advanced 


Extra 
Extra 

Quick survey of recent deep learning 
Slides: S2deepSurvey 
structured 
video 
DNN Cheatsheets 
Platform 
Platform 

S2 L0b Ta Pytorch 
Slides: S2pytorch 
library 

TA survey pytorch 
Section 3  More Advanced Supervsied on Tabular Type

1015 
W8 
Q7 
SVM 
Slides: S3SVMbasic 
tabular 
video 
More SVM 
1020 
W9 

SVM, Kernel 
Slides: S3SVMkernel 
structured 
video 
VC Theory 
1022 
W9 
Q8 
DecisionTree and Bagging 
Slides: S3DecisionTree 
tabular 
video 
xgboost 
1027 
W10 

RF and Boosting 
Slides: S3ensembleboosting 
tabular 
video 
xgboost 
Extra 
Extra 

SVM, Dual 
Slides: S3SVMoptimDual 
optimize 
video 
SMO + Paper SMO 
Section 4  Supervised on 1D Sequence Type (e.g. Language Text)

1029 
W10 
Q9 
Generative Classification 
Slides: S4BayesClassify 
basics 
video 

1103 
W11 

Gaussian BC 
Slides: S4GenerDiscr 
tabular 
video 
Paper Discr vs. Genera 
1105 
W11 
Q10 
NaiveBC on Text 
Slides: S5NBCtext 
1D(Text) 
video 
Multinomial MLE 
1110 
W12 

Recent deep learning on Text 
Slides: S4deepText 
1D(Text) 
video 
DNN Cheatsheets 
1112 
W12 
Q11 
Learning to Recommend on Text 
Slides: S4deepRecommend 
1D(Text) 
video 

Extra 
Extra 

probabilistic programming 
Slides: S2probprogram 
advanced 


Extra 
Extra 

Feature Selection and Model Selection 
Slides: S4feaSelc 
tabular 
video 
API + ELS Ch3.4 and Ch3.3 
Platform 
Platform 

adversarial machine leanring in NLP 
Slides: S3TextAttack 
library 

Invited Speaker 
Section 5  Not Supervised

1117 
W13 

Clustering Hier 
Slides: S5clusteringHier 
tabular 
video 
compare Hier clusterings 
1119 
W13 
Q12 
Clustering Partition 
Slides: S5clusteringkMeans 
tabular 
video 
compare clusterings 
1124 
W14 

RL 
Slides: S5reinforcementlearning 
advanced 
video 
xgboost 
Extra 
Extra 

Clustering GMM 
Slides: S5clusteringGMM 
advanced 
video 
EM primer 
Platform 
Platform 

deep RL Gym 
Slides: S5RLgym 
library 

Invited Speaker 
Section 6  Wrap Up


W14 
QM 
Review 
Slides: L20review 

video 
[Cheatsheets] 



Project Presentations 
Slides: Team Presentations 


[deep2reproduce] 