2020 Fall UVa CS Machine Learning Lectures Organized by Tags

Click on a tag to see relevant list of lectures.

• 1Basic
• 2Regression
• 3Classification
• 4Unsupervised
• 5Theory
• Deep
• DimenReduct
• Discriminative
• Ensemble
• Gaussian
• Generative
• Linear
• Local
• ModelSelection
• Nonlinear
• Optimization
• Regularization
• notSupervised
• platform

---

1Basic

Title	Lecture	Notes	Video
Introduction	Slide	Numpy Tutorial	M1 / M2 / M3
Algebra Review	Slide	Khanacademy Math + CMU study note	scikit-learn tutorials
Scikit-learn	Slide	basic tutorial + scikit-learn code examples	How install
Machine Learning in a Nutshell	Slide	two modes running example	M1 / M2 / M3
Linear Regression	Slide	linear regression coderun + regression on COVID19	M1 / M2 / M3 / M4
ProbReview + MLE	Slide	Error Metrics	M1
Prob Review	Slide		M1 + M2
Review	Slide	[ML Cheatsheets]	video + HW1-3 Key HW4-key + Quiz-keys
Project Presentations (on Dec7 and Dec8)	Slide	[deep2reproduce]

2Regression

Title	Lecture	Notes	Video
Linear Regression	Slide	linear regression coderun + regression on COVID19	M1 / M2 / M3 / M4
GD and SGD for LR	Slide	SGD Jupyter notebook + numpy linalg	M1 + M2
LR with basis	Slide	polynomial regression notebook + RBF regression notebook	M1 + M2
Workflow for model selection	Slide	hyperpara select notebook + flow API	M1
Linear Prediction with Regularization	Slide	notebook regularized RBF regression + old video on advanced	M1 + M2 + Extra M3
Lasso and Elastic Net	Slide	Elastic paper	Extra M3

3Classification

Title	Lecture	Notes	Video
KNN and Theory	Slide	kNN notebook	M1 + M2
Logistic and NN	Slide	code + compare classifiers	M1 + M2
NN and Deep Learning	Slide	DNN Cheatsheets	M1+ M2+ M3+ M4
CNN	Slide	Keras + FastAI examples	M1+ M2
Generative Classification	Slide	text NBC notebook	M1 + M2 + (Extra M3 )
NaiveBC on Text	Slide	text NBC notebook	M1 + M2 + (Extra M3 + M4)
Quick survey of recent deep learning	Slide	DNN Cheatsheets	M1 + M2 + M3 + M4
Gaussian GBC	Slide	Paper Discr vs. Genera	Extra M4
Learning to Generate	Slide
SVM	Slide	PCA+SVM Notebook	M1 + M2
SVM, Kernel	Slide	Practical Guide	M1 + M2 + M3 + (Extra M4)
DecisionTree and Bagging	Slide		M1 + M2 + M3
RF and Boosting	Slide	xgboost	M1 + M2 + M3 + M4
SVM, Dual	Slide	SMO	Extra M4
convex optim with Dual	Slide	VC Theory
More on Boosting	Slide

4Unsupervised

Title	Lecture	Notes	Video
Recent deep learning on Text	Slide	Keras Notebook on DNN text	M1 + M2 + M3
Quick survey of recent deep learning	Slide	DNN Cheatsheets	M1 + M2 + M3 + M4
Clustering Hier	Slide	compare Hier clusterings	M1 + M2
Clustering Partition	Slide	compare clusterings	M1 + M2 + (Extra M3)
Clustering GMM	Slide
Clustering GMM	Slide	EM primer

5Theory

Title	Lecture	Notes	Video
KNN and Theory	Slide	kNN notebook	M1 + M2
Bias Variance Tradeoff	Slide	notebook validation and learning curves	M1 + M2
SVM	Slide	PCA+SVM Notebook	M1 + M2
SVM, Kernel	Slide	Practical Guide	M1 + M2 + M3 + (Extra M4)
DecisionTree and Bagging	Slide		M1 + M2 + M3
SVM, Dual	Slide	SMO	Extra M4
convex optim with Dual	Slide	VC Theory
More on Boosting	Slide
Clustering GMM	Slide
Clustering GMM	Slide	EM primer

Deep

Title	Lecture	Notes	Video
Logistic and NN	Slide	code + compare classifiers	M1 + M2
NN and Deep Learning	Slide	DNN Cheatsheets	M1+ M2+ M3+ M4
CNN	Slide	Keras + FastAI examples	M1+ M2
Recent deep learning on Text	Slide	Keras Notebook on DNN text	M1 + M2 + M3
Quick survey of recent deep learning	Slide	DNN Cheatsheets	M1 + M2 + M3 + M4

DimenReduct

Title	Lecture	Notes	Video
PCA, Feature Selection	Slide	Great PCA Video + PCA Notebook	M1
Feature Selection	Slide	ELS Ch3.4 and Ch3.3 + API	(Extra M2 + M3 )

Discriminative

Title	Lecture	Notes	Video
Logistic and NN	Slide	code + compare classifiers	M1 + M2
NN and Deep Learning	Slide	DNN Cheatsheets	M1+ M2+ M3+ M4
CNN	Slide	Keras + FastAI examples	M1+ M2
Recent deep learning on Text	Slide	Keras Notebook on DNN text	M1 + M2 + M3
Quick survey of recent deep learning	Slide	DNN Cheatsheets	M1 + M2 + M3 + M4
SVM	Slide	PCA+SVM Notebook	M1 + M2
SVM, Kernel	Slide	Practical Guide	M1 + M2 + M3 + (Extra M4)
RF and Boosting	Slide	xgboost	M1 + M2 + M3 + M4
SVM, Dual	Slide	SMO	Extra M4
convex optim with Dual	Slide	VC Theory

Ensemble

Title	Lecture	Notes	Video
DecisionTree and Bagging	Slide		M1 + M2 + M3
RF and Boosting	Slide	xgboost	M1 + M2 + M3 + M4
More on Boosting	Slide

Gaussian

Title	Lecture	Notes	Video
Gaussian GBC	Slide	Paper Discr vs. Genera	Extra M4

Generative

Title	Lecture	Notes	Video
Generative Classification	Slide	text NBC notebook	M1 + M2 + (Extra M3 )
NaiveBC on Text	Slide	text NBC notebook	M1 + M2 + (Extra M3 + M4)
Recent deep learning on Text	Slide	Keras Notebook on DNN text	M1 + M2 + M3
Quick survey of recent deep learning	Slide	DNN Cheatsheets	M1 + M2 + M3 + M4
Gaussian GBC	Slide	Paper Discr vs. Genera	Extra M4
probabilistic programming	Slide
Clustering Partition	Slide	compare clusterings	M1 + M2 + (Extra M3)
Clustering GMM	Slide
Clustering GMM	Slide	EM primer

Linear

Title	Lecture	Notes	Video
Linear Regression	Slide	linear regression coderun + regression on COVID19	M1 / M2 / M3 / M4
Logistic and NN	Slide	code + compare classifiers	M1 + M2
SVM	Slide	PCA+SVM Notebook	M1 + M2

Local

Title	Lecture	Notes	Video
LR with basis	Slide	polynomial regression notebook + RBF regression notebook	M1 + M2
Workflow for model selection	Slide	hyperpara select notebook + flow API	M1
KNN and Theory	Slide	kNN notebook	M1 + M2
Bias Variance Tradeoff	Slide	notebook validation and learning curves	M1 + M2

ModelSelection

Title	Lecture	Notes	Video
LR with basis	Slide	polynomial regression notebook + RBF regression notebook	M1 + M2
Workflow for model selection	Slide	hyperpara select notebook + flow API	M1
Linear Prediction with Regularization	Slide	notebook regularized RBF regression + old video on advanced	M1 + M2 + Extra M3
KNN and Theory	Slide	kNN notebook	M1 + M2
Lasso and Elastic Net	Slide	Elastic paper	Extra M3
Feature Selection	Slide	ELS Ch3.4 and Ch3.3 + API	(Extra M2 + M3 )

Nonlinear

Title	Lecture	Notes	Video
LR with basis	Slide	polynomial regression notebook + RBF regression notebook	M1 + M2
Workflow for model selection	Slide	hyperpara select notebook + flow API	M1
Logistic and NN	Slide	code + compare classifiers	M1 + M2
NN and Deep Learning	Slide	DNN Cheatsheets	M1+ M2+ M3+ M4
CNN	Slide	Keras + FastAI examples	M1+ M2
Recent deep learning on Text	Slide	Keras Notebook on DNN text	M1 + M2 + M3
Quick survey of recent deep learning	Slide	DNN Cheatsheets	M1 + M2 + M3 + M4

Optimization

Title	Lecture	Notes	Video
GD and SGD for LR	Slide	SGD Jupyter notebook + numpy linalg	M1 + M2
Linear Prediction with Regularization	Slide	notebook regularized RBF regression + old video on advanced	M1 + M2 + Extra M3
Lasso and Elastic Net	Slide	Elastic paper	Extra M3
auto differentiation	Slide
probabilistic programming	Slide
SVM	Slide	PCA+SVM Notebook	M1 + M2
SVM, Kernel	Slide	Practical Guide	M1 + M2 + M3 + (Extra M4)
SVM, Dual	Slide	SMO	Extra M4
convex optim with Dual	Slide	VC Theory
More on Boosting	Slide

Regularization

Title	Lecture	Notes	Video
Linear Prediction with Regularization	Slide	notebook regularized RBF regression + old video on advanced	M1 + M2 + Extra M3
Lasso and Elastic Net	Slide	Elastic paper	Extra M3
SVM	Slide	PCA+SVM Notebook	M1 + M2
SVM, Kernel	Slide	Practical Guide	M1 + M2 + M3 + (Extra M4)
SVM, Dual	Slide	SMO	Extra M4
convex optim with Dual	Slide	VC Theory

notSupervised

Title	Lecture	Notes	Video
deep RL Gym	Slide	Invited Speaker
self/semi-supervised	Slide

platform

Title	Lecture	Notes	Video
Scikit-learn	Slide	basic tutorial + scikit-learn code examples	How install
machine leanring in the AWS cloud	Slide	Invited Speaker	video
pyTorch + Keras	Slide	S3-L0-pytorch + FastAI Cov19-Notebook	see slack
adversarial text	Slide	Invited Speaker