2019 Fall UVa CS 6316 Machine Learning Lectures Organized by Tags

Click on a tag to see relevant list of lectures.

• 1Basic
• 2Regression
• 3Classification
• 4Unsupervised
• 5Theory
• Deep
• DimenReduct
• Discriminative
• Ensemble
• Generative
• Linear
• Local
• ModelSelection
• Nonlinear
• Optimization
• Regularization

---

1Basic

Title	Lecture	Extra Content	Notes	Video
Introduction	Slide	PDF	Numpy Tutorial	video
Algebra Review	Slide	PDF	Useful Math	video
Linear Regression	Slide		LR more + ELS Ch3.2	video
supervised classification	Slide		Error Metrics	video
ProbReview + MLE	Slide	PDF	MLE / MLE code	video
Review	Slide	PDF	[Cheatsheets]	video
Friday Final Project Presentations	Slide		[deep2reproduce]

2Regression

Title	Lecture	Extra Content	Notes	Video
Linear Regression	Slide		LR more + ELS Ch3.2	video
Optimization for LR	Slide		Useful SGD	video
Nonlinear Regression	Slide	PDF	NonLinear + API + ELS Ch5	video
Linear Prediction with Regularization	Slide		More Ridge	video
Lasso and Elastic Net	Slide	PDF	Elastic paper	video
Feature Selection and Model Selection	Slide	PDF	API + ELS Ch3.4 and Ch3.3	video

3Classification

Title	Lecture	Extra Content	Notes	Video
KNN and Theory	Slide	PDF	Useful BiasVar	video
SVM	Slide	PDF	More SVM	video
SVM, Kernel	Slide	PDF	VC Theory	video
SVM, Dual	Slide	PDF	SMO + Paper SMO	video
Logistic and NN	Slide	PDF	code + compare classifiers	video
NN and Deep Learning	Slide	PDF		MLP video
NN and Deep Learning	Slide	PDF	CNN	video
Quick survey of recent deep learning	Slide	PDF	DNN Cheatsheets	video
Generative Classification	Slide	PDF		video
Gaussian BC	Slide	PDF	Paper Discr vs. Genera	video
NaiveBC on Text	Slide	PDF	Multinomial MLE	video
DecisionTree and Bagging	Slide	PDF	xgboost	video
RF and Boosting	Slide	PDF	xgboost	video

4Unsupervised

Title	Lecture	Extra Content	Notes	Video
Quick survey of recent deep learning	Slide	PDF	DNN Cheatsheets	video
Clustering Hier	Slide	PDF	compare Hier clusterings	video
Clustering Partition	Slide	PDF	compare clusterings	video
Clustering GMM	Slide	PDF	EM primer	video

5Theory

Title	Lecture	Extra Content	Notes	Video
KNN and Theory	Slide	PDF	Useful BiasVar	video
Bias Variance Tradeoff	Slide	PDF	ESL Ch7	video
SVM	Slide	PDF	More SVM	video
SVM, Kernel	Slide	PDF	VC Theory	video
SVM, Dual	Slide	PDF	SMO + Paper SMO	video
DecisionTree and Bagging	Slide	PDF	xgboost	video
Clustering GMM	Slide	PDF	EM primer	video

Deep

Title	Lecture	Extra Content	Notes	Video
Logistic and NN	Slide	PDF	code + compare classifiers	video
NN and Deep Learning	Slide	PDF		MLP video
NN and Deep Learning	Slide	PDF	CNN	video
Quick survey of recent deep learning	Slide	PDF	DNN Cheatsheets	video

DimenReduct

Title	Lecture	Extra Content	Notes	Video
Feature Selection and Model Selection	Slide	PDF	API + ELS Ch3.4 and Ch3.3	video

Discriminative

Title	Lecture	Extra Content	Notes	Video
SVM	Slide	PDF	More SVM	video
SVM, Kernel	Slide	PDF	VC Theory	video
SVM, Dual	Slide	PDF	SMO + Paper SMO	video
Logistic and NN	Slide	PDF	code + compare classifiers	video
NN and Deep Learning	Slide	PDF		MLP video
NN and Deep Learning	Slide	PDF	CNN	video
Quick survey of recent deep learning	Slide	PDF	DNN Cheatsheets	video
RF and Boosting	Slide	PDF	xgboost	video

Ensemble

Title	Lecture	Extra Content	Notes	Video
DecisionTree and Bagging	Slide	PDF	xgboost	video

Generative

Title	Lecture	Extra Content	Notes	Video
Quick survey of recent deep learning	Slide	PDF	DNN Cheatsheets	video
Generative Classification	Slide	PDF		video
Gaussian BC	Slide	PDF	Paper Discr vs. Genera	video
NaiveBC on Text	Slide	PDF	Multinomial MLE	video
Clustering Partition	Slide	PDF	compare clusterings	video
Clustering GMM	Slide	PDF	EM primer	video

Linear

Title	Lecture	Extra Content	Notes	Video
Linear Regression	Slide		LR more + ELS Ch3.2	video
SVM	Slide	PDF	More SVM	video
Logistic and NN	Slide	PDF	code + compare classifiers	video
RF and Boosting	Slide	PDF	xgboost	video

Local

Title	Lecture	Extra Content	Notes	Video
Nonlinear Regression	Slide	PDF	NonLinear + API + ELS Ch5	video
KNN and Theory	Slide	PDF	Useful BiasVar	video
Bias Variance Tradeoff	Slide	PDF	ESL Ch7	video

ModelSelection

Title	Lecture	Extra Content	Notes	Video
Nonlinear Regression	Slide	PDF	NonLinear + API + ELS Ch5	video
Linear Prediction with Regularization	Slide		More Ridge	video
Lasso and Elastic Net	Slide	PDF	Elastic paper	video
Feature Selection and Model Selection	Slide	PDF	API + ELS Ch3.4 and Ch3.3	video
KNN and Theory	Slide	PDF	Useful BiasVar	video

Nonlinear

Title	Lecture	Extra Content	Notes	Video
Nonlinear Regression	Slide	PDF	NonLinear + API + ELS Ch5	video
Logistic and NN	Slide	PDF	code + compare classifiers	video
NN and Deep Learning	Slide	PDF		MLP video
NN and Deep Learning	Slide	PDF	CNN	video
Quick survey of recent deep learning	Slide	PDF	DNN Cheatsheets	video

Optimization

Title	Lecture	Extra Content	Notes	Video
Optimization for LR	Slide		Useful SGD	video
Linear Prediction with Regularization	Slide		More Ridge	video
Lasso and Elastic Net	Slide	PDF	Elastic paper	video
Feature Selection and Model Selection	Slide	PDF	API + ELS Ch3.4 and Ch3.3	video
SVM	Slide	PDF	More SVM	video
SVM, Kernel	Slide	PDF	VC Theory	video
SVM, Dual	Slide	PDF	SMO + Paper SMO	video

Regularization

Title	Lecture	Extra Content	Notes	Video
Linear Prediction with Regularization	Slide		More Ridge	video
Lasso and Elastic Net	Slide	PDF	Elastic paper	video
Feature Selection and Model Selection	Slide	PDF	API + ELS Ch3.4 and Ch3.3	video
SVM	Slide	PDF	More SVM	video
SVM, Kernel	Slide	PDF	VC Theory	video
SVM, Dual	Slide	PDF	SMO + Paper SMO	video