2025 Fall UVa CS Machine Learning Lectures Organized by Tags

Click on a tag to see relevant list of lectures.

• 1Basic
• 2Regression
• 3Classification
• 4Unsupervised
• 5Theory
• Deep
• DimenReduct
• Discriminative
• Ensemble
• Gaussian
• Generative
• Linear
• Local
• ModelSelection
• Nonlinear
• Optimization
• RL
• Regularization
• notSupervised
• platform

---

1Basic

Title	Lecture	Notes	Video
Introduction	Slide	Numpy Tutorial	M2 / M3
Algebra Review	Slide	Khanacademy Math + CMU study note	Python Data Science Code tutorials
Scikit-learn	Slide	basic tutorial + scikit-learn code examples	How install
Machine Learning in a Nutshell	Slide	two modes running example	M1 / M2 / M3
Linear Regression	Slide	linear regression coderun	M1 / M2 / M3 / M4
ProbReview + MLE	Slide	Error Metrics	M1
Prob Review	Slide		M1 + M2
Review	Slide	[ML Cheatsheets]	video + HW1-3 Key HW4-key + Quiz-keys

2Regression

Title	Lecture	Notes	Video
Linear Regression	Slide	linear regression coderun	M1 / M2 / M3 / M4
GD and SGD for LR	Slide	SGD Jupyter notebook + numpy linalg +	M1 + M2
LR with basis	Slide	L5_Poly_Regression.ipynb	M1 + M2
Workflow for model selection	Slide	hyperpara select notebook + flow API	M1
Linear Prediction with Regularization	Slide		M1 + M2 + Extra M3
Lasso and Elastic Net	Slide	Elastic paper	Extra M3

3Classification

Title	Lecture	Notes	Video
KNN and Theory	Slide		M1 + M2
Logistic and NN	Slide	compare classifiers	M1 + M2
NN and Deep Learning	Slide	DNN Cheatsheets	M1+ M2+ M3
CNN	Slide	Keras notebook + another Keras Kaggle notebook	M1+ M2
Generative Classification	Slide	text NBC notebook	M1 + M2 + (Extra M3 )
NaiveBC on Text	Slide	text NBC notebook	M1 + M2 + (Extra M3 + M4)
Gaussian GBC	Slide	Paper Discr vs. Genera	Extra M4
Quick survey of recent deep learning	Slide	DNN Cheatsheets	M1 + M2 + M3 + M4
SVM	Slide	PCA+SVM Notebook	M1 + M2
SVM, Kernel	Slide	Practical Guide	M1 + M2 + M3 + (Extra M4)
DecisionTree and Bagging	Slide		M1 + M2 + M3
RF and Boosting	Slide	xgboost	M1 + M2 + M3 + M4
SVM, Dual	Slide	SMO	Extra M4
convex optim with Dual	Slide	VC Theory
More on Boosting	Slide

4Unsupervised

Title	Lecture	Notes	Video
Recent deep learning on Text	Slide	Keras Notebook on DNN text	M1 + M2 + M3
Quick survey of recent deep learning	Slide	DNN Cheatsheets	M1 + M2 + M3 + M4
Clustering Hier	Slide	compare Hier clusterings	M1 + M2
Clustering Partition	Slide	compare clusterings	M1 + M2
Clustering GMM	Slide		(Extra M3)
Clustering GMM	Slide	EM primer

5Theory

Title	Lecture	Notes	Video
KNN and Theory	Slide		M1 + M2
Bias Variance Tradeoff	Slide	notebook validation and learning curves	M1 + M2
SVM	Slide	PCA+SVM Notebook	M1 + M2
SVM, Kernel	Slide	Practical Guide	M1 + M2 + M3 + (Extra M4)
DecisionTree and Bagging	Slide		M1 + M2 + M3
SVM, Dual	Slide	SMO	Extra M4
convex optim with Dual	Slide	VC Theory
More on Boosting	Slide
Reinforcement Learning	Slide
Clustering GMM	Slide		(Extra M3)
Clustering GMM	Slide	EM primer

Deep

Title	Lecture	Notes	Video
Logistic and NN	Slide	compare classifiers	M1 + M2
NN and Deep Learning	Slide	DNN Cheatsheets	M1+ M2+ M3
CNN	Slide	Keras notebook + another Keras Kaggle notebook	M1+ M2
Recent deep learning on Text	Slide	Keras Notebook on DNN text	M1 + M2 + M3
Quick survey of recent deep learning	Slide	DNN Cheatsheets	M1 + M2 + M3 + M4

DimenReduct

Title	Lecture	Notes	Video
PCA, Feature Selection	Slide	Great PCA Video + PCA Notebook	M1
Feature Selection	Slide	S3-QuizReview + ELS Ch3.4 and Ch3.3 + API	(Extra M2 + M3 )

Discriminative

Title	Lecture	Notes	Video
Logistic and NN	Slide	compare classifiers	M1 + M2
NN and Deep Learning	Slide	DNN Cheatsheets	M1+ M2+ M3
CNN	Slide	Keras notebook + another Keras Kaggle notebook	M1+ M2
Recent deep learning on Text	Slide	Keras Notebook on DNN text	M1 + M2 + M3
Quick survey of recent deep learning	Slide	DNN Cheatsheets	M1 + M2 + M3 + M4
SVM	Slide	PCA+SVM Notebook	M1 + M2
SVM, Kernel	Slide	Practical Guide	M1 + M2 + M3 + (Extra M4)
RF and Boosting	Slide	xgboost	M1 + M2 + M3 + M4
SVM, Dual	Slide	SMO	Extra M4
convex optim with Dual	Slide	VC Theory

Ensemble

Title	Lecture	Notes	Video
DecisionTree and Bagging	Slide		M1 + M2 + M3
RF and Boosting	Slide	xgboost	M1 + M2 + M3 + M4
More on Boosting	Slide

Gaussian

Title	Lecture	Notes	Video
Gaussian GBC	Slide	Paper Discr vs. Genera	Extra M4

Generative

Title	Lecture	Notes	Video
Recent deep learning on Text	Slide	Keras Notebook on DNN text	M1 + M2 + M3
Generative Classification	Slide	text NBC notebook	M1 + M2 + (Extra M3 )
NaiveBC on Text	Slide	text NBC notebook	M1 + M2 + (Extra M3 + M4)
Gaussian GBC	Slide	Paper Discr vs. Genera	Extra M4
Quick survey of recent deep learning	Slide	DNN Cheatsheets	M1 + M2 + M3 + M4
Clustering Partition	Slide	compare clusterings	M1 + M2
Clustering GMM	Slide		(Extra M3)
Clustering GMM	Slide	EM primer

Linear

Title	Lecture	Notes	Video
Linear Regression	Slide	linear regression coderun	M1 / M2 / M3 / M4
Logistic and NN	Slide	compare classifiers	M1 + M2
SVM	Slide	PCA+SVM Notebook	M1 + M2

Local

Title	Lecture	Notes	Video
LR with basis	Slide	L5_Poly_Regression.ipynb	M1 + M2
Workflow for model selection	Slide	hyperpara select notebook + flow API	M1
KNN and Theory	Slide		M1 + M2
Bias Variance Tradeoff	Slide	notebook validation and learning curves	M1 + M2

ModelSelection

Title	Lecture	Notes	Video
LR with basis	Slide	L5_Poly_Regression.ipynb	M1 + M2
Workflow for model selection	Slide	hyperpara select notebook + flow API	M1
Linear Prediction with Regularization	Slide		M1 + M2 + Extra M3
KNN and Theory	Slide		M1 + M2
Lasso and Elastic Net	Slide	Elastic paper	Extra M3
Feature Selection	Slide	S3-QuizReview + ELS Ch3.4 and Ch3.3 + API	(Extra M2 + M3 )

Nonlinear

Title	Lecture	Notes	Video
LR with basis	Slide	L5_Poly_Regression.ipynb	M1 + M2
Workflow for model selection	Slide	hyperpara select notebook + flow API	M1
Logistic and NN	Slide	compare classifiers	M1 + M2
NN and Deep Learning	Slide	DNN Cheatsheets	M1+ M2+ M3
CNN	Slide	Keras notebook + another Keras Kaggle notebook	M1+ M2
Recent deep learning on Text	Slide	Keras Notebook on DNN text	M1 + M2 + M3
Quick survey of recent deep learning	Slide	DNN Cheatsheets	M1 + M2 + M3 + M4

Optimization

Title	Lecture	Notes	Video
GD and SGD for LR	Slide	SGD Jupyter notebook + numpy linalg +	M1 + M2
Linear Prediction with Regularization	Slide		M1 + M2 + Extra M3
Lasso and Elastic Net	Slide	Elastic paper	Extra M3
SVM	Slide	PCA+SVM Notebook	M1 + M2
SVM, Kernel	Slide	Practical Guide	M1 + M2 + M3 + (Extra M4)
SVM, Dual	Slide	SMO	Extra M4
convex optim with Dual	Slide	VC Theory
More on Boosting	Slide

RL

Title	Lecture	Notes	Video
Reinforcement Learning	Slide

Regularization

Title	Lecture	Notes	Video
Linear Prediction with Regularization	Slide		M1 + M2 + Extra M3
Lasso and Elastic Net	Slide	Elastic paper	Extra M3
SVM	Slide	PCA+SVM Notebook	M1 + M2
SVM, Kernel	Slide	Practical Guide	M1 + M2 + M3 + (Extra M4)
SVM, Dual	Slide	SMO	Extra M4
convex optim with Dual	Slide	VC Theory

notSupervised

Title	Lecture	Notes	Video
Reinforcement Learning	Slide
deep RL Gym	Slide	Invited Speaker

platform

Title	Lecture	Notes	Video
Scikit-learn	Slide	basic tutorial + scikit-learn code examples	How install
Huggingface	Slide	S2-L0-pytorch	M1
pyTorch + Keras	Slide	S2-L0-pytorch