19Fall CS6316 - Machine Learning
MoWe 2:00PM - 3:15PM @ MEC 205
Schedule
Syllabus
Assignments
Slides
Topics
2019 Fall UVa CS 6316 Machine Learning Lectures Organized by Given Order
---- ----
Introduction
Lecture: L01-intro
Version: current
More to Read:
Q0
Useful to Read:
Numpy Tutorial
Video:
video
1Basic
Algebra Review
Lecture: L02-review
Version: current
More to Read:
L2-linalg-notes
Useful to Read:
Useful Math
Video:
video
1Basic
Linear Regression
Lecture: L03-lr
Version: current
Useful to Read:
LR more
+
ELS Ch3.2
Video:
video
2Regression
Linear
1Basic
Optimization for LR
Lecture: L04-lropt
Version: current
Useful to Read:
Useful SGD
Video:
video
2Regression
Optimization
Nonlinear Regression
Lecture: L05-lrExtend-SelectModel
Version: current
More to Read:
L05E-nonparametricR
Useful to Read:
NonLinear
+
API
+
ELS Ch5
Video:
video
2Regression
Nonlinear
ModelSelection
Local
Linear Prediction with Regularization
Lecture: L06-lrReg
Version: current
Useful to Read:
More Ridge
Video:
video
2Regression
Optimization
Regularization
ModelSelection
Lasso and Elastic Net
Lecture: L06-lrReg
Version: current
More to Read:
L06extra-lrRegOpm
Useful to Read:
Elastic paper
Video:
video
2Regression
Optimization
Regularization
ModelSelection
Feature Selection and Model Selection
Lecture: L07-feaSelc
Version: current
More to Read:
L07-FeatureSelect-jmlrPaper
Useful to Read:
API
+
ELS Ch3.4 and Ch3.3
Video:
video
2Regression
Optimization
Regularization
DimenReduct
ModelSelection
supervised classification
Lecture: L08-SCbasic
Version: current
Useful to Read:
Error Metrics
Video:
video
1Basic
KNN and Theory
Lecture: L09-KNN
Version: current
More to Read:
L09-KNN-extra
Useful to Read:
Useful BiasVar
Video:
video
3Classification
5Theory
Local
ModelSelection
Bias Variance Tradeoff
Lecture: L10-biasVariance
Version: current
More to Read:
L10-Tibshirani-modelbasics
Useful to Read:
ESL Ch7
Video:
video
5Theory
Local
SVM
Lecture: L11-SVM-basic
Version: current
More to Read:
L11-LibSVMGuide
Useful to Read:
More SVM
Video:
video
3Classification
Linear
Discriminative
Regularization
Optimization
5Theory
SVM, Kernel
Lecture: L11b-SVM-kerneltrick
Version: current
More to Read:
L11-LibSVMGuide
Useful to Read:
VC Theory
Video:
video
3Classification
Discriminative
Regularization
Optimization
5Theory
SVM, Dual
Lecture: L11c-SVM-optimDual
Version: current
More to Read:
L11Extra-SVMoptimDual
Useful to Read:
SMO
+
Paper SMO
Video:
video
3Classification
Discriminative
Regularization
Optimization
5Theory
ProbReview + MLE
Lecture: L12-ProbReview
Version: current
More to Read:
L13-MLE
Useful to Read:
MLE
/
MLE code
Video:
video
1Basic
Logistic and NN
Lecture: L14-Logistic
Version: current
More to Read:
L14extra-Logistic
Useful to Read:
code
+
compare classifiers
Video:
video
3Classification
Nonlinear
Deep
Linear
Discriminative
NN and Deep Learning
Lecture: L15-NNB
Version: current
More to Read:
L15-lecun-98b
Video:
MLP video
3Classification
Nonlinear
Deep
Discriminative
NN and Deep Learning
Lecture: L15b-NNRecap
Version: current
More to Read:
L16-PCA
Useful to Read:
CNN
Video:
video
3Classification
Nonlinear
Deep
Discriminative
Quick survey of recent deep learning
Lecture: L15c-deepReview
Version: current
More to Read:
L16-PCA
Useful to Read:
DNN Cheatsheets
Video:
video
3Classification
Nonlinear
Deep
Discriminative
4Unsupervised
Generative
Generative Classification
Lecture: L17-BC
Version: current
More to Read:
L16-PCA
Video:
video
3Classification
Generative
Gaussian BC
Lecture: L17b-GenerDiscr
Version: current
More to Read:
L17c-NBCtext
Useful to Read:
Paper Discr vs. Genera
Video:
video
3Classification
Generative
NaiveBC on Text
Lecture: L17c-NBCtext
Version: current
More to Read:
L20-review
Useful to Read:
Multinomial MLE
Video:
video
3Classification
Generative
DecisionTree and Bagging
Lecture: L18-DT
Version: current
More to Read:
L22-review
Useful to Read:
xgboost
Video:
video
3Classification
Ensemble
5Theory
RF and Boosting
Lecture: L18b-ensemble
Version: current
More to Read:
L18c-More-Boosting
Useful to Read:
xgboost
Video:
video
3Classification
Linear
Discriminative
Clustering Hier
Lecture: L19-clustering1-Hier
Version: current
More to Read:
L19c-clustering3-GMM
Useful to Read:
compare Hier clusterings
Video:
video
4Unsupervised
Clustering Partition
Lecture: L19b-clustering2-kMeans
Version: current
More to Read:
L19d-EMextra-EM
Useful to Read:
compare clusterings
Video:
video
4Unsupervised
Generative
Clustering GMM
Lecture: L19c-clustering3-GMM
Version: current
More to Read:
L19d-EMextra-EM
Useful to Read:
EM primer
Video:
video
4Unsupervised
Generative
5Theory
Review
Lecture: L20-review
Version: current
More to Read:
L20-AfewUseful
Useful to Read:
[Cheatsheets]
Video:
video
1Basic
Friday Final Project Presentations
Lecture: Team Presentations
Version: current
Useful to Read:
[deep2reproduce]
1Basic
BackTop