Website for 2020-Fall-UVA-CS Machine Learning: Machine Learning Foundation, Deep Learning and Good Uses (Undergraduate Advanced)

Course Schedule and Notes

The lectures' schedule below is tentative and is continually subject to change; We will move at whatever pace we find comfortable.  

Date Week Qz Title / Post Lecture PDF Focus Video (Split2Modules) Study Note
0825 W1 Introduction Slides: S0-Intro basics M1 / M2 / M3 Numpy Tutorial
Extra Extra Algebra Review Slides: S0-AlgbReview prerequisite scikit-learn tutorials Khanacademy Math + CMU study note
Extra Extra ProbReview Slides: S0-ProbReview prerequisite old video scikit-learn code examples
Platform Platform Scikit-learn Slides: S0-scikit-learn library How install basic tutorial

Section 1 - Basics Supervised & On Tabular Input Type

0827 W1 Machine Learning in a Nutshell Slides: S1-nutshell basics M1 / M2 / M3 two modes running example
0901 W2 Q1 Linear Regression Slides: S1-LinearReg tabular M1 / M2 / M3 / M4 linear regression coderun + regression on COVID19
0903 W2 GD and SGD for LR Slides: S1-LROptimization tabular M1 + M2 SGD Jupyter notebook + numpy linalg
0908 W3 Q2 LR with basis Slides: S1-LRSelectExtend tabular M1 + M2 polynomial regression notebook + RBF regression notebook
0910 W3 Workflow for model selection Slides: S1-ModelSelect tabular video hyperpara select notebook + flow API
0915 W4 Q3 Linear Prediction with Regularization Slides: S1-lrRegularized tabular M1 + M2 notebook regularized RBF regression + old video on advanced
0917 W4 KNN and Theory Slides: S1-KNN tabular M1 + M2 kNN notebook
0922 W5 Q4 Bias Variance Tradeoff Slides: S1-biasVariance theory M1 + M2 notebook validation and learning curves
Platform Platform machine leanring in the AWS cloud Slides: S1-CloudML library video Invited Speaker Teach
Extra Extra Lasso and Elastic Net Slides: S1-lrSparse tabular video Elastic paper

Section 2 - Deep Supervised and on 2D Grid Type (e.g. Imaging)

0924 W5 ProbReview + MLE Slides: S2-MLE basics video Error Metrics
0929 W6 Q5 Logistic and NN Slides: S2-LogisticReg structured video code + compare classifiers
1001 W6 NN and Deep Learning Slides: S2-basicDeepNN structured MLP video
1006 W7 Q6 CNN Slides: S2-CovNN 2d(vision) video CNN
1008 W7 PCA, TSNE, UMAP Slides: S2-PCA-VAE tabular DNN Cheatsheets
Extra Extra semi-supervised Slides: S2-semi-self-learning advanced
Extra Extra auto differentiation Slides: S2-auto-grad advanced
Extra Extra Quick survey of recent deep learning Slides: S2-deepSurvey structured video DNN Cheatsheets
Platform Platform S2 L0b Ta Pytorch Slides: S2-pytorch library TA survey pytorch

Section 3 - More Advanced Supervsied on Tabular Type

1015 W8 Q7 SVM Slides: S3-SVM-basic tabular video More SVM
1020 W9 SVM, Kernel Slides: S3-SVM-kernel structured video VC Theory
1022 W9 Q8 DecisionTree and Bagging Slides: S3-DecisionTree tabular video xgboost
1027 W10 RF and Boosting Slides: S3-ensemble-boosting tabular video xgboost
Extra Extra SVM, Dual Slides: S3-SVM-optimDual optimize video SMO + Paper SMO

Section 4 - Supervised on 1D Sequence Type (e.g. Language Text)

1029 W10 Q9 Generative Classification Slides: S4-BayesClassify basics video
1103 W11 Gaussian BC Slides: S4-GenerDiscr tabular video Paper Discr vs. Genera
1105 W11 Q10 NaiveBC on Text Slides: S5-NBCtext 1D(Text) video Multinomial MLE
1110 W12 Recent deep learning on Text Slides: S4-deepText 1D(Text) video DNN Cheatsheets
1112 W12 Q11 Learning to Recommend on Text Slides: S4-deepRecommend 1D(Text) video
Extra Extra probabilistic programming Slides: S2-prob-program advanced
Extra Extra Feature Selection and Model Selection Slides: S4-feaSelc tabular video API + ELS Ch3.4 and Ch3.3
Platform Platform adversarial machine leanring in NLP Slides: S3-TextAttack library Invited Speaker

Section 5 - Not Supervised

1117 W13 Clustering Hier Slides: S5-clustering-Hier tabular video compare Hier clusterings
1119 W13 Q12 Clustering Partition Slides: S5-clustering-kMeans tabular video compare clusterings
1124 W14 RL Slides: S5-reinforcement-learning advanced video xgboost
Extra Extra Clustering GMM Slides: S5-clustering-GMM advanced video EM primer
Platform Platform deep RL Gym Slides: S5-RL-gym library Invited Speaker

Section 6 - Wrap Up

W14 QM Review Slides: L20-review video [Cheatsheets]
Project Presentations Slides: Team Presentations [deep2reproduce]