Statistical Learning

---

What’s Going On?

• It is currently Week 17.
• If you have any questions, post on Piazza or stop by office hours!

Week 00 Aug 17 - Aug 21

Syllabus week! Welcome to STAT 432!

Assignments

Assignment	Deadline	Credit
Quiz 00	Friday, 11:59 PM	105%

Reading

Link	Source
Syllabus	Course Website
FAQ	Course Website
The Extended Syllabus	Instructor Website
Ten Simple Rules for Success in STAT 432	Instructor Website
Computing	Basics of Statistical Learning

Week 01 Aug 24 - Aug 28

First official week of class! Machine learning overview. Probability, statistics, and computing review.

• Keywords: Supervised Learning, Unsupervised Learning, Regression, Classification, Density Estimation, Clustering, Outlier Detection, Dimension Reduction

Assignments

Assignment	Deadline	Credit
Quiz 00	Friday, 11:59 PM	100%
Quiz 01	Friday, 11:59 PM	105%

Reading

Link	Source
Machine Learning Overview	Basics of Statistical Learning
Probability	Basics of Statistical Learning
Statistics	Basics of Statistical Learning
Computing	Basics of Statistical Learning

Video

Title	Link	Mirror
1.1 - Welcome!	1.1 - YouTube	1.1 - MediaSpace
1.2 - R and RStudio Setup	1.2 - YouTube	1.2 - MediaSpace
1.3 - Just Hit [tab]	1.3 - YouTube	1.3 - MediaSpace
1.4 - Machine Learning Tasks	1.4 - YouTube	1.4 - MediaSpace

Office Hours

Staff and Link	Day	Time
Zoom with Matthew	Wednesday	4:00 PM - 5:00 PM
Zoom with David	Wednesday	7:00 PM - 8:00 PM
Zoom with Jingyu	Wednesday	8:00 PM - 10:00 PM
Zoom with Jasmine	Thursday	4:00 PM - 5:00 PM
Zoom with David	Thursday	7:00 PM - 8:00 PM
Zoom with Tianyi	Thursday	8:00 PM - 10:00 PM

Week 02 Aug 31 - Sep 04

Introduction to regression for prediction tasks and supervised learning in general.

• Keywords: Regression, Linear Regression, Prediction, Conditional Mean, RMSE, Test-Train Split

Assignments

Assignment	Deadline	Credit
Quiz 00	Friday, 11:59 PM	85%
Quiz 01	Friday, 11:59 PM	100%
Quiz 02	Friday, 11:59 PM	105%

Reading

Link	Source
Linear Regression	Basics of Statistical Learning

Video

Title	Link	Mirror
2.1 - Linear Regression	2.1 - YouTube	2.1 - MediaSpace
2.2 - Linear Regression in R	2.2 - YouTube	2.2 - MediaSpace

Office Hours

Staff and Link	Day	Time
Zoom with Matthew	Wednesday	4:00 PM - 5:00 PM
Zoom with Jonas	Wednesday	5:00 PM - 7:00 PM
Zoom with David	Wednesday	7:00 PM - 8:00 PM
Zoom with Jingyu	Wednesday	8:00 PM - 10:00 PM
Zoom with Jasmine	Thursday	4:00 PM - 5:00 PM
Zoom with David	Thursday	7:00 PM - 8:00 PM
Zoom with Tianyi	Thursday	8:00 PM - 10:00 PM

Week 03 Sep 07 - Sep 11

Introduction to nonparametric regression and discussions of model flexibility, the bias-variance tradeoff, and overfitting.

• Keywords: Nonparametric Regression, k-Nearest Neighbors, Decision Trees, Model Flexibility, Bias-Variance Tradeoff, Overfitting, No Free Lunch, Curse of Dimensionality

Assignments

Assignment	Deadline	Credit
Quiz 01	Friday, 11:59 PM	85%
Quiz 02	Friday, 11:59 PM	100%
Quiz 03	Friday, 11:59 PM	105%

Reading

Link	Source
Nonparametric Regression	Basics of Statistical Learning
The Bias–Variance Tradeoff	Basics of Statistical Learning
Regression Overview	Basics of Statistical Learning

Video

Title	Link	Mirror
3.1 - Nonparametric Regression	3.1 - YouTube	3.1 - MediaSpace
3.2 - KNN and Trees in R	3.2 - YouTube	3.2 - MediaSpace
3.3 - Supervised Learning Concepts	3.3 - YouTube	3.3 - MediaSpace

Office Hours

Staff and Link	Day	Time
Zoom with Matthew	Wednesday	4:00 PM - 5:00 PM
Zoom with Jonas	Wednesday	5:00 PM - 7:00 PM
Zoom with David	Wednesday	7:00 PM - 8:00 PM
Zoom with Jingyu	Wednesday	8:30 PM - 10:30 PM
Zoom with Jasmine	Thursday	4:00 PM - 5:00 PM
Zoom with David	Thursday	7:00 PM - 8:00 PM
Zoom with Tianyi	Thursday	8:00 PM - 10:00 PM

Week 04 Sep 14 - Sep 18

This week we will introduce the classification task in detail.

• Keywords: Classification, Bayes Classifier, Bayes Error, Nonparametric Classification, k-Nearest Neighbors, Decision Trees, Misclassification Rate, Accuracy

Assignments

Assignment	Deadline	Credit
Quiz 02	Friday, 11:59 PM	85%
Quiz 03	Friday, 11:59 PM	100%
Quiz 04	Friday, 11:59 PM	105%

Reading

Link	Source
Classification	Basics of Statistical Learning
Nonparametric Classification	Basics of Statistical Learning

Video

Title	Link	Mirror
4.1 - Classification Introduction	4.1 - YouTube	4.1 - MediaSpace
4.2 - Nonparametric Classification	4.2 - YouTube	4.2 - MediaSpace
4.3 - Classification in R	4.3 - YouTube	4.3 - MediaSpace

Office Hours

Staff and Link	Day	Time
Zoom with Matthew	Wednesday	4:00 PM - 5:00 PM
Zoom with Jonas	Wednesday	5:00 PM - 7:00 PM
Zoom with David	Wednesday	7:00 PM - 8:00 PM
Zoom with Jingyu	Wednesday	8:00 PM - 10:00 PM
Zoom with Jasmine	Thursday	4:00 PM - 5:00 PM
Zoom with David	Thursday	7:00 PM - 8:00 PM
Zoom with Tianyi	Thursday	8:00 PM - 10:00 PM

Week 05 Sep 21 - Sep 25

This week we will introduce logistic regression and discuss the details of evaluating models for binary classification

• Keywords: Logistic Regression, Link Function, Decision Boundary, Binary Classification, Confusion Matrix, Sensitivity, Specificity

Assignments

Assignment	Deadline	Credit
Quiz 03	Friday, 11:59 PM	85%
Quiz 04	Friday, 11:59 PM	100%
Quiz 05	Friday, 11:59 PM	105%

Reading

Link	Source
Logistic Regression	Basics of Statistical Learning
Binary Classification	Basics of Statistical Learning

Video

Title	Link	Mirror
5.1 - Logistic Regression	5.1 - YouTube	5.1 - MediaSpace
5.2 - Binary Classification	5.2 - YouTube	5.2 - MediaSpace
5.3 - Logistic Regression in R	5.3 - YouTube	5.3 - MediaSpace
5.4 - Binary Classification in R	5.4 - YouTube	5.4 - MediaSpace

Office Hours

Staff and Link	Day	Time
Zoom with Matthew	Wednesday	4:00 PM - 5:00 PM
Zoom with Jonas	Wednesday	5:00 PM - 7:00 PM
Zoom with David	Wednesday	7:00 PM - 8:00 PM
Zoom with Jingyu	Wednesday	8:00 PM - 10:00 PM
Zoom with Jasmine	Thursday	4:00 PM - 5:00 PM
Zoom with David	Thursday	7:00 PM - 8:00 PM
Zoom with Tianyi	Thursday	8:00 PM - 10:00 PM

Week 06 Sep 28 - Oct 02

This week we will prepare for the exam.

Assignments

Assignment	Deadline	Credit
Quiz 04	Friday, 11:59 PM	85%
Quiz 05	Friday, 11:59 PM	100%

Reading

Link	Source
Binary Classification	Basics of Statistical Learning

Video

Title	Link	Mirror
6.1 - Another Binary Example in R	6.1 - YouTube	6.1 - MediaSpace

Office Hours

Staff and Link	Day	Time
Zoom with Matthew	Wednesday	4:00 PM - 5:00 PM
Zoom with Jonas	Wednesday	5:00 PM - 7:00 PM
Zoom with David	Wednesday	7:00 PM - 8:00 PM
Zoom with Jingyu	Wednesday	8:00 PM - 10:00 PM
Zoom with Jasmine	Thursday	4:00 PM - 5:00 PM
Zoom with David	Thursday	7:00 PM - 8:00 PM
Zoom with Tianyi	Thursday	8:00 PM - 10:00 PM

Week 07 Oct 05 - Oct 09

Exam week!!!

Assignments

Assignment	Deadline	Credit
Exam	Monday, 7:00 PM	NA
Quiz 05	Friday, 11:59 PM	85%
Quiz 06	Friday, 11:59 PM	105%

Reading

Link	Source
Generative Models	Basics of Statistical Learning
Computing	Basics of Statistical Learning

Video

Title	Link	Mirror
7.1 - A Mental Model for R	7.1 - YouTube	7.1 - MediaSpace
7.2 - Generative Models	7.2 - YouTube	7.2 - MediaSpace

Office Hours

Staff and Link	Day	Time
Zoom with Matthew	Wednesday	4:00 PM - 5:00 PM
Zoom with Jonas	Wednesday	5:00 PM - 7:00 PM
Zoom with David	Wednesday	7:00 PM - 8:00 PM
Zoom with Jingyu	Wednesday	8:00 PM - 10:00 PM
Zoom with Jasmine	Thursday	4:00 PM - 5:00 PM
Zoom with David	Thursday	7:00 PM - 8:00 PM
Zoom with Tianyi	Thursday	8:00 PM - 10:00 PM

Week 08 Oct12 - Oct 16

This week we will discuss simulation, bootstrap, and cross-validation.

Assignments

Assignment	Deadline	Credit
Quiz 06	Friday, 11:59 PM	100%
Quiz 07	Friday, 11:59 PM	105%

Reading

Link	Source
Simulation	Basics of Statistical Learning
Bootstrap	Basics of Statistical Learning
Cross-Validation	Basics of Statistical Learning

Video

Title	Link	Mirror
8.1 - Simulation	8.1 - YouTube	8.1 - MediaSpace
8.2 - Bootstrap	8.2 - YouTube	8.2 - MediaSpace
8.3 - Cross-Validation	8.3 - YouTube	8.3 - MediaSpace

Office Hours

Staff and Link	Day	Time
Zoom with Matthew	Wednesday	4:00 PM - 5:00 PM
Zoom with Jonas	Wednesday	5:00 PM - 7:00 PM
Zoom with David	Wednesday	7:00 PM - 8:00 PM
Zoom with Jingyu	Wednesday	8:00 PM - 10:00 PM
Zoom with Jasmine	Thursday	4:00 PM - 5:00 PM
Zoom with David	Thursday	7:00 PM - 8:00 PM
Zoom with Tianyi	Thursday	8:00 PM - 10:00 PM

Week 09 Oct 19 - Oct 23

This week we will discuss regularization!

• Keywords: Penalized Regression, Shrinkage, Regularization, Variable Selection, Best Subset Selection, Ridge Regression, Lasso

Assignments

Assignment	Deadline	Credit
Quiz 06	Friday, 11:59 PM	85%
Quiz 07	Friday, 11:59 PM	100%
Quiz 08	Friday, 11:59 PM	105%

Reading

Link	Source
Regularization	Basics of Statistical Learning

Video

Title	Link	Mirror
9.1 - Regularization	9.1 - YouTube	9.1 - MediaSpace

Office Hours

Staff and Link	Day	Time
Zoom with Matthew	Wednesday	4:00 PM - 5:00 PM
Zoom with Jonas	Wednesday	5:00 PM - 7:00 PM
Zoom with Jingyu	Wednesday	8:00 PM - 10:00 PM
Zoom with Jasmine	Thursday	4:00 PM - 5:00 PM
Zoom with David	Thursday	7:00 PM - 8:00 PM
Zoom with Tianyi	Thursday	8:00 PM - 10:00 PM
Zoom with David	Friday	7:00 PM - 8:00 PM

Week 10 Oct 26 - Oct 30

An introduction to ensemble methods.

• Keywords: Bagging, Random Forest, Boosting

Assignments

Assignment	Deadline	Credit
Quiz 07	Friday, 11:59 PM	100%
Quiz 08	Friday, 11:59 PM	105%
Quiz 09	Friday, 11:59 PM	105%
Grad Quiz	December 9	100%

Office Hours

Staff and Link	Day	Time
Zoom with Matthew	Wednesday	4:00 PM - 5:00 PM
Zoom with Jonas	Wednesday	5:00 PM - 7:00 PM
Zoom with David	Wednesday	7:00 PM - 8:00 PM
Zoom with Jingyu	Wednesday	8:00 PM - 10:00 PM
Zoom with Jasmine	Thursday	4:00 PM - 5:00 PM
Zoom with David	Thursday	7:00 PM - 8:00 PM
Zoom with Tianyi	Thursday	8:00 PM - 10:00 PM

Week 11 Nov 02 - Nov 06

This weeky we’ll start transitioning to focusing on analyses.

Assignments

Assignment	Deadline	Credit
Quiz 08	Friday, 11:59 PM	100%
Quiz 09	Friday, 11:59 PM	100%
Analysis 01	November 11	100%
Grad Quiz	December 9	100%

Office Hours

Staff and Link	Day	Time
Zoom with Matthew	Wednesday	4:00 PM - 5:00 PM
Zoom with Jonas	Wednesday	5:00 PM - 7:00 PM
Zoom with David	Wednesday	7:00 PM - 8:00 PM
Zoom with Jingyu	Wednesday	8:00 PM - 10:00 PM
Zoom with Jasmine	Thursday	4:00 PM - 5:00 PM
Zoom with David	Thursday	7:00 PM - 8:00 PM
Zoom with Tianyi	Thursday	8:00 PM - 10:00 PM

Week 12 Nov 09 - Nov 13

This weeky we’ll start transitioning to focusing on analyses.

Assignments

Assignment	Deadline	Credit
Quiz 08	Friday, 11:59 PM	85%
Quiz 09	Friday, 11:59 PM	85%
Analysis 01	November 11	100%
Grad Quiz	December 9	100%

Office Hours

Staff and Link	Day	Time
Zoom with Matthew	Wednesday	4:00 PM - 5:00 PM
Zoom with Jonas	Wednesday	5:00 PM - 7:00 PM
Zoom with David	Wednesday	7:00 PM - 8:00 PM
Zoom with Jingyu	Wednesday	8:00 PM - 10:00 PM
Zoom with Jasmine	Thursday	4:00 PM - 5:00 PM
Zoom with David	Thursday	7:00 PM - 8:00 PM
Zoom with Tianyi	Thursday	8:00 PM - 10:00 PM

Week 13 Nov 16 - Nov 20

Continue work on analyses!

Assignments

Assignment	Deadline	Credit
Analysis 02	November 20	100%
Grad Quiz	December 9	100%

Office Hours

Staff and Link	Day	Time
Zoom with Matthew	Wednesday	4:00 PM - 5:00 PM
Zoom with Jonas	Wednesday	5:00 PM - 7:00 PM
Zoom with David	Wednesday	7:00 PM - 8:00 PM
Zoom with Jingyu	Wednesday	8:00 PM - 10:00 PM
Zoom with Jasmine	Thursday	4:00 PM - 5:00 PM
Zoom with David	Thursday	7:00 PM - 8:00 PM
Zoom with Tianyi	Thursday	8:00 PM - 10:00 PM

Week 14 Nov 23 - Nov 27

This week is Fall Break. There are no course activities, including no office hours.

Week 15 Nov 30 - Dec 04

Continue work on analyses! Almost the end of the semester!

Assignments

Assignment	Deadline	Credit
Analysis 03	Wednesday	100%
Analysis 04	December 9	100%
Grad Quiz	December 9	100%

Office Hours

Staff and Link	Day	Time
Zoom with Matthew	Wednesday	4:00 PM - 5:00 PM
Zoom with Jonas	Wednesday	5:00 PM - 7:00 PM
Zoom with David	Wednesday	7:00 PM - 8:00 PM
Zoom with Jingyu	Wednesday	8:00 PM - 10:00 PM
Zoom with Jasmine	Thursday	4:00 PM - 5:00 PM
Zoom with David	Thursday	7:00 PM - 8:00 PM
Zoom with Tianyi	Thursday	8:00 PM - 10:00 PM

Week 16 Dec 07 - Dec 11

Last week of class.

Assignments

Assignment	Deadline	Credit
Analysis 04	Wednesday	100%
Grad Quiz	Wednesday	100%

Office Hours

Staff and Link	Day	Time
Zoom with Matthew	Wednesday	4:00 PM - 5:00 PM
Zoom with Jonas	Wednesday	5:00 PM - 7:00 PM
Zoom with David	Wednesday	7:00 PM - 8:00 PM
Zoom with Jingyu	Wednesday	8:00 PM - 10:00 PM

Week 17 Dec 14 - Dec 18

You’re still here? It’s over. Go home. Go!

---

Home