Machine Learning at U of C

This page contains a list of topics, definitions, and results from Machine Learning course at University of Chicago.

Week 1

Learning problem

Given a distribution $\mathbb {P}$ on $X\times Y$. We want to learn the objective function $f_{p}(x)=\mathbb {E} _{p}[y|x]$ (with respect to the distribution $\mathbb {P}$).

Learning Algorithms

Let Z be the set of possible samples. The learning algorithm is a function that maps a number of samples to a measurable function (denoted here by F a class of all measurable functions). Sometimes we consider a class of computable functions instead.

$A:\cup _{n=1}^{\infty }Z^{n}\rightarrow F$