Advanced Machine Learning Systems

Catalog description

Graduate-level introduction to system-focused aspects of machine learning, covering guiding principles and commonly used techniques for scaling up to large data sets. Topics will include stochastic gradient descent, acceleration, variance reduction, methods for choosing metaparameters, parallelization within a chip and across a cluster, and innovations in hardware architectures. An open-ended project in which students apply these techniques is a major part of the course.