- Big Data Algorithms

Catalog description

This course is about the design and analysis of big data algorithms, i.e. algorithms that compute on extremely large datasets. Two frameworks are required to understand big data algorithms: MapReduce algorithms for data stored on a cluster, and streaming algorithms for data too large to store. After introducing these frameworks, the course covers numerous examples of big data algorithms, including hashing, frequency moments, Google’s PageRank algorithm, matching algorithms, clustering, the Netflix recommendation algorithm, algorithms on social network graphs, and dimensionality reduction. The analysis of such algorithms requires tools from probability theory and statistics, which will be introduced as needed.