Cloud Computing and ML Hosting

Catalog description

CS 5416 is a course focused on the systems aspects of performance for cloud-hosted AI and ML applications such as LLMs, as well as complex systems in which AI or ML is just one element. The T/R lectures are shared with an undergraduate class, CS 4414 but the (required) recitation sections cover content that the CS 4414 students will not see and the last of the multi-stage projects will focus on cloud AI and ML scenarios, while the last of the CS 4414 projects focuses on a single-computer scenario. Thus even though you will overlap with Cornell seniors (and some juniors) in the lecture hall, you will also gain additional perspective and knowledge in recitation and will be doing a more ambitious style of project that comes very close to what companies are undertaking to integrate AI into their cloud solutions. The CS 4414 students will have a separate discussion board than you, and although you do take the same prelim exams, your grading is more focused on projects (25% exams, 75% projects, in contrast to the 50-50 balance for CS 4414 ). CS 5416 starts by exposing students to programming applications at the systems level and to the operating systems abstractions that these applications depend on. It then builds on this foundation to look at systems issues that shape the performance and reliability of modern ML and AI applications, such as “chat bots” and question-answering AIs. We do not expect students to learn how these ML and AI tools work, in a mathematical sense. Instead our focus is on how they execute, where components run and how they talk one another, how they interact with big-data storage, and how they leverage accelerators such as GPU. CS 4414 students who attend these cloud-computing and ML lectures won’t be using the material in their projects, whereas CS 5416 students will gain hands-on experience working with and optimizing ML and AI applications that…