- Introduction to Transformer Models

Catalog description

This course provides a comprehensive introduction to transformer-based foundation models which underpin modern artificial intelligence. Students will explore the core transformer mechanics, including self-attention, and the processes of pre-training and fine-tuning. The course has a strong practical emphasis, providing hands-on experience with industry-standard libraries and frameworks. Students will learn to deploy, customize, and optimize models using techniques like quantization to improve efficiency. This includes working with tools like the Hugging Face ecosystem, Ollama, and other open-source platforms to build applications for text generation, classification, and summarization.