Multimodal Computer Vision

Catalog description

Multimodal representations are reshaping computer vision, driving advances in both understanding and generation across a wide range of perceptual tasks. This research-oriented course explores computer vision techniques that integrate images with additional modalities such as language and 3D geometry for addressing challenges in both analysis and synthesis tasks. Possible topics include visual grounding, multimodal alignment, and text-guided generation and editing over multiple 2D and 3D representations.