Advanced Introduction to Parallel and Distributed Computing

Catalog description

Parallel computing theory: Parallel Random-Access Machines (PRAMs), Amdahl’s law and Gustafson’s law for theoretical speedup limits; parallel vs. distributed computing: speedup, fault-tolerance, and resource-sharing; parallel architectures: data flow, instruction-level pipelining, shared-memory multiprocessors, distributed-memory multicomputers, interconnection networks; distributed systems: client-server systems, cluster computing, computing grids, cloud computing; parallel and distributed programming with industry standard MPI (Message Passing Interface); and parallel algorithms. Students are expected to implement an advanced project.