Parallel Programming.

Catalog description

Brief review of uniprocessor organization and architecture. Flynn taxonomy of parallel computers. Fundamental design issues in parallel processing. Interconnection networks, Parallelization process. Partitioning for performance. Data access and communication in a multi-memory system. Analysis of parallel algorithms. Performance issues from the processor perspective. Shared memory multiprocessors. Single level and multilevel cache hierarchies. Cache coherence issues, memory consistency, and synchronization. Snooping bus protocols. Distributed memory systems. Directory-based cache coherence. Parallel programming of distributed-memory systems using MPI. Parallel programming of shared-memory multi-core processors using Posix Threads (Pthreads) and OpenMP. (Spring) Prerequisites: EG3313 and EG2312.