Reading: Parallel Architectures

Reading¶

• Introduction to Parallel Computing - Sections B-D: Concepts and Terminology, Parallel Computer Memory Architectures, and Parallel Programming Models
  • Key concepts:
    • Flynn’s Taxonomy (SISD, SIMD, MISD, MIMD)
    • Amdahl’s Law
    • SMP, UMA, NUMA, Distributed memory
    • Threads (POSIX, OpenMP)
    • Message Passing (MPI)
    • SPMD, MPMD

Supplemental¶

• Parallel Programming for Beginners: Chapters “0: Introduction” and “1: Shared Memory” (sections 1.0-1.1)