Motivation and history -- Parallel architectures -- Parallel algorithm design -- Message-passing programming -- The sieve of erathosthenes -- Floyd's algorithm -- Performance analysis -- Matrix-vector multiplication -- Document classification -- Monte Carlo methods -- Matrix multiplication -- Solving linear systems -- Finite difference methods -- Sorting -- The fast Fourier transform -- Combinatorial search -- Shared-memory programming -- Combining MPI and OpenMP.