•Task parallelism means that every CPU core will perform a different part of the computation.

•Data parallelism means that every CPU core will perform the same computation but on a different part of the data.

Data Parallel

  • Full data parallelism: map
  • Reduction

Task Parallel

  • Perform different computations in parallel
  • Particularly effective for stream processing (e.g. video, audio)