Textbook

• Parallel Programming: Techniques and Applications Using Networked Workstations and Parallel Computers (2nd Edition). By Barry Wilkinson and Michael Allen, 2004.

Other recommended textbooks

• An Introduction to Parallel Programming. By Peter Pacheco, 2011.
• Introduction to High Performance Computing for Scientists and Engineers (Chapman & Hall/CRC Computational Science). By Georg Hager and Gerhard Wellein, 2010.
• Introduction to Parallel Computing. By Ananth Grama, Anshul Gupta, George Karypis and Vipin Kumar, 2003.
  
• Designing and Building Parallel Programs, by Ian Foster (available online).
  
• Introduction to High Performance Scientific Computing. By Victor Eijkhout, 2013. (available online)
  

Other recommended books

• Using OpenMP: Portable Shared Memory Parallel Programming (Scientific and Engineering Computation). By Barbara Chapman, Gabriele Jost and Ruud van van der Pas , 2007.
• Using MPI - 2nd Edition: Portable Parallel Programming with the Message Passing Interface (Scientific and Engineering Computation). By William Gropp, Ewing Lusk and Anthony Skjellum, 1999.
  
• The Sourcebook of Parallel Computing (The Morgan Kaufmann Series in Computer Architecture and Design). By Jack Dongarra, Ian Foster, Geoffrey C. Fox, William Gropp, Ken Kennedy, Linda Torczon and Andy White, 2002.
  

Parallel Processing Courses around the world

Other References