
Parallel computingParallel computing is a large topic so it is hard to know where to start. Basically you can program in parallel using two different approaches:
Four excellent books, the first covering MPI, the second OpenMP, the third HPF, and the fourth PVM, are:
A new book is "Parallel Programming in C with MPI and OpenMP" by Michael J. Quinn, Oregon State University, McGrawHill 2003, 543 pp. Two further new books: Introduction to Parallel Computing, A practical guide with examples in C.Wesley Petersen, Seminar for Applied Mathematics, Department of Mathematics, ETHZ, Switzerland, and Peter Arbenz, Institute for Scientific Computing, Department Informatik, ETHZ, Switzerland
Oxford Texts in Applied and Engineering Mathematics,
278 pages, January 2004, ISBN
0198515774, Paperback, http://www.oup.co.uk/isbn/0198515774 Parallel Scientific Computation: A Structured Approach using BSP and MPIRob Bisseling, Associate Professor, Mathematics Department, Utrecht University, The Netherlands.This is the first text explaining how to use the bulk synchronous parallel (BSP) model and the freely available BSPlib communication library in parallel algorithm design and parallel programming. Aimed at upper level undergraduates, graduate students and researchers in mathematics, physics and computer science, the main topics treated in the book are core topics in the area of scientific computation and many additional topics are treated in numerous exercises. The book contains five small but complete example programs written in BSPlib which illustrate the methods taught. An appendix on the messagepassing interface (MPI) discusses how to program in a structured, bulk synchronous parallel style using the MPI communication library. It presents MPI equivalents of all the programs in the book. The complete programs of the book and their driver programs are freely available online in the packages BSPedupack and MPIedupack. Contents: Introduction; LU decomposition; The fast Fourier transform; Sparse matrixvector multiplication; Auxiliary BSPedupack functions; A quick reference guide to BSPlib; Programming in BSP style using MPI; References; Index. Oxford University Press, February 2004, 305 pages, ISBN 0198529392, Hardback, GBP 45.00. 20 % DISCOUNT WHEN ORDERING DIRECT. PLEASE USE LINK BELOW: http://www.oup.co.uk/isbn/0198529392?view=00&promo=nadigest
