Parallel And Distributed Computing

This textis an introduction to the complex and emerging world of the Parallel andDistributed Computing. It helps you understand the principles and acquire the practicalskills of MPI programming using the C/FORTAN programming language. My aim isfor you to gain sufficient knowledge and experience to perform simple usefulprogramming tasks using the best up-to-date techniques and so we hope for it tobe the easiest book from which you can learn the basics of MPI programming. Ithelps you understand the principles, algorithm & implementation of Paralleland Distributed Computing.This bookis emphatically focused on the concept. Understanding the fundamental ideas,principles, and techniques is the essence of a good programmer. Onlywell-designed code has a chance of becoming part of a correct, reliable, andmaintainable parallel system. Through this book, I hope that you will see theabsolute necessity of understanding Parallel and Distributed Computing.I havetaken a top-down approach, addressing the issues to be resolved in the designof parallel and distributed systems and describing successful approaches in theform of abstract models, algorithms and detailed case studies of widely usedsystems.The bookaims to provide an understanding of the principles on which the parallel anddistributed computing are based; their architecture, algorithms and design; andhow it meets the demands of contemporary distributed applications. I began witha set of chapters that together cover the building blocks for a study ofparallel and distributed systems. The first few chapters provide a conceptualoverview of the subject, outlining the characteristics of parallel and distributedsystems and the challenges that must be addressed in their design: scalability,heterogeneity, security and failure handling being the most significant. Thesechapters also develop abstract models for understanding process interaction,failure and security.