Essential reading to understand patterns for parallel programmingSoftware patterns have revolutionized the way we think about how software is designed, built, and documented, and the design of parallel software requires you to consider other particular design aspects and special skills. From clusters to supercomputers, success heavily depends on the design skills of software developers.Patterns for Parallel Software Design presents a pattern-oriented software architecture approach to parallel software design. This approach is not a design method in the classic sense, but a new way of managing and exploiting existing design knowledge for designing parallel programs. Moreover, such approaches enhance not only build-time properties of parallel systems, but also, and particularly, their run-time properties.* Features known solutions in concurrent and distributed programming, applied to the development of parallel programs* Provides architectural patterns that describe how to divide an algorithm and/or data to find a suitable partition and link it with a programming structure that allows for such a division* Presents an architectural point of view and explains the development of parallel softwarePatterns for Parallel Software Design will give you the skills you need to develop parallel software.

Foreword xiiiPreface xviiAbout the Author xxAcknowledgements xxContributor Biography xxiiChapter 1 Software Patterns 1The Concept of a Software Pattern 2Pattern Description, Organization and Categorization 8Summary 10Chapter 2 A Brief Introduction to Parallel Programming11Parallel Programming 12Factors that Influence the Performance of a Parallel Program12Advantages and Disadvantages of Parallel Programming 23Summary 25Chapter 3 Architectural Patterns for Parallel Programming27Parallel Pipes and Filters 28Parallel Layers 41Communicating Sequential Elements 54Manager-Workers 67Shared Resource 79Summary 93Chapter 4 Design Patterns for Communication Components95Shared Variable Pipe 96Multiple Local Call 103Message Passing Pipe 114Multiple Remote Call 124Shared Variable Channel 136Message Passing Channel 145Local Rendezvous 156Remote Rendezvous 165Summary 173Chapter 5 Some Idioms for Synchronization Mechanisms175Semaphore 177Critical Region 185Monitor 192Message Passing 199Remote Procedure Call 208Summary 217Chapter 6 Two Case Studies 219Blood Vessel Segmentation 220Adaptive 3D Grid-Based Eulerian (Gasdynamic) Program 249Summary 297Chapter 7 Parallel Software Design 299A General Parallel Software Design Process 300A Pattern-Based Parallel Software Design Method 302Problem Analysis 305Coordination Design - Architectural Patterns 315Communication Design - Design Patterns 327Detailed Design - Idioms 340Implementation and Evaluation 349Summary 357Chapter 8 Parallel Software Architecture 359A Definition of Parallel Software Architecture 359Parallel Software Design 361Summary 366Chapter 9 Directions in Patterns for Parallel Programming367The Situation in Software Design 368Design Experience and Techniques 369A Tangible Description for Parallel Software Systems 371The Need for Measurement in Parallel Software Design 372Final Remarks 374Glossary 377Notations 393References 397Index of Patterns 409Index 411