Motivation It is now possible to build powerful single-processor and multiprocessor systems and use them efficiently for data processing, which has seen an explosive ex pansion in many areas of computer science and engineering. One approach to meeting the performance requirements of the applications has been to utilize the most powerful single-processor system that is available. When such a system does not provide the performance requirements, pipelined and parallel process ing structures can be employed. The concept of parallel processing is a depar ture from sequential processing. In sequential computation one processor is in volved and performs one operation at a time. On the other hand, in parallel computation several processors cooperate to solve a problem, which reduces computing time because several operations can be carried out simultaneously. Using several processors that work together on a given computation illustrates a new paradigm in computer problem solving which is completely different from sequential processing. From the practical point of view, this provides sufficient justification to investigate the concept of parallel processing and related issues, such as parallel algorithms. Parallel processing involves utilizing several factors, such as parallel architectures, parallel algorithms, parallel programming lan guages and performance analysis, which are strongly interrelated. In general, four steps are involved in performing a computational problem in parallel. The first step is to understand the nature of computations in the specific application domain. Front Matter....Pages i-xix Computer Architecture....Pages 1-56 Components of Parallel Computers....Pages 57-108 Principles of Parallel Programming....Pages 109-136 Parallel Programming Approaches....Pages 137-216 Principles of Parallel Algorithm Design....Pages 217-258 Parallel Graph Algorithms....Pages 259-318 Parallel Search Algorithms....Pages 319-353 Parallel Computational Algorithms....Pages 355-410 Data Flow and Functional Programming....Pages 411-437 Asynchronous Parallel Programming....Pages 439-476 Data Parallel Programming....Pages 477-499 Artificial Intelligence and Parallel Processing....Pages 501-534 Back Matter....Pages 535-566 This book covers the essential elements of parallel processing and parallel algorithms. It is unique in that it is a self-contained book covering everything fundamental of parallel processing from computer architecture to parallel programming and parallel algorithms. It is designed to function as a text for an undergraduate course in parallel processing, but also works well as a comprehensive reference for professionals interested in all phases of parallel processing and parallel programming. Computer Architecture Components of Parallel Computers Principles of Parallel Programming Parallel Programmming Approaches Principles of Parallel Algorithm Design Parallel Graph Algorithms Parallel Search Algorithms General Parallel Algorithms Data-Flow Computing Ada Concurrent Programming Modula Concurrent Programming for Hybrid Architectures Parallel Processing of AI Systems.
