Parallel Programming: Practical Aspects, Models and Current Limitations

Parallel programming is designed for the use of parallel computer systems for solving time-consuming problems that cannot be solved on a sequential computer in a reasonable time.

These problems can be divided into two classes:
1. Processing large data arrays (including processing images and signals in real time).
2. Simulation of complex physical processes and chemical reactions.

For each of these classes prospective methods are designed for solving problems. For data processing one of the most promising technologies is the use of artificial neural networks. Method of particles-in-cell and cellular automata are very useful for simulation.

Problems of scalability of parallel algorithms and the transfer of existing parallel programs to future parallel computers are very acute now. An important task is to optimize the use of the equipment (including the CPU cache) of parallel computer. Along with parallelizing information processing it is essential to ensure the processing reliability by the relevant organization of systems of concurrent interacting processes. From the perspective of creating qualitative parallel programs it is important to develop advanced methods of teaching parallel programming.

The above reasons are the basis for the creation of this book, chapters of which are devoted to solving these problems.

Table of Contents

Chapter 1: Mapping Data Processing Neural Networks onto Distributed Computer Systems with Regular Structures
Chapter 2: Mapping Parallel Program Graphs onto Graphs of Distributed Computer Systems by Neural Network Algorithms
Chapter 3: Large-Scale and Fine-Grain Parallelism in Plasma Simulation
Chapter 4: Numerical Modelling of Astrophysical Flow on Hybrid Architecture Supercomputers
Chapter 5: Efficient Computational Approaches for Parallel Stochastic Simulation on Supercomputers
Chapter 6: Lattice Gas Cellular Automata for a Flow Simulation and Their Parallel Implementation
Chapter 7: Parallel Simulation of Asynchronous Cellular Automata
Chapter 8: XPU: A C++ Metaprogramming Approach to Ease Parallelism Expression: Parallelization Methodology, Internal Design and Practical Application
Chapter 9: An Approach to the Construction of Robust Systems of Interacting Processes
Chapter 10: Early Learning in Parallel Programming