Algorithmic Differentiation of Pragma-Defined Parallel Regions : Differentiating Computer Programs Containing OpenMP

Numerical programs often use parallel programming techniques such as OpenMP to compute the program's output values as efficient as possible. In addition, derivative values of these output values with respect to certain input values play a crucial role. To achieve code that computes not only the output values simultaneously but also the derivative values, this work introduces several source-to-source transformation rules. These rules are based on a technique called algorithmic differentiation. The main focus of this work lies on the important reverse mode of algorithmic differentiation. The inherent data-flow reversal of the reverse mode must be handled properly during the transformation. The first part of the work examines the transformations in a very general way since pragma-based parallel regions occur in many different kinds such as OpenMP, OpenACC, and Intel Phi. The second part describes the transformation rules of the most important OpenMP constructs. Contents Introduction with Examples from Numerical Optimization Algorithmic Differentiation by Source Transformation Transformation rules for Parallel Code Regions (e.g. OpenMP 3.1) Static Program Analysis Target Groups Lecturers and students of computer science Computer scientists, engineers, mathematicians and numerical analysts The Author Michael Förster is currently Research Associate of the Institute Software and Tools for Computational Engineering, RWTH Aachen University. Front Matter....Pages I-XI Motivation and Introduction....Pages 1-59 Source Transformation of Pure Parallel Regions....Pages 61-136 Exclusive Read Analysis....Pages 137-186 Source Transformation of OpenMP Constructs....Pages 187-268 Experimental Results....Pages 269-329 Conclusions....Pages 331-335 Back Matter....Pages 337-405