This is the first entry-level book on algorithmic (also known as automatic) differentiation (AD), providing fundamental rules for the generation of first- and higher-order tangent-linear and adjoint code. The author covers the mathematical underpinnings as well as how to apply these observations to real-world numerical simulation programs. Readers will find many examples and exercises, including hints to solutions. Also included are the prototype AD tools dco and dcc for use with the examples and exercises. The derivative code compiler dcc provides first- and higher-order tangent-linear and adjoint modes for a limited subset of C/C++. In addition, readers will have access to a supplementary website containing sources of all software discussed in the book, additional exercises and comments on their solutions (growing over the coming years), links to other sites on AD, and errata. Audience: This book is intended for undergraduate and graduate students in computational science, engineering, and finance as well as applied mathematics and computer science. It will provide researchers and developers at all levels with an intuitive introduction to AD. Contents: Preface; Acknowledgments; Optimality; Chapter 1: Motivation and Introduction; Chapter 2: First Derivative Code; Chapter 3: Higher Derivative Code; Chapter 4: Derivative Code Compilers An Introductory Tutorial; Chapter 5: dcc A Prototype Derivative Code Compiler; Appendix A: Derivative Code by Overloading; Appendix B: Syntax of dcc Input; Appendix C: (Hints on) Solutions; Bibliography; Index This is the first entry-level book on algorithmic (also known as automatic) differentiation (AD), providing fundamental rules for the generation of first- and higher-order tangent-linear and adjoint code. The author covers the mathematical underpinnings as well as applications to real-world numerical simulation programs. Readers will Many examples and exercises, including hints to solutions The prototype AD tools dco and dcc for use with the examples and exercises First- and higher-order tangent-linear and adjoint modes for a limited subset of C/C++, provided by the derivative code compiler dcc A supplementary website containing sources of all software discussed in the book, additional exercises and comments on their solutions (growing over the coming years), links to other sites on AD, and errata. Ideal for undergraduate and graduate students, the book is also suitable for researchers and developers at all levels who need an introduction to AD. This Is The First Entry-level Book On Algorithmic (also Known As Automatic) Differentiation (ad), Providing Fundamental Rules For The Generation Of First- And Higher-order Tangent-linear And Adjoint Code. The Author Covers The Mathematical Underpinnings As Well As How To Apply These Observations To Real-world Numerical Simulation Programs. Readers Will Find: Examples And Exercises, Including Hints To Solutions; The Prototype Ad Tools Dco And Dcc For Use With The Examples And Exercises; First- And Higher-order Tangent-linear And Adjoint Modes For A Limited Subset Of C/c++, Provided By The Derivative Code Compiler Dcc; A Supplementary Website Containing Sources Of All Software Discussed In The Book, Additional Exercises And Comments On Their Solutions (growing Over The Coming Years), Links To Other Sites On Ad, And Errata.
