

In Programming Language Design and Implementation. λPSI: exact inference for higherorder probabilistic programs. Timon Gehr, Samuel Steffen, and Martin Vechev.International Conference on Functional Programming (2018). The Simple Essence of Automatic Differentiation. On optimal control problems with discontinuities. Opt: A Domain Specific Language for Non-Linear Least Squares Optimization in Graphics and Imaging. Zachary Devito, Michael Mara, Michael Zollhöfer, Gilbert Bernstein, Jonathan Ragan-Kelley, Christian Theobalt, Pat Hanrahan, Matthew Fisher, and Matthias Niessner.Model-based 3D hand pose estimation from monocular video. Martin de La Gorce, David J Fleet, and Nikos Paragios.In Advances in Neural Information Processing Systems, Vol. End-to-End Differentiable Physics for Learning and Control. Filipe de Avila Belbute-Peres, Kevin Smith, Kelsey Allen, Josh Tenenbaum, and J.

New Generalized Functions and Multiplication of Distributions. Interactive spacetime control for animation. Chen, Yulia Rubanova, Jesse Bettencourt, and David K Duvenaud. JAX: composable transformations of Python+NumPy programs. James Bradbury, Roy Frostig, Peter Hawkins, Matthew James Johnson, Chris Leary, Dougal Maclaurin, and Skye Wanderman-Milne.Pyro: Deep Universal Probabilistic Programming. Chen, Martin Jankowiak, Fritz Obermeyer, Neeraj Pradhan, Theofanis Karaletsos, Rohit Singh, Paul Szerlip, Paul Horsfall, and Noah D. Practical Methods for Optimal Control and Estimation Using Nonlinear Programming (2nd ed.). Survey of numerical methods for trajectory optimization.

On dissipative systems and related variational principles. Smooth interpolation of orientations with angular velocity constraints using quaternions. Alan H Barr, Bena Currin, Steven Gabriel, and John F Hughes.Unbiased warped-area sampling for differentiable rendering. Sai Praveen Bangaru, Tzu-Mao Li, and Frédo Durand.The Irradiance Jacobian for Partially Occluded Polyhedral Sources. Aether: An embedded domain specific sampling language for Monte Carlo rendering. Luke Anderson, Tzu-Mao Li, Jaakko Lehtinen, and Frédo Durand.TensorFlow: Large-Scale Machine Learning on Heterogeneous Systems. Corrado, Andy Davis, Jeffrey Dean, Matthieu Devin, Sanjay Ghemawat, Ian Goodfellow, Andrew Harp, Geoffrey Irving, Michael Isard, Yangqing Jia, Rafal Jozefowicz, Lukasz Kaiser, Manjunath Kudlur, Josh Levenberg, Dan Mané, Rajat Monga, Sherry Moore, Derek Murray, Chris Olah, Mike Schuster, Jonathon Shlens, Benoit Steiner, Ilya Sutskever, Kunal Talwar, Paul Tucker, Vincent Vanhoucke, Vijay Vasudevan, Fernanda Viégas, Oriol Vinyals, Pete Warden, Martin Wattenberg, Martin Wicke, Yuan Yu, and Xiaoqiang Zheng. Martín Abadi, Ashish Agarwal, Paul Barham, Eugene Brevdo, Zhifeng Chen, Craig Citro, Greg S.

Our approach is widely applicable to a variety of tasks, including image stylization, fitting shader parameters, trajectory optimization, and optimizing physical designs. We also build a system, Teg, implementing these semantics. We formally define the language semantics and prove the correctness and closure under the differentiation, allowing the generation of gradients and higher-order derivatives. We introduce integration as a language primitive and account for the Dirac delta contribution from differentiating parametric discontinuities in the integrand. We propose a systematic approach to differentiating integrals with discontinuous integrands, by developing a new differentiable programming language. Previous approaches either apply specialized hand-derived solutions, smooth out the discontinuities, or rely on incorrect automatic differentiation. Ignoring the discontinuities during differentiation often has a significant impact on the optimization process. In many domains, such as rendering and physics simulation, we differentiate the parameters of models that are expressed as integrals over discontinuous functions. These discontinuities appear in object boundaries, occlusion, contact, and sudden change over time. Emerging research in computer graphics, inverse problems, and machine learning requires us to differentiate and optimize parametric discontinuities.
