Differential Programming

 

码一个以前就知道的问题(thanks Alex and Chris for exposing me to this line of work…)

TODO:

  • Derivative of max in PyTorch is not commutative
  • Think about what is d/dt (if 0 < t < 1 && x < t then 1 else 0)
  • Also nice counter-intuitive examples for AD

Papers: