How to make a TensorFlow ML model compatible with PyMC3?

Thank you @jlindbloom for your pointers!

I wrote a custom Theano Op for my TensorFlow model, but without the grad method so I can’t use any gradient-based sampling technique. How would one compute the gradient of a ML model prediction?