Adding a new operator for an objective which involves gradients

Do you have a demo notebook with your study? This would be a cool tutorial to extending OPVI in pymc3