I’m interested but not knowledgable on the ODE project. I want to point you at https://docs.pymc.io/developer_guide.html, which is a very good resource for the internal workings of PyMC3.
It might be specifically useful to understand that the with pm.Model() as model: construction is not a common one in Python, but is useful here for various reasons.
Also, I encourage applying.