How to run PyMC3 in a multi-node cluster? Is it possible at the moment?

I am not familiar with ray - SMC need access to all chain/batch at the end of each step for resampling, not sure whether that would work with ray. If you find it useful, we certainly welcome a PR (we can set is as a flag).
Did you try to see if your solution works?
Otherwise, as @sammosummo mentioned, you can look at pymc4/TFP, which I recently added SMC as well https://github.com/tensorflow/probability/tree/master/tensorflow_probability/python/experimental/mcmc/examples (there is even an ODE example)

other effort of speeding up ODE including @aseyboldt’s work, which you might also find helpful https://github.com/aseyboldt/sunode

2 Likes