Pymc3 getting stuck after initialization

You should try it out to see if that works. The modes in theano more or less leverage if your model will take a longer time to be compiled, because it will try to optimize the underlying binary to be able to run fast, or if it just compiles fast without many optimizations. The latter maybe will cause the model to run slower (but it may be negligible to what you gain with running chains in parallel).