Many thanks for your insightful response, your explanation makes sense. As mentioned above, I went through these examples in order to investigate some modelling I had done in Stan.
For reference, earlier today I reproduced the marginal GP example discussed in this post in Stan and got similar results as in pymc.