Agree with @BioGoertz, but unfortunately those approaches end up being pretty slow (but often that’s all you can do).
This has been bugging me for a while, and there isn’t really anything tricky about the implementation, so here’s an example of multioutput GPs for Marginal, hopefully that helps you out in this case. I def agree that it would be great if PyMC4 had this functionality built-in.