Thank you, @junpenglao! That is a relief to know!
So the work-around here is to take the predictive trace and for any transformed RV, apply the transform. Not ideal, but definitely feasible.
It would be nice to see that predictive sampling becomes a first class citizen in PyMC4.