GP marginal likelihood with white noise/Latent GP

Yes, your guess is exactly right. If you check what’s in the trace you’ll see the GP there for the Latent case, but not the Marginal case.