Generating orthogonal latent variables

What do you mean by “orthogonal”? If you set eta to a large number on LKJCholeskyCov, you’re just making a diagonal matrix, which you can just do. But an MvNormal with diagonal covariance is equivalent to independent normals, so you don’t even need an MvNormal.