You’re right, that’s quite different than what I had suggested. Perhaps you could consider using the LatentKron per your previous GP question and using an identity matrix as one of the Kronecker product matrices. Then, you’d reshape an I*W GP draw into and I,W matrix. That way, all of the individual vectors will share the same GP prior but will be independent.