Have you considered using pm.Wishart instead? This is a classical distribution over psd (covariance) matrices, with an implemented random so it should be alright.
Also (for general interest) there’s recent work showing an equivalence between LKJ and a restricted form of the Wishart prior (it also gives a more efficient random for LKJ other than the onion method):