You can definitely create a covariance matrix like that but you have to use theano constructors (don’t ask me which though 
), but it will probably not sample very well.
You can have a rough (zero-centered) prior control on the correlations with the LKJCholkeyCov by adjusting the eta parameter, but I guess you are not happy with that?