How to get a non-trainable random variable?

You need to implement a custom step sampler that always updates the value of the variable with a new draw from the prior, regardless of the model logp.

This thread may be useful: Custom sampling step - #32 by ricardoV94