What priors to choose for one hot encoded columns

Hi Oliver-

If you’ve one-hot encoded a lot of categorial variables, it is likely that your model suffers from multicollinearity, meaning that one or more coefficients are non-identifiable. See this post for more information.

The standard recommendation would be to identify the source(s) of multicollinearity and either combine or drop these features to ensure model identifiability.

3 Likes