Definitely check priors. I’ll add in that when working with exponential link models, it is extremely easy to get numerical overflows. The maximum value you can have inside the exp is something like 700, so the scale of the data is extremely important.
For count distributions, I’ve been using softplus as a link function instead of exp recently, because it has much nicer numerical properties.