You also get some uncertainty from the coefficients of your model. This can lead to a higher posterior uncertainty for models that have the same expectation (This is to say that p will not be fixed).
I am not sure about the analogy you are making with a hierarchical beta-binomial model. Can you elaborate?