How to set priors over weights for adjusting the magnitudes of different likelihoods in a model

Questions
4

It is likely will break the conjugacy - Not sure what would be the best way to deal with the double integral, these are usually quite tricky. Why not sample from your model? Then you dont need to worry about conjugacy.