Changing a parameter that isn't on the chain every sample

I think I understand the idea (although not the rationale). I really don’t know how wise it is to change things that pymc expects to be fixed during sampling.

I still feel that what you want is equivalent in practice to just resetting your prior of A every time you sample, but I might be missing something. How would the generative model for your data look like?