You can assume some minimum and maximum dimension and have thus an underlying fine discretization. these also would be the the values in the chains that will be stored. Then you drag along an additional discrete index variable which would be then the index to each dimension. I am currently working on it as well. I will let you know once it is working. Another problem however is indeed the sampling algorithm. I think at the moment there is no sampler implemented that might be able to efficiently sample these kind of problems. The gradient based samplers do not work because you do not have a gradient available, and the proposal distribution for standard Metropolis or SMC is somewhat problematic. And Standard Metropolis will fail and get stuck anways in the complex objective function. You may want to give the new DEMetropolis sampler a try. But RJMCMC would be indeed an nice contribution!
3 Likes