I saw some people were asking about the speed. Does it mean that the value of the iteration rate can be seen as an indication if the sampling is efficient or not? I thought if the model is complex, then it should also take longer? (But do I understand it right?) Or when I see the rate is decreasing to a certain degree, say, 5 it/s, should I then consider looking at my model for modification?
Another question, ’ If the model is well parameterised, then the sampling should be able to find the train faster’, is it a fair statement?
Thanks a lot.
It is also not necessarily the case that more complex model would take longer to sample. An example would be if you put hyperprior on the model parameters of a large linear regression system, you can sample faster some times. Because additional information from the hyperprior informed the sampler where the posterior weight is more likely concentrate.
You usually saw a speed up after tunning, because the parameters are at a more optimal state now. The slowdown you posted in the picture happens during the tunning, it is probably fine.