Thanks for the clarification. Could you please clarify which “technical advice”-section you are referring to?
Indeed, I tried writing the simulator without drawing in the loop but then I ran into the problem that I needed to draw/evaluate the values to be able to use boolean operators in the control logic.
How do you then explain the slowness of the sample_smc if it does not touch my numpy code? 
Perhaps I should reduce the simulator to a mwe.
Edit: Oh yes I found the technical advice at the end of the example.