How can I speed up the execution of my model?

I think so too, but it is pretty straightforward to switch to theano version so I suggest you to go for it.