PyMC3 Pickle Issue with GPU

Not sure about this one - your model seems quite straightforward - did you try upgrading to the newest release PyMC3.5?