I think it is likely possible, as long as the latent variables for the kernel could be expressed as some theano function, or the GP kernel could be express as a combinations of a set of standard GP kernels.
Did you have a look at the documentation of new GP module?
http://docs.pymc.io/examples.html#gaussian-processes