yes. as I mentioned, it works with raw theano (Just Lasagne with optimization). exactly the same hidden layers, neurons and hyperparameters.
my second question: it is true to transfer weight from a raw theano model (suppose results are acceptable) to pymc model (if all parameters and structure are same) as initial weight and then training it.