This might be helpful: probabilistic+pca.ipynb · GitHub
Would be great to turn this into a pymc-example.