Probabilistic Programming vs Probabilistic Graphical Models

Can we use pymc3 to do probabilistic graphical models?

Yes if your graph is a directed acyclic graph. Undirect graph is currently not supported (but you might be able to hack one out with a sleep-wake update).