Ah shoot I forgot to check that. I was really getting into playing with the generating function.
Well the wiki has the logp function too, so it just means you give a logp function (written in pytensor) to CustomDist, instead of the generating graph (dist).