OK, thanks for the extra detail.
I think that you still require a “fudge factor” as you call it, even in Bayesian models. If you look at the code for such transformations in pymc3, for example invlogit or sigmoid, they do contain fudge factors (specifically eps=2.220446049250313e-16).