Bayesian Neural Network Activation

Questions
1

Is there anyway to use a relu activation for a Bayesian neural network in the form that is presented on the twiecki.io/blog?

2

Sure, you can replace the function pm.math.tanh with tt.nnet.relu.

3

ahh!!! Thanks!