Non-trainable layers in neuralnets

Hello, wondering if anyone’s tried to introduce non-trainable parameters/layers in a bayesian neural network using PyMC3 (similar to how skip connections exist in tensorflow). Essentially what I’m trying to do is replicate the way offsets work in a GLM, but within a neural network.