How to model time-dependent variables in pymc3

You can try cumsum from theano:
from theano.tensor.extra_ops import cumsum