Adding two covariance matrices of different sizes

You need to use the set_subtensor function here. I think this is because you need to tell theano to add a new node in the computational graph that does this replacement.

Out of curiosity, what is the use case? Are you trying to transition the covariance function from one part of the domain to another?