How can we build a mixture of mixtures?

I think what you are looking for is:

w2 = tt.concatenate(w, axis=0)

You could find more information in the theano doc: http://deeplearning.net/software/theano/library/tensor/basic.html