Reducing dimensionality of data that covary in piecewise way

It’s hard to answer this question because the dimensionality and geometry of your setting is unclear. Does each \vec y lie on a simplex? Is the dimension of that simplex fixed across all observed points or can it vary? Are the differences ordered (y_i-y_{i-1} \geq y_{i+1}-y_i)?