Numerical Issues with StickBreaking in ADVI

You are right, sum_to_1 only produce unit vector but not simplex.