Did you have a look at the discussion in Multivariate Normal with missing inputs? I feel that the solution might apply.