If I split the data in batches and run for loop over the model, inference should be based on the random variables in each iteration for each set of mini batch. But how do I make final inference?
Is this way of using for loop for batches a good option?