Hi, I am dealing with a very large dataset and trying to run Latent Dirichlet Allocation using ADVI on it. I used scikit learn CountVectorizer to prepare the data and the resultant sparse matrix,which is seen as observed data in the likelihood. But I can’t use toarray to get the dense version of th…

Minibatch for a large dataset ADVI

junpenglao September 7, 2018, 9:20am 2

Try saving the traces using using pm.save_trace and pm.load_trace. See also Saving and Loading GP model in PYMC3

Topic		Replies	Views
ADVI Minibatch slows down with increasing size of data Questions	3	979	April 19, 2019
Big Data with HierarchicalRegression Questions	3	891	August 10, 2018
Large Scale Factor Analysis with minibatch ADVI Questions	9	2915	August 20, 2017
Advi_minibatch is deprecated? Questions	4	1280	September 20, 2018
Minibatch when latent variable size depends on data dimension Questions	2	668	February 8, 2019