Parallel sampling without pickle in version 4.0.0b3

Questions v5
8

Has there been any update on this error. I am facing the exact same problem when increasing the cores beyond 1. In my black-box likelihood, I call model functions that I originally wrote in c++ and have now wrapped with SWIG and exposed to python.

This is my error

Sampling 4 chains in 4 jobs
Traceback (most recent call last):----------------------------| 0.00% [0/100 00:00<?]
  File "/home/unjhawala/projectlets/misc/2022/DataDrivenModSim/BayesianCalibration/dART/dART_acc_wrapped.py", line 264, in <module>
    main()
  File "/home/unjhawala/projectlets/misc/2022/DataDrivenModSim/BayesianCalibration/dART/dART_acc_wrapped.py", line 192, in main
    idata = pm.sample_smc(draws = ndraws,parallel=True,cores=4,return_inferencedata=True,progressbar = True)
  File "/home/unjhawala/anaconda3/envs/pymc_env/lib/python3.10/site-packages/pymc/smc/sample_smc.py", line 220, in sample_smc
    results = run_chains_parallel(
  File "/home/unjhawala/anaconda3/envs/pymc_env/lib/python3.10/site-packages/pymc/smc/sample_smc.py", line 399, in run_chains_parallel
    params = tuple(cloudpickle.dumps(p) for p in params)
  File "/home/unjhawala/anaconda3/envs/pymc_env/lib/python3.10/site-packages/pymc/smc/sample_smc.py", line 399, in <genexpr>
    params = tuple(cloudpickle.dumps(p) for p in params)
  File "/home/unjhawala/anaconda3/envs/pymc_env/lib/python3.10/site-packages/cloudpickle/cloudpickle_fast.py", line 73, in dumps
    cp.dump(obj)
  File "/home/unjhawala/anaconda3/envs/pymc_env/lib/python3.10/site-packages/cloudpickle/cloudpickle_fast.py", line 633, in dump
    return Pickler.dump(self, obj)
TypeError: cannot pickle 'SwigPyObject' object

This is my sampling line of code

idata = pm.sample_smc(draws = ndraws,parallel=True,cores=4,return_inferencedata=True,progressbar = True)

Here is my environment set up
pymc 4.1.7
cloud pickle 2.1.0

Let me know if you need any more details