Issues with PyMC Marekting on Databricks

Questions v5
1

Hello,

I’m runing an issue when installing pymc-marketing on a Databricks cluster.

After installing the library (via Compute → Libraries), the Python REPL fails to start with the error:

“Failure starting repl. Try detatching and reattaching the notebook.”

The cluster works fine before instaltion and everthing goes back to normal after removing the library.

Enviroment:

  • Databricks Runtime: 15.4 LTS (includes Apache Spark 3.5.0, Scala 2.12)

  • Python: 3.11.11

  • Package Version

    numpy 1.23.5
    pandas 1.5.3
    pyarrow 14.0.1
    scikit-learn 1.3.0
    scipy 1.11.1
    seaborn 0.12.2

It looks like dependency conflict with Databricks enviroment. Is there a recomended way to use pymc-markeitng on Databricks?

2

maybe try a more recent python, pymc. Those are all pretty old versions by now.