Conda is the officially recommended method of installation (instructions here) specifically to avoid the issues you are encountering. If you wish to avoid the bloat of conda, you can try miniconda. Or you can try micromamba if you are interested in trying out the mamba package/environment manager.
1 Like