Coffea v24.5.0 can not be installed in SWAN

Hello

coffea package installed in SWAN is v0.7.21 which is an old one. I tried to upgrade coffea to v24-x using command like
“pip install --upgrade coffea”
“pip install --user --upgrade coffea”
But there are dependency mix-up and conflict; However, the end new version is installed in $CERNBOX_HOME. I exported new directory in $PYTHONPATH and I was able to use coffea v24-x in SWAN terminal with python interactive mode but in notebooks still old version is imported.

Then I tried to create a python virtual environment but that also didn’t work. I was not able to create an isolated python environment in SWAN.

What should I do? I need coffea v24-x in notebooks

Error massage when upgrading coffea:
“”““Installing collected packages: typing-extensions, llvmlite, numba, dask, awkward, uproot, pydantic, correctionlib, coffea
WARNING: The script dask is installed in ‘/eos/user/m/msahraei/.local/bin’ which is not on PATH.
Consider adding this directory to PATH or, if you prefer to suppress this warning, use --no-warn-script-location.
WARNING: The script correction is installed in ‘/eos/user/m/msahraei/.local/bin’ which is not on PATH.
Consider adding this directory to PATH or, if you prefer to suppress this warning, use --no-warn-script-location.
ERROR: pip’s dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts.
zfit 0.16.0 requires tensorflow-probability<0.22,>=0.20, which is not installed.
swandaskcluster 2.0.1 requires swanportallocator, which is not installed.
distributed 2023.7.1 requires dask==2023.7.1, but you have dask 2024.5.1 which is incompatible.
langchainplus-sdk 0.0.20 requires pydantic<2,>=1, but you have pydantic 2.7.2 which is incompatible.
servicex 2.6.2 requires awkward<2,>=1.0.1, but you have awkward 2.6.5 which is incompatible.
servicex 2.6.2 requires idna==2.10, but you have idna 3.2 which is incompatible.
servicex 2.6.2 requires uproot<5,>=4.0.1, but you have uproot 5.3.7 which is incompatible.
tensorflow-cpu 2.13.1 requires gast<=0.4.0,>=0.2.1, but you have gast 0.5.2 which is incompatible.
tensorflow-cpu 2.13.1 requires typing-extensions<4.6.0,>=3.6.6, but you have typing-extensions 4.12.0 which is incompatible.
tfp-nightly 0.21.0 requires typing-extensions<4.6.0, but you have typing-extensions 4.12.0 which is incompatible.
zfit 0.16.0 requires pydantic<2.0.0, but you have pydantic 2.7.2 which is incompatible.
zfit 0.16.0 requires tensorflow<2.14,>=2.13, but you have tensorflow 2.16.1 which is incompatible.
tensorflow 2.16.1 requires gast!=0.5.0,!=0.5.1,!=0.5.2,>=0.2.1, but you have gast 0.5.2 which is incompatible.
tensorflow 2.16.1 requires h5py>=3.10.0, but you have h5py 3.8.0 which is incompatible.
tensorflow 2.16.1 requires keras>=3.0.0, but you have keras 2.13.1 which is incompatible.
tensorflow 2.16.1 requires tensorboard<2.17,>=2.16, but you have tensorboard 2.13.0 which is incompatible.
Successfully installed awkward-2.6.4 coffea-2024.5.0 correctionlib-2.5.0 dask-2024.5.1 llvmlite-0.42.0 numba-0.59.1 pydantic-2.7.1 typing-extensions-4.12.0 uproot-5.3.7"””

Actually at the end it says coffea is installed but in the notebook still old version is imported. I also exported new $PYTHONPATH and restarted the kernel but still old version shows up.

Thank you in advance for your help.

Hello Mohammad,

If you select the Bleeding edge software stack when you start your SWAN session (instead of LCG 105a, which is the default) you will find an updated coffea 2024.5.0.

This version of coffea will make it into the forthcoming LCG 106 release that will be out soon.

Cheers,
Enric

1 Like