Running scaling notebooks

Technical
1

Hi, I’m trying to run one of the notebooks from the scaling repository, but I’m currently stuck in the installation of esmf-tracedescribed in the 25km notebook. I created the virtual environment, activated the modules, and then tried to install. These are the errors I get:

(.venv) [jn8053@gadi-login-03 esmf-trace]$ pip install -r requirements.txt
Collecting pandas (from -r requirements.txt (line 1))
  Cache entry deserialization failed, entry ignored
  Downloading https://files.pythonhosted.org/packages/c3/e2/00cacecafbab071c787019f00ad84ca3185952f6bb9bca9550ed83870d4d/pandas-1.1.5-cp36-cp36m-manylinux1_x86_64.whl (9.5MB)
    100% |████████████████████████████████| 9.5MB 148kB/s 
Collecting pyarrow (from -r requirements.txt (line 2))
  Cache entry deserialization failed, entry ignored
  Downloading https://files.pythonhosted.org/packages/38/c6/97a4133eea642155e7a73cb946d889cadc461a1e6b93f5627af9fdd7b3f3/pyarrow-6.0.1.tar.gz (770kB)
    100% |████████████████████████████████| 778kB 1.1MB/s 
    Complete output from command python setup.py egg_info:
    Traceback (most recent call last):
      File "<string>", line 1, in <module>
      File "/scratch/g40/jn8053/tmp/pip-build-dokez4g4/pyarrow/setup.py", line 39, in <module>
        from Cython.Distutils import build_ext as _build_ext
    ModuleNotFoundError: No module named 'Cython'
    
    ----------------------------------------
Command "python setup.py egg_info" failed with error code 1 in /scratch/g40/jn8053/tmp/pip-build-dokez4g4/pyarrow/
You are using pip version 9.0.3, however version 25.3 is available.
You should consider upgrading via the 'pip install --upgrade pip' command.
(.venv) [jn8053@gadi-login-03 esmf-trace]$ pip install -e .
Obtaining file:///home/561/jn8053/esmf-trace
    Complete output from command python setup.py egg_info:
    Traceback (most recent call last):
      File "<string>", line 1, in <module>
      File "/home/561/jn8053/esmf-trace/setup.py", line 3, in <module>
        import setuptools_scm
    ModuleNotFoundError: No module named 'setuptools_scm'
    
    ----------------------------------------
Command "python setup.py egg_info" failed with error code 1 in /home/561/jn8053/esmf-trace/
You are using pip version 9.0.3, however version 25.3 is available.
You should consider upgrading via the 'pip install --upgrade pip' command.
2

Hi Julia

pip 9.0.3 is very old

Could you try

module load python3/3.12.1

before running the install

4

Hey Anton, thanks, I don’t need to run these anymore so let’s close :slight_smile: (or delete post)

1 Like
6

I’ve made an issue to clarify in the instructions anyway :slight_smile:

1 Like