Skip to content

Add notes on common issues with ghex and mpi4py on alps#1221

Merged
havogt merged 14 commits into
C2SM:mainfrom
msimberg:mpi4py-ghex-install
May 4, 2026
Merged

Add notes on common issues with ghex and mpi4py on alps#1221
havogt merged 14 commits into
C2SM:mainfrom
msimberg:mpi4py-ghex-install

Conversation

@msimberg
Copy link
Copy Markdown
Contributor

@msimberg msimberg commented Apr 27, 2026

No description provided.

havogt
havogt reviewed Apr 27, 2026
View reviewed changes
Comment thread README.md Outdated
havogt
havogt reviewed Apr 27, 2026
View reviewed changes
Comment thread README.md Outdated
@jcanton
Copy link
Copy Markdown
Contributor

jcanton commented Apr 27, 2026

what about
PYTHONOPTIMIZE
GT4PY_UNSTRUCTURED_HORIZONTAL_HAS_UNIT_STRIDE

@jcanton
Copy link
Copy Markdown
Contributor

jcanton commented Apr 27, 2026

and
LD_LIBRARY_PATH=/user-environment/linux-sles15-neoverse_v2/gcc-13.2.0/nvhpc-25.1-tsfur7lqj6njogdqafhpmj5dqltish7t/Linux_aarch64/25.1/compilers/lib:$LD_LIBRARY_PATH

@msimberg
Copy link
Copy Markdown
Contributor Author

msimberg commented Apr 27, 2026

what about PYTHONOPTIMIZE
GT4PY_UNSTRUCTURED_HORIZONTAL_HAS_UNIT_STRIDE

I think PYTHONOPTIMIZE should not be set when running tests. May deserve to be mentioned elsewhere (do you want to propose where to add it?). GT4PY_UNSTRUCTURED_HORIZONTAL_HAS_UNIT_STRIDE should no longer be needed if I understand correctly.

and LD_LIBRARY_PATH=/user-environment/linux-sles15-neoverse_v2/gcc-13.2.0/nvhpc-25.1-tsfur7lqj6njogdqafhpmj5dqltish7t/Linux_aarch64/25.1/compilers/lib:$LD_LIBRARY_PATH

Is still needed? This might be uenv-specific. With which uenv do you need it?

msimberg
msimberg commented Apr 28, 2026
View reviewed changes
Comment thread README.md Outdated
msimberg
msimberg commented Apr 28, 2026
View reviewed changes
Comment thread README.md Outdated
msimberg
msimberg commented Apr 28, 2026
View reviewed changes
Comment thread README.md Outdated
@havogt
Copy link
Copy Markdown
Contributor

havogt commented Apr 28, 2026

GT4PY_UNSTRUCTURED_HORIZONTAL_HAS_UNIT_STRIDE should no longer be needed if I understand correctly.

Unfortunately still needed because this didn't pass distributed tests #1130

msimberg
msimberg commented Apr 28, 2026
View reviewed changes
Comment thread README.md Outdated
msimberg
msimberg commented Apr 28, 2026
View reviewed changes
Comment thread README.md Outdated
havogt
havogt approved these changes Apr 30, 2026
View reviewed changes
Copy link
Copy Markdown
Contributor

@havogt havogt left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

after removing the line about verification tests

Comment thread README.md Outdated
msimberg and others added 3 commits April 30, 2026 16:51
@msimberg @havogt
Update README.md
2738018 
Co-authored-by: Hannes Vogt <hannes@havogt.de>
@jcanton
pre-commit
d1c947f
@jcanton
Merge branch 'main' into mpi4py-ghex-install
78d5f17 
* main:
  fix d2dexdz2_fac2_mc bug in `driver_utils.py` (C2SM#1225)
  Remove dace orchestration functionality (C2SM#1227)
  Remove FrozenNameSpace in graupel and dycore (C2SM#1201)
  Pull test data from CSCS object store (C2SM#1191)
@jcanton
Copy link
Copy Markdown
Contributor

jcanton commented May 4, 2026

cscs-ci run default

@jcanton
Copy link
Copy Markdown
Contributor

jcanton commented May 4, 2026

cscs-ci run distributed

@github-actions
Copy link
Copy Markdown

github-actions Bot commented May 4, 2026

Mandatory Tests

Please make sure you run these tests via comment before you merge!

  • cscs-ci run default
  • cscs-ci run distributed

Optional Tests

To run benchmarks you can use:

  • cscs-ci run benchmark-bencher

To run tests and benchmarks with the DaCe backend you can use:

  • cscs-ci run dace

To run test levels ignored by the default test suite (mostly simple datatest for static fields computations) you can use:

  • cscs-ci run extra

For more detailed information please look at CI in the EXCLAIM universe.

@havogt havogt merged commit 3b57b2b into C2SM:main May 4, 2026
52 of 54 checks passed
@msimberg msimberg deleted the mpi4py-ghex-install branch May 4, 2026 09:24
jcanton added a commit that referenced this pull request May 4, 2026
@jcanton
Merge branch 'main' into static_field_vectorization
e737880 
* main:
  Add notes on common issues with ghex and mpi4py on alps (#1221)
  Add AGENTS.md (#1204)
jcanton added a commit that referenced this pull request May 4, 2026
@jcanton
Merge branch 'main' into copilot/make-variable-names-consistent
53a475e 
* main: (21 commits)
  Add persistent gt4py cache for github workflows (#1220)
  Fix typo in EDGE_TANGENT_Z definition (#1230)
  Update MPI test initialization (#1223)
  Vectorize static field computations (#1198)
  Add notes on common issues with ghex and mpi4py on alps (#1221)
  Add AGENTS.md (#1204)
  fix d2dexdz2_fac2_mc bug in `driver_utils.py` (#1225)
  Remove dace orchestration functionality (#1227)
  Remove FrozenNameSpace in graupel and dycore (#1201)
  Pull test data from CSCS object store (#1191)
  Fix typo in field names in driver_utils.py (#1226)
  Fix unnecessary use of `xp.ones` (#1222)
  Distributed standalone driver (#1102)
  Added smagorinsky coefficients, iforcing, turbulence coeffs and extra_diffu to interface (#1192)
  Fix cupy/numpy usage in metis decomposition (#1212)
  py2fgen: expose main for module use (#1216)
  Fix plot script for blueline perf (#1209)
  Rewrite download infrastructure with pooch (#1182)
  Muphys: remove frozen namespaces (#1202)
  Rename ProcessProperties variables to consistent `process_props` naming (#1175)
  ...
jcanton added a commit that referenced this pull request May 4, 2026
@jcanton
Merge branch 'main' into copilot/clean-up-math-module
1d00a72 
* main:
  Add persistent gt4py cache for github workflows (#1220)
  Fix typo in EDGE_TANGENT_Z definition (#1230)
  Update MPI test initialization (#1223)
  Vectorize static field computations (#1198)
  Add notes on common issues with ghex and mpi4py on alps (#1221)
  Add AGENTS.md (#1204)
  fix d2dexdz2_fac2_mc bug in `driver_utils.py` (#1225)
  Remove dace orchestration functionality (#1227)
  Remove FrozenNameSpace in graupel and dycore (#1201)
  Pull test data from CSCS object store (#1191)
  Fix typo in field names in driver_utils.py (#1226)
  Fix unnecessary use of `xp.ones` (#1222)
  Distributed standalone driver (#1102)
jcanton added a commit that referenced this pull request May 4, 2026
@jcanton
Merge branch 'main' into copilot/add-halo-exchange-functionality
0ff0833 
* main:
  Make horizontal/vertical dimension consistent via auto-discovery functions, eliminate list/maps (#1206)
  Fix consistency of passing array_ns in functions (#1178)
  Add persistent gt4py cache for github workflows (#1220)
  Fix typo in EDGE_TANGENT_Z definition (#1230)
  Update MPI test initialization (#1223)
  Vectorize static field computations (#1198)
  Add notes on common issues with ghex and mpi4py on alps (#1221)
  Add AGENTS.md (#1204)
@msimberg msimberg mentioned this pull request May 7, 2026
Open
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@jcanton jcanton jcanton left review comments

@havogt havogt havogt approved these changes

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

3 participants

@msimberg @jcanton @havogt