Skip to content

Upload profiling jobs when done - #301

Draft
max-models wants to merge 40 commits into
develfrom
upload-profiling-jobs-when-done
Draft

Upload profiling jobs when done#301
max-models wants to merge 40 commits into
develfrom
upload-profiling-jobs-when-done

Conversation

@max-models

@max-models max-models commented Jul 28, 2026 •
edited
Loading

Copy link
Copy Markdown
Member

Closes #296, #307
Merge after #300

  • Upload one job at a time to profiling-data
  • Skip the intermediate step of copying the .h5 files to a separate export folder before copying them to the profiling-data repo

@max-models
max-models marked this pull request as draft July 28, 2026 14:31
spossann and others added 27 commits July 29, 2026 08:15
@spossann
remove mentions of case_commands from docstrings, as it cannot be pas…
cc6204a 
…sed anywhere.
@spossann
remove _params from .gitignore; added new profiling example: Poisson …
b65a11d 
…strong;still debugging .sh scripts
@max-models
uncommented the mkdir
6cec198
@max-models
Run bash jobs sequentially
c2223ee
@max-models
Set python path to self.venv_path / bin / python
15fc06a
@max-models
Removed MPI import from src/struphy/models/cold_plasma.py
fb77efc
@max-models
Removed rank = ... from models
b2dad5f
@max-models
Update feectools to not call get_rank()
cc63ae6
@max-models
Added launched_under_mpi() to check if the code is launched with mpir…
08ce4e7 
…un or not
@max-models
Set mpi4py.rc.initialize = False and mpi4py.rc.finalize = False in pr…
aee92cd 
…ofiling/profiling_job.py
@max-models
Update scope-profiler version to 0.2.4 to avoid the mpi get_rank call
49be235
@max-models
Make sure we are running in output_root for the output folder to be c…
9f9ebee 
…orrect
@max-models
Merge branch '300-add-a-poisson-solver-case-to-the-profiling-examples…
dc73ddc 
…' into upload-profiling-jobs-when-done
@max-models
Removed rank == 0 check
4ffe864
@max-models
formatting
9d4c8a0
@max-models
ruff check
a2e8279
@max-models
Merge branch '300-add-a-poisson-solver-case-to-the-profiling-examples…
fe58169 
…' into upload-profiling-jobs-when-done
@max-models
Cleanup
0dd6695
@max-models
Change output folder
88bdac7
@max-models
Merge branch '300-add-a-poisson-solver-case-to-the-profiling-examples…
c4c990d 
…' into upload-profiling-jobs-when-done
@max-models
formatting
001e35f
@max-models
Formatting
6026df8
@max-models
Pyccel language is recorded in , not in the name
172f666
@max-models
Removed old code for counting active processes (now they are serial a…
6c242b9 
…nyway).
@max-models
Remove get_comm from src/struphy/utils/mpi_launch.py
3623cdd
@max-models
Removed unneccesary MPI imports
2cf8af0
@max-models
Removed unneccesary MPI imports
80e8f81
@max-models max-models mentioned this pull request Jul 30, 2026
Open
@max-models max-models mentioned this pull request Jul 30, 2026
Open
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

Push the individual runs to the profiling repo (do not wait for the full case to finish)

2 participants

@max-models @spossann