Skip to content

Initial version of CMIP7 submission code - #1067

Merged
Matthew Mizielinski (matthew-mizielinski) merged 5 commits into
v4.0_releasefrom
751_submission_cmip7
Aug 21, 2026
Merged

Initial version of CMIP7 submission code#1067
Matthew Mizielinski (matthew-mizielinski) merged 5 commits into
v4.0_releasefrom
751_submission_cmip7

Conversation

@matthew-mizielinski

@matthew-mizielinski Matthew Mizielinski (matthew-mizielinski) commented Aug 20, 2026

Copy link
Copy Markdown
Collaborator

Closes #751

Added:

  • CMIP7 configuration file with list of facet maps [1].
  • CMIP7 queues
  • logging information when constructing message content in dds.py (_prepare_message)
  • alternative variable filtering in drs.py (filter_filesets)
  • changes to ensure that moose client understands commands clearly
  • allowed reading of approved variables files for CMIP7

Removed:

  • CMIP6 queues (defunct)
  • old archiving code (send_to_mass, rerun_send_to_mass) and associated tests
  • use of both body and content in messages throughout the code now just have content.

Note: rabbitMQ tests can only be run from systems with access to rabbitMQ servers.

[1]:

  • valid = list of metadata fields that can be used within the code for this project (excluding version)
  • atomic = the combination of metadata fields that are unique for a particular dataset (excluding version)
  • name = list of metadata fields used in file names
  • dataset_id = list of metadata needed to construct the dataset id (excluding version)
  • mass = list of metadata fields used in storage of data in MASS

Comment thread cdds/cdds/deprecated/transfer/dds.py
Comment thread cdds/cdds/deprecated/transfer/moo.py
Comment thread cdds/cdds/deprecated/transfer/constants.py
Comment thread cdds/cdds/deprecated/transfer/drs.py

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

All tests pass and looks good from what I understand

Comment thread cdds/cdds/deprecated/transfer/msg.py
Comment thread cdds/cdds/deprecated/transfer/msg.py

@mo-gill Ed (mo-gill) left a comment

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM!

@matthew-mizielinski
Matthew Mizielinski (matthew-mizielinski) merged commit 7e7ce63 into v4.0_release Aug 21, 2026
1 check passed
@matthew-mizielinski
Matthew Mizielinski (matthew-mizielinski) deleted the 751_submission_cmip7 branch August 21, 2026 14:19
Matthew Mizielinski (matthew-mizielinski) added a commit that referenced this pull request Aug 21, 2026
* Initial version of CMIP7 submission code

* #751: tidy up from self review

* #751: removed unused config entries

* #751: Further tidy up

* #751: correct submission code following production test
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

CMIP7: Identify whether existing submission code could be updated to work with CMIP7 data

3 participants