Skip to content

Check data quality per observation at the site - #1676

Open
GoureeSankar wants to merge 5 commits into
simonsobs:masterfrom
GoureeSankar:master
Open

Check data quality per observation at the site#1676
GoureeSankar wants to merge 5 commits into
simonsobs:masterfrom
GoureeSankar:master

Conversation

@GoureeSankar

Copy link
Copy Markdown

Contains a python script for implementing data quality check and associated config file.
Note: Path to the mapmaker on pwg-scripts, given inside the config file under mapmaker_path needs to be modified.

Contains a python script for implementing data quality check and associated config file. 
Note: Path to the mapmaker on pwg-scripts, given inside the config file under mapmaker_path needs to be modified.
@mmccrackan
mmccrackan self-requested a review June 23, 2026 20:36

@mmccrackan mmccrackan left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Overall looks solid, just some starting comments mostly on how it integrates into the site-pipeline work flow.

Comment thread sotodlib/site_pipeline/compute_data_quality.py Outdated
Comment thread sotodlib/site_pipeline/compute_data_quality.py Outdated
Comment thread sotodlib/site_pipeline/compute_data_quality.py Outdated
Comment thread sotodlib/site_pipeline/compute_data_quality.py Outdated
Comment thread sotodlib/site_pipeline/compute_data_quality.py Outdated
Comment thread sotodlib/site_pipeline/compute_data_quality.py Outdated
Comment thread sotodlib/site_pipeline/compute_data_quality.py Outdated
Comment thread sotodlib/site_pipeline/compute_data_quality.py Outdated
Comment thread sotodlib/site_pipeline/compute_data_quality.py Outdated
Comment thread sotodlib/site_pipeline/satp1_detcen_jupiter_sitecheck.yaml Outdated

@mmccrackan mmccrackan left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Some additional comments, which are mainly just formatting suggestions and some questions. Might want to see if you can pass it through a python linter just to clear up some extra/missing spaces.

I think the only major things are about the output file format, adding an overwrite option, and the question about whether it re-runs already completed obs or not.

Comment thread sotodlib/site_pipeline/compute_data_quality.py Outdated
Comment thread sotodlib/site_pipeline/compute_data_quality.py Outdated
Comment thread sotodlib/site_pipeline/compute_data_quality.py Outdated
Comment thread sotodlib/site_pipeline/compute_data_quality.py Outdated
Comment thread sotodlib/site_pipeline/compute_data_quality.py Outdated
Comment thread sotodlib/site_pipeline/compute_data_quality.py Outdated
Comment thread sotodlib/site_pipeline/compute_data_quality.py Outdated
Comment thread sotodlib/site_pipeline/compute_data_quality.py Outdated
Comment thread sotodlib/site_pipeline/compute_data_quality.py Outdated
Comment thread sotodlib/site_pipeline/compute_data_quality.py Outdated
@mmccrackan

Copy link
Copy Markdown
Contributor

One other comment but can you move the Yaml config file to a draft PR over at https://github.com/simonsobs/site-pipeline-configs and remove it here? Fine to leave the paths as they are until we finalize them.

@mmccrackan

Copy link
Copy Markdown
Contributor

One other comment but we should probably rename the file to something that is more planet map specific.

Also if you could add a short entry to the docs, that would be awesome: https://github.com/simonsobs/sotodlib/blob/master/docs/site_pipeline.rst

Comment thread sotodlib/site_pipeline/compute_data_quality.py Outdated
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants