Add 2024 ATB Update Pipeline - #14
Open
Yunzhi-Chen wants to merge 56 commits into
Open
Conversation
Update Links
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
…l/ReEDS_Input_Processing into yc/natural_gas_update
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
…config.json" This reverts commit 92f0e8b.
…ession/README.md Co-authored-by: Wesley Cole <49044852+wesleyjcole@users.noreply.github.com>
Update AEO preprocessing to pull from AEO2026
This reverts commit c43c67f.
…om AEO directly" This reverts commit 0e86670.
Add natural gas price regression pipeline
Remove highprice and lowprice since AEO 2026 does not have the two scenarios
Update natural gas regression parameters with AEO 2026 data
Fix formatting issues in README.md
…ression_params.ipynb Co-authored-by: Wesley Cole <49044852+wesleyjcole@users.noreply.github.com>
Add temperature - gas price regression workflow
scraped_input holds raw ATB downloads (workbook, flat file). Battery costs are extracted from the workbook at runtime; battery_costs_2024.csv intermediate removed. Pre-release battery_costs_2025.csv is now local/gitignored.
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
4 participants
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
Adds a configuration-driven workflow to convert corrected ATB 2024 v3 data into ReEDS-compatible inputs.
The workflow downloads, formats, plots, and validates ATB data. It also provides optional selective smoothing and before/after comparison plots.
Technical details
Additional changes
atb/config.yamland pipeline scripts.Relevant sources or documentation
Additional details
Output verification
The formatter completed successfully and generated 32 ReEDS input files. All 32 unsmoothed files matched the corresponding current ReEDS inputs within the configured tolerance.
Validation plots—unsmoothed output versus current ReEDS data:
plots.zip
Before/after smoothing plots:
smoothing_comparison.zip
The smoothed outputs intentionally differ where short dips, bumps, or stair steps are removed.
Documentation
Updated the ATB README files with setup, processing, smoothing, validation, and input-source information.
LLM usage
LLM tools assisted with implementation, documentation, debugging, and validation. Outputs were reviewed and tested against the current ReEDS inputs.