Skip to content

adds pagination support for reading from azure tables#116

Merged
tomjemmett merged 4 commits into
mainfrom
add_table_storage_pagination
May 13, 2026
Merged

adds pagination support for reading from azure tables#116
tomjemmett merged 4 commits into
mainfrom
add_table_storage_pagination

Conversation

@tomjemmett

@tomjemmett tomjemmett commented May 11, 2026

Copy link
Copy Markdown
Member

adds support to read an entire table by paginating results.

for our needs this is probably ok, but could cause problems if the table is very large

Copilot AI review requested due to automatic review settings May 11, 2026 13:07
@tomjemmett tomjemmett requested a review from francisbarton as a code owner May 11, 2026 13:07

Copilot AI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

This PR updates read_azure_table() to support Azure Table Storage pagination by iteratively fetching additional pages using continuation headers, returning a single combined tibble.

Changes:

  • Refactors request construction into a reusable base_req.
  • Adds iterative paging via httr2::req_perform_iterative() using x-ms-continuation-* headers.
  • Updates response parsing to combine results across multiple responses.

💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

Comment thread R/read_azure_table.R
Comment thread R/read_azure_table.R
tomjemmett and others added 2 commits May 11, 2026 14:57
Co-authored-by: Copilot Autofix powered by AI <175728472+Copilot@users.noreply.github.com>
@tomjemmett tomjemmett mentioned this pull request May 12, 2026

@francisbarton francisbarton left a comment

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This is great Tom, thanks!

@tomjemmett tomjemmett merged commit 5b8160d into main May 13, 2026
1 check passed
@tomjemmett tomjemmett deleted the add_table_storage_pagination branch May 14, 2026 09:48
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants