Skip to content

ci(release-schedule): trigger from the cluster, not GitHub's cron - #858

Open
funkypenguin wants to merge 1 commit into
mainfrom
feat/release-schedule-external-dispatch
Open

ci(release-schedule): trigger from the cluster, not GitHub's cron#858
funkypenguin wants to merge 1 commit into
mainfrom
feat/release-schedule-external-dispatch

Conversation

@funkypenguin

Copy link
Copy Markdown
Contributor

Draft on purpose — do not merge until elfhosted/infra#20140 is merged and a cluster dispatch has been observed to land. This PR removes the only automatic trigger this workflow currently has.

Why

GitHub deprioritises scheduled workflows and silently drops ticks. Over one 17-hour sample this workflow's "30 * * * *" cron fired 12 times instead of 17, with gaps up to 2h18m:

13:45 14:43 15:58 16:44 18:04 19:12 20:04 21:17 22:26 23:37 — 02:04 — 04:14

harbor-themes-v0.11.5 was tagged upstream at 05:19 UTC on 2026-08-27; the matrix had last run at 04:14. The image sat unbuilt for over two hours with nothing reporting a failure — fetch.sh had correctly seen no change on its last run, and the next run never came.

Replaced by a k8s CronJob in infra (cronjobs/dispatch-containers-release--flux-system) firing workflow_dispatch hourly at :30, the same cadence this file used to declare. Same pattern elfhosted/myprecious' release-please workflow already uses.

Also: workflow-level concurrency

A full matrix build routinely outlives the dispatch interval. Because fetch.sh compares against published tags, an overlapping run re-derives the same not-yet-pushed changes, and both runs race to push the same tag at different digests — churning renovate PRs and tenant clusters.

That was previously masked by the dropped ticks. With a reliable hourly trigger it would not be. cancel-in-progress: false lets a running build finish; GitHub keeps at most one pending run, whose matrix is generated fresh when it starts.

🤖 Generated with Claude Code

GitHub deprioritises scheduled workflows and silently drops ticks: over one
17-hour sample this workflow's own "30 * * * *" cron fired 12 times instead of
17, with gaps up to 2h18m. harbor-themes-v0.11.5 was tagged upstream at 05:19
and the matrix had last run at 04:14, so the image sat unbuilt with nothing
reporting a failure.

Replaced by a k8s CronJob in infra (cronjobs/dispatch-containers-release--flux-system)
that fires workflow_dispatch hourly at :30, matching the cadence this file used
to declare. Same pattern as elfhosted/myprecious' release-please workflow.

Also adds workflow-level concurrency. A full matrix build routinely outlives
the dispatch interval, and because fetch.sh compares against PUBLISHED tags an
overlapping run re-derives the same not-yet-pushed changes, so both runs race
to push the same tag at different digests. Queueing was previously masked by
the dropped ticks; with a reliable trigger it would not be.

Co-Authored-By: Claude Opus 5 (1M context) <noreply@anthropic.com>
@funkypenguin
funkypenguin marked this pull request as ready for review August 27, 2026 07:05
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant