DO-NOT-MERGE Triage E2E test failures

[jackfrancis]

What type of PR is this?

/kind failing-test

What this PR does / why we need it:

This PR is a fulcrum to see what works and doesn't in current E2E tests.

Which issue(s) this PR fixes (optional, in fixes #<issue number>(, fixes #<issue_number>, ...) format, will close the issue(s) when PR gets merged):
Fixes #

Special notes for your reviewer:

TODOs:

• squashed commits
• includes documentation
• adds unit tests
• cherry-pick candidate

Release note:

NONE

[k8s-ci-robot]

[APPROVALNOTIFIER] This PR is NOT APPROVED

This pull-request has been approved by:
Once this PR has been reviewed and has the lgtm label, please assign jackfrancis for approval. For more information see the Code Review Process.

The full list of commands accepted by this bot can be found here.

Details

Needs approval from an approver in each of these files:

• OWNERS

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

[codecov]

Codecov Report

✅ All modified and coverable lines are covered by tests.
✅ Project coverage is 44.41%. Comparing base (c61e7ed) to head (efc82e1).
⚠️ Report is 13 commits behind head on main.

Additional details and impacted files

@@           Coverage Diff           @@
##             main    #6106   +/-   ##
=======================================
  Coverage   44.41%   44.41%           
=======================================
  Files         280      280           
  Lines       25379    25379           
=======================================
  Hits        11273    11273           
  Misses      13293    13293           
  Partials      813      813           

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:

• ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

[jackfrancis]

/test ls

[jackfrancis]

/test pull-cluster-api-provider-azure-apiversion-upgrade
/test pull-cluster-api-provider-azure-e2e-workload-upgrade
/test pull-cluster-api-provider-azure-aks-mgmt-e2e
/test pull-cluster-api-provider-azure-apiserver-ilb
/test pull-cluster-api-provider-azure-capi-e2e
/test pull-cluster-api-provider-azure-conformance
/test pull-cluster-api-provider-azure-conformance-azl3-with-ci-artifacts
/test pull-cluster-api-provider-azure-conformance-custom-builds
/test pull-cluster-api-provider-azure-conformance-dual-stack-with-ci-artifacts
/test pull-cluster-api-provider-azure-conformance-ipv6-with-ci-artifacts
/test pull-cluster-api-provider-azure-conformance-with-ci-artifacts
/test pull-cluster-api-provider-azure-conformance-with-ci-artifacts-dra
/test pull-cluster-api-provider-azure-dra-scalability
/test pull-cluster-api-provider-azure-e2e-optional
/test pull-cluster-api-provider-azure-e2e-windows
/test pull-cluster-api-provider-azure-load-test-1k-dra-with-workload-custom-builds
/test pull-cluster-api-provider-azure-load-test-custom-builds
/test pull-cluster-api-provider-azure-load-test-dra-custom-builds
/test pull-cluster-api-provider-azure-load-test-dra-with-workload-custom-builds
/test pull-cluster-api-provider-azure-perf-test-apiserver-availability
/test pull-cluster-api-provider-azure-windows-custom-builds
/test pull-cluster-api-provider-azure-windows-with-ci-artifacts

[jackfrancis]

/test pull-cluster-api-provider-azure-e2e-workload-upgrade
/test pull-cluster-api-provider-azure-conformance-azl3-with-ci-artifacts
/test pull-cluster-api-provider-azure-e2e-windows
/test pull-cluster-api-provider-azure-windows-custom-builds
/test pull-cluster-api-provider-azure-windows-with-ci-artifacts

curious if these are flaky or broken

[jackfrancis]

/test pull-cluster-api-provider-azure-conformance-azl3-with-ci-artifacts
/test pull-cluster-api-provider-azure-e2e-windows
/test pull-cluster-api-provider-azure-windows-custom-builds
/test pull-cluster-api-provider-azure-windows-with-ci-artifacts

pull-cluster-api-provider-azure-e2e-workload-upgrade is definitely flaky (passed on 2nd attempt)

[jackfrancis]

/test pull-cluster-api-provider-azure-conformance-azl3-with-ci-artifacts
/test pull-cluster-api-provider-azure-e2e-windows
/test pull-cluster-api-provider-azure-windows-custom-builds
/test pull-cluster-api-provider-azure-windows-with-ci-artifacts

[k8s-ci-robot]

@jackfrancis: The following tests failed, say /retest to rerun all failed tests or /retest-required to rerun all mandatory failed tests:

Test name	Commit	Details	Required	Rerun command
pull-cluster-api-provider-azure-dra-scalability	efc82e1	link	false	/test pull-cluster-api-provider-azure-dra-scalability
pull-cluster-api-provider-azure-perf-test-apiserver-availability	efc82e1	link	false	/test pull-cluster-api-provider-azure-perf-test-apiserver-availability
pull-cluster-api-provider-azure-load-test-dra-custom-builds	efc82e1	link	false	/test pull-cluster-api-provider-azure-load-test-dra-custom-builds
pull-cluster-api-provider-azure-load-test-dra-with-workload-custom-builds	efc82e1	link	false	/test pull-cluster-api-provider-azure-load-test-dra-with-workload-custom-builds
pull-cluster-api-provider-azure-load-test-1k-dra-with-workload-custom-builds	efc82e1	link	false	/test pull-cluster-api-provider-azure-load-test-1k-dra-with-workload-custom-builds
pull-cluster-api-provider-azure-windows-with-ci-artifacts	efc82e1	link	false	/test pull-cluster-api-provider-azure-windows-with-ci-artifacts
pull-cluster-api-provider-azure-conformance-azl3-with-ci-artifacts	efc82e1	link	false	/test pull-cluster-api-provider-azure-conformance-azl3-with-ci-artifacts
pull-cluster-api-provider-azure-windows-custom-builds	efc82e1	link	false	/test pull-cluster-api-provider-azure-windows-custom-builds
pull-cluster-api-provider-azure-e2e-windows	efc82e1	link	false	/test pull-cluster-api-provider-azure-e2e-windows

Full PR test history. Your PR dashboard. Please help us cut down on flakes by linking to an open issue when you hit one in your PR.

Details

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes-sigs/prow repository. I understand the commands that are listed here.

[willie-yao]

/test pull-cluster-api-provider-azure-apiversion-upgrade

[willie-yao]

/test pull-cluster-api-provider-azure-apiversion-upgrade

[willie-yao]

/test pull-cluster-api-provider-azure-aks-mgmt-e2e