There is a mismatch between the test execution duration shown in the pipeline logs and the duration value sent in the automated email report. The highlighted pipeline step "Run Playwright Tests" shows a duration of approximately 10m 45s for test execution (see attached screenshot), while the email report displays a much shorter duration (e.g., 3m 25s), which does not reflect the actual time taken by the test run.
Steps to Reproduce:
- Execute a Playwright test pipeline in Azure DevOps.
- Observe the duration for "Run Playwright Tests" in the job timeline and logs.
- Check the duration reported in the test summary HTML or email report generated by the pipeline.
Expected Behavior:
The duration shown in the email report should match the actual test execution time as recorded in the pipeline job (highlighted as 10m 45s).
Actual Behavior:
The email report displays a duration much shorter than the test execution time shown in the logs (example: 3m 25s).
Additional Details:
- This causes confusion as recipients see a test duration in the email that vastly differs from what's shown in the pipeline.
- Screenshots attached for reference:
- Pipeline job log showing 10m 45s for "Run Playwright Tests"
- Email report summary displaying 3m 25s for test execution
Attachments:
Pipeline job screenshot (shows true test execution time)
Email report screenshot (shows incorrect duration)
Request:
Please investigate why the test duration value in the email report does not match the actual test execution time and update the report logic to reflect the true duration.
There is a mismatch between the test execution duration shown in the pipeline logs and the duration value sent in the automated email report. The highlighted pipeline step "Run Playwright Tests" shows a duration of approximately 10m 45s for test execution (see attached screenshot), while the email report displays a much shorter duration (e.g., 3m 25s), which does not reflect the actual time taken by the test run.
Steps to Reproduce:
Expected Behavior:
The duration shown in the email report should match the actual test execution time as recorded in the pipeline job (highlighted as 10m 45s).
Actual Behavior:
The email report displays a duration much shorter than the test execution time shown in the logs (example: 3m 25s).
Additional Details:
Attachments:
Pipeline job screenshot (shows true test execution time)
Email report screenshot (shows incorrect duration)
Request:
Please investigate why the test duration value in the email report does not match the actual test execution time and update the report logic to reflect the true duration.