Skip to content

ci: Use sticky PR comments for Playwright report summaries#6909

Merged
khvn26 merged 2 commits intomainfrom
ci/sticky-playwright-pr-comments
Mar 11, 2026
Merged

ci: Use sticky PR comments for Playwright report summaries#6909
khvn26 merged 2 commits intomainfrom
ci/sticky-playwright-pr-comments

Conversation

@khvn26
Copy link
Member

@khvn26 khvn26 commented Mar 10, 2026

  • I have read the Contributing Guide.
  • I have added information to docs/ if required so people know about the feature.
  • I have filled in the "Changes" section below.
  • I have filled in the "How did you test this code" section below.

Changes

In this PR, we migrate Playwright E2E test report PR comments from daun/playwright-report-summary direct commenting to marocchino/sticky-pull-request-comment. This ensures that on CI re-runs, the existing comment is updated in place rather than creating a new one each time, reducing notification spam.

  • Use create-comment: false on daun/playwright-report-summary to generate the summary output only
  • Post the summary via marocchino/sticky-pull-request-comment@v2 with a stable header key per test type and runner

How did you test this code?

Will be validated by the next PR that triggers E2E tests in CI.

@khvn26 khvn26 requested a review from a team as a code owner March 10, 2026 09:55
@khvn26 khvn26 requested review from gagantrivedi and removed request for a team March 10, 2026 09:55
@vercel
Copy link

vercel bot commented Mar 10, 2026

The latest updates on your projects. Learn more about Vercel for GitHub.

3 Skipped Deployments
Project Deployment Actions Updated (UTC)
docs Ignored Ignored Preview Mar 10, 2026 10:21am
flagsmith-frontend-preview Ignored Ignored Preview Mar 10, 2026 10:21am
flagsmith-frontend-staging Ignored Ignored Preview Mar 10, 2026 10:21am

Request Review

@github-actions github-actions bot added the ci-cd Build, test and deployment related label Mar 10, 2026
@github-actions
Copy link
Contributor

github-actions bot commented Mar 10, 2026

Docker builds report

Image Build Status Security report
ghcr.io/flagsmith/flagsmith-api-test:pr-6909 Finished ✅ Skipped
ghcr.io/flagsmith/flagsmith-e2e:pr-6909 Finished ✅ Skipped
ghcr.io/flagsmith/flagsmith-frontend:pr-6909 Finished ✅ Results
ghcr.io/flagsmith/flagsmith-private-cloud:pr-6909 Finished ✅ Results
ghcr.io/flagsmith/flagsmith:pr-6909 Finished ✅ Results
ghcr.io/flagsmith/flagsmith-api:pr-6909 Finished ✅ Results

Zaimwa9
Zaimwa9 previously approved these changes Mar 10, 2026
@codecov
Copy link

codecov bot commented Mar 10, 2026

Codecov Report

✅ All modified and coverable lines are covered by tests.
✅ Project coverage is 98.34%. Comparing base (a37f417) to head (f76ab3d).
⚠️ Report is 8 commits behind head on main.

Additional details and impacted files
@@           Coverage Diff           @@
##             main    #6909   +/-   ##
=======================================
  Coverage   98.34%   98.34%           
=======================================
  Files        1335     1335           
  Lines       49707    49707           
=======================================
  Hits        48882    48882           
  Misses        825      825           

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.
  • 📦 JS Bundle Analysis: Save yourself from yourself by tracking and limiting bundle sizes in JS merges.

@github-actions
Copy link
Contributor

Playwright Test Results (oss - depot-ubuntu-latest-16)

passed  10 passed

Details

stats  10 tests across 7 suites
duration  27.9 seconds
commit  390bc21
info  🔄 Run: #15199 (attempt 1)

@github-actions
Copy link
Contributor

Playwright Test Results (oss - depot-ubuntu-latest-arm-16)

passed  10 passed

Details

stats  10 tests across 7 suites
duration  29.8 seconds
commit  390bc21
info  🔄 Run: #15199 (attempt 1)

@github-actions
Copy link
Contributor

Playwright Test Results (private-cloud - depot-ubuntu-latest-arm-16)

passed  16 passed

Details

stats  16 tests across 13 suites
duration  56.4 seconds
commit  390bc21
info  🔄 Run: #15199 (attempt 1)

@github-actions
Copy link
Contributor

Playwright Test Results (private-cloud - depot-ubuntu-latest-16)

failed  1 failed
passed  1 passed

Details

stats  2 tests across 2 suites
duration  55.2 seconds
commit  390bc21
info  📦 Artifacts: View test results and HTML report
🔄 Run: #15199 (attempt 1)

Failed tests

firefox › tests/environment-permission-test.pw.ts › Environment Permission Tests › Environment-level permissions control access to features, identities, and segments @enterprise

Use a shared header with append mode so all matrix jobs contribute
to one comment instead of creating separate ones.
@github-actions github-actions bot added ci-cd Build, test and deployment related and removed ci-cd Build, test and deployment related labels Mar 10, 2026
@github-actions
Copy link
Contributor

github-actions bot commented Mar 10, 2026

Playwright Test Results (oss - depot-ubuntu-latest-arm-16)

passed  10 passed

Details

stats  10 tests across 7 suites
duration  28.4 seconds
commit  f76ab3d
info  🔄 Run: #15200 (attempt 1)

Playwright Test Results (oss - depot-ubuntu-latest-16)

passed  10 passed

Details

stats  10 tests across 7 suites
duration  44 seconds
commit  f76ab3d
info  🔄 Run: #15200 (attempt 1)

Playwright Test Results (private-cloud - depot-ubuntu-latest-16)

passed  1 passed

Details

stats  1 test across 1 suite
duration  1 minute, 4 seconds
commit  f76ab3d
info  🔄 Run: #15200 (attempt 2)

Playwright Test Results (private-cloud - depot-ubuntu-latest-arm-16)

passed  2 passed

Details

stats  2 tests across 2 suites
duration  59.9 seconds
commit  f76ab3d
info  🔄 Run: #15200 (attempt 2)

@khvn26 khvn26 requested a review from Zaimwa9 March 10, 2026 10:36
@khvn26
Copy link
Member Author

khvn26 commented Mar 11, 2026

Likely needs more tweaking (all runs are appended to a single comment which will probably blow it up all the way to the body length limit for long-living PRs), but I'd rather merge this sooner and open a follow-up PR.

@khvn26 khvn26 merged commit dbd66e9 into main Mar 11, 2026
46 of 48 checks passed
@khvn26 khvn26 deleted the ci/sticky-playwright-pr-comments branch March 11, 2026 11:40
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

ci-cd Build, test and deployment related

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants