Skip to content

feat(triage): merge enterprise results into release triage - #883

Draft
estefafdez wants to merge 13 commits into
mainfrom
estefafdez/task/enterprise-triage
Draft

estefafdez wants to merge 13 commits into
mainfrom
estefafdez/task/enterprise-triage

Conversation

@estefafdez

@estefafdez estefafdez commented Sep 25, 2026 •

Copy link
Copy Markdown
Collaborator

Done Definition Checks

Taiga URL (optional)

Taiga Ticket: 2523

Description

This PR resolves the release triage not covering the Enterprise suite and cleans up several confusing/rough edges in the release-triage.yml workflow found while testing it end to end.

What problem are you trying to solve?

The daily workflow (playwright_pre_daily.yml) now runs both a standard (chrome) and an enterprise job, each uploading its own report to S3.

Solution

  • scripts/triage.ts: --results is now repeatable, so the standard and enterprise results.json get merged into a single clustering pass and land in the same release story instead of needing two separate triage runs (which would have stepped on each other's resolved/auto-close state). Tasks made up entirely of enterprise specs get an [enterprise] prefix in their subject.
  • release-triage.yml: also fetches the enterprise suite's report when the run has one (falls back cleanly to standard-only otherwise)
  • Tightened several workflow input descriptions to be short and clear in the GitHub Actions "Run workflow" form.
  • .github/workflows/README.md updated to match.

How to test

  • Check the code
  • Update the test case in Qase (Automation Status field or steps changed)
  • It complies with the test conventions
  • There are no missing snapshots
  • The tests run OK

Screenshots 📸 (optional)

image image image

Merge reset_state/close_only into a single mode choice, auto-delete the
old Taiga story on reset instead of requiring a manual step, and fail
fast with a clear message if release_tag looks like a full build string
instead of a short release name.
…3 reports

The GITHUB_TOKEN-scoped gh run list lookup was seen returning a
completed scheduled run 3 weeks stale (its S3 report had already
expired), crashing the download step with a raw 404. Walk the last 15
candidates and use the first one whose results.json actually exists in
S3, instead of trusting the very first match blindly.
Temporary, removed right after use once #2569/#2570 are deleted.
GitHub only recognizes workflow_dispatch workflows once they've existed
on the default branch — a brand-new workflow file on a feature branch
can't be dispatched via API/CLI (404), so this approach doesn't work.
Discovered while testing: a story already exists in production tagged
with a full build string. The hard-fail check would have made it
impossible to keep adding to that exact story, so this only warns in
the job summary now — intentionally reusing an existing tag to
continue its story is a valid case, not just a mistake.
@estefafdez estefafdez self-assigned this Sep 25, 2026
@estefafdez
estefafdez marked this pull request as ready for review September 25, 2026 07:38
Comment thread .github/workflows/release-triage.yml Outdated
--event schedule \
--status completed \
--limit 1 \
--limit 15 \

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Why do you change this limit?

Copy link
Copy Markdown
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@tdelatorre I changed --limit 1 to --limit 15 because, when I was running and testing this workflow, gh run list returned a run from more than 3 weeks ago whose report no longer existed in S3 (it had been deleted by our bucket's retention policy). That's why, with a limit of 15 runs (~3 weeks of daily runs), we avoid picking a run whose S3 report might already be expired.

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@estefafdez It shouldn't grab a run from more than 3 weeks ago; there are runs every day. It should always grab the latest nitrate run and other tests run, with their reports in S3.
We should investigate why it's doing that.

Comment thread scripts/triage.ts Outdated
@estefafdez
estefafdez marked this pull request as draft September 25, 2026 10:20

This branch has not been deployed

No deployments
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants