Repository navigation
Smoke Test: Claude - 24572008825 #26899
Description
Summary
Smoke test run for Claude engine validation — Run §24572008825
Overall Status: PARTIAL (1 test failed, 1 skipped)
PR used for review testing: #26810 "Bump default CLI/tool versions (Claude, Copilot, Codex, GitHub MCP) and recompile lockfiles"
Timestamp: 2026-04-17T15:08:46Z
Core Tests (#1–12)
| # | Test | Result | Notes |
|---|---|---|---|
| 1 | GitHub MCP Testing | ✅ | Last 2 merged PRs: #26872 (docs FAQ fix), #26858 (MCP gateway refactor) |
| 2 | MCP Scripts GH CLI Testing | ✅ | PRs #26888 (ci: compile marketplace workflows), #26879 (WIP: fix file size) |
| 3 | Serena MCP Testing | ✅ | Project activated, 4 symbols found (2 main Files, 2 main Functions) |
| 4 | Make Build Testing | ✅ | make build succeeded — built gh-aw binary |
| 5 | Playwright Testing | ✅ | Page title: "GitHub · Change is constant. GitHub keeps you ahead. · GitHub" |
| 6 | Tavily Web Search Testing | ✅ | 5 results returned for "GitHub Agentic Workflows" |
| 7 | File Writing Testing | ✅ | /tmp/gh-aw/agent/smoke-test-claude-24572008825.txt created |
| 8 | Bash Tool Testing | ✅ | File contents verified via cat |
| 9 | Discussion Interaction Testing | ✅ | Discussion #26897 found; comic-book comment added |
| 10 | Agentic Workflows MCP Testing | ❌ | Error: failed to get workflow statuses — tool unavailable |
| 11 | Slack Safe Output Testing | ✅ | Message posted to #smoke-tests |
| 12 | Code Scanning Alert Testing | ✅ | Dummy warning alert created |
PR Review Safe Output Tests (#13–19)
| # | Test | Result | Notes |
|---|---|---|---|
| 13 | Update PR Testing | ✅ | PR #26810 body appended |
| 14 | PR Review Comment Testing | ✅ | 2 inline review comments on .changeset/patch-update-cli-tool-versions-20260417.md |
| 15 | Submit PR Review Testing | ✅ | Review submitted as COMMENT |
| 16 | Resolve Review Thread | Skipped — no review threads existed on PR #26810 | |
| 17 | Add Reviewer Testing | ✅ | copilot reviewer added to PR #26810 |
| 18 | Push to PR Branch Testing | ✅ | smoke-test-files/smoke-claude-push-test.md pushed to branch |
| 19 | Close PR Testing | Skipped — no suitable test/bot PR to close safely |
Test Details
Test #10 — Agentic Workflows MCP Error
Error: MCP error -32603: calling "tools/call": failed to get workflow statuses
Pattern searched: smoke-claude
The agentic-workflows MCP server returned an internal error when querying workflow status. This may indicate the MCP server was unavailable or the workflow pattern was not found.
Test #3 — Serena Symbols Found
Symbols found via find_symbol("main"):
cmd/gh-aw/main(File, 896 lines)main(Function) incmd/gh-aw/main.gocmd/gh-aw-wasm/main(File, 124 lines)main(Function) incmd/gh-aw-wasm/main.go
References:
💥 [THE END] — Illustrated by Smoke Claude · ● 178K · ◷
- expires on Apr 17, 2026, 5:12 PM UTC
Activity
github-actions commentedon Apr 17, 2026
This issue was automatically closed because it expired on 2026-04-17T17:12:48.298Z.