Repository navigation
Smoke Test: Claude - 24593507195 #26971
Copy link
Copy link
Closed as not planned
Labels
Description
Test Results — Run §24593507195
Overall Status: PARTIAL (1 test tool unavailable, 2 skipped by policy)
Timestamp: 2026-04-18T01:18 UTC
PR Used for Review Tests: #26953
Core Tests (#1–12)
| # | Test | Result |
|---|---|---|
| 1 | GitHub MCP — last 2 merged PRs | ✅ (response oversized, fetched via pagination) |
| 2 | mcpscripts-gh — list 2 PRs | ✅ (#26968, #26966) |
| 3 | Serena MCP — activate + find 3+ symbols | ✅ (CompileWorkflow, validateWorkflowData, generateAndValidateYAML, +) |
| 4 | Make build | ✅ go build succeeded |
| 5 | Playwright — github.com title contains "GitHub" | ✅ "GitHub · Change is constant." |
| 6 | Tavily web search — "GitHub Agentic Workflows" | ✅ 3 results returned |
| 7 | File writing — smoke-test-claude-24593507195.txt | ✅ Created |
| 8 | Bash tool — verify file contents | ✅ cat output verified |
| 9 | Discussion interaction — comment on #26967 | ✅ Comic-book comment posted |
| 10 | Agentic Workflows MCP — status smoke-claude |
❌ Tool unavailable: failed to get workflow statuses |
| 11 | Slack safe output | ✅ Posted to #smoke-tests |
| 12 | Code scanning alert safe output | ✅ Warning posted on README.md:1 |
PR Review Tests (#13–19)
| # | Test | Result |
|---|---|---|
| 13 | Update PR body (append) | ✅ Appended test message |
| 14 | PR review comments (2 lines) | ✅ 2 inline comments on invocation_context_helpers.cjs |
| 15 | Submit PR review (COMMENT) | ✅ Review submitted |
| 16 | Resolve review thread | |
| 17 | Add reviewer (copilot) | ✅ Copilot added as reviewer |
| 18 | Push to PR branch | ✅ smoke-test-files/smoke-claude-push-test.md pushed |
| 19 | Close PR (conditional) |
Details
Test #10 — Agentic Workflows MCP Error
MCP error -32603: calling "tools/call": failed to get workflow statuses
The status file was written to /tmp/gh-aw/agent/smoke-claude-status-24593507195.txt with error note.
Test #16 — Integrity Policy
The get_review_comments call returned empty due to integrity filtering:
Resource 'pr:#26953' has lower integrity than agent requires.
Note
🔒 Integrity filter blocked 1 item
The following item were blocked because they don't meet the GitHub integrity level.
- Refactor comment scripts for native SideRepoOps context (workflowRepo vs eventRepo) #26953
pull_request_read: has lower integrity than agent requires. The agent cannot read data with integrity below "approved".
To allow these resources, lower min-integrity in your GitHub frontmatter:
tools:
github:
min-integrity: approved # merged | approved | unapproved | none💥 [THE END] — Illustrated by Smoke Claude · ● 287.8K · ◷
- expires on Apr 18, 2026, 3:24 AM UTC
Reactions are currently unavailable
Activity
github-actions commentedon Apr 18, 2026
This issue was automatically closed because it expired on 2026-04-18T03:24:43.182Z.