← 返回
未分类 中文

PR-Proof-of-Work

TDD-driven E2E workflow with real Playwright browser screenshots as PR proof. Use when: (1) fix bugs or implement features with test-first approach, (2) crea...
TDD-driven E2E workflow with real Playwright browser screenshots as PR proof. Use when: (1) fix bugs or implement features with test-first approach, (2) crea...
newtontech
未分类 clawhub v1.0.0 1 版本 99633.7 Key: 无需
★ 0
Stars
📥 272
下载
💾 0
安装
1
版本
#latest

概述

TDD E2E PR Workflow

One Issue → One PR with visual proof.

Flow: Select one issue → Write test (BEFORE screenshot) → Fix → Test passes (AFTER screenshot) → PR with screenshot comment.

Golden Rule: Study ≥2 existing PASSING tests before writing any new test. Wrong fixture/selector usage is #1 failure cause.


Phase 0: Select One Issue

Choose an open issue to work on, or pick randomly:

# Option A: List and manually select
gh issue list --repo <owner/repo> --state open --json number,title,body

# Option B: Pick one randomly
gh issue list --repo <owner/repo> --state open --json number,title | \
  jq -r '.[] | "\(.number): \(.title)"' | shuf -n 1
  1. Note the issue number and create a short kebab-case slug from title (e.g. "fix-discard-button")
  2. Create isolated worktree:

```bash

git worktree add .worktrees/fix/ -b fix/

cd .worktrees/fix/

```

  1. Copy screenshot-reporter.ts into the worktree's e2e/ directory (not tracked on fix branches)
  2. Set screenshot output:

```bash

export E2E_SCREENSHOT_DIR="$(pwd)/e2e-screenshots"

```


Phase 1: Write Real Browser Test

Step A: Study existing tests (MANDATORY)

Read ≥2 passing E2E tests to understand:

  • Fixture API (withProject, withSession, gotoSession, sdk)
  • Action helpers (waitSessionIdle, runTerminal, openSettings)
  • Selector patterns (data-component, data-slot, ARIA roles)
  • Data seeding (apply_patch, terminal commands, SDK methods)

Step B: Write test with BEFORE screenshot

import { test, expect } from "../fixtures"
import { createScreenshotReporter } from "../screenshot-reporter"

test("feature description", async ({ page, withProject }) => {
  const screenshot = createScreenshotReporter(page, "test-name")

  await withProject(async (project) => {
    // ... setup using project's fixture patterns ...
    await screenshot.captureBefore("initial-state")
    // ... assertions ...
  })
})

Playwright TS transform gotcha — rejects inline object params:

// WRONG: fs.mkdirSync(dir, { recursive: true })
// RIGHT:
const opts = { recursive: true }
fs.mkdirSync(dir, opts)

Apply to ALL object literals: fs.mkdirSync, page.screenshot, page.waitForFunction, etc.


Phase 2: Implement Fix

Write minimum code to pass. Do NOT modify test assertions.

Debugging loop (most tests need 2-4 iterations):

  1. Read error carefully — 90% are selector/fixture mismatches, not logic bugs
  2. Verify DOM — use page.waitForSelector or page.waitForFunction to confirm elements exist
  3. Check prerequisites — hover before clicking, expand before asserting, wait for idle
  4. Use page.pause() to inspect live DOM
  5. Never weaken assertions — fix the code, not the test

Common failure patterns (see references/debugging-guide.md):

SymptomLikely CauseFix
---------
Timeout on selectorWrong data attribute or shadow DOMCheck DOM with page.pause(), try ARIA roles
waitMark never resolvesSeed function missing expected contentMatch seed format exactly from passing tests
Button not visibleMissing hover/expand stepHover parent row, expand section first
Review panel emptyWrong changes mode (git vs session)Switch mode before asserting
Stale element referenceRace condition with async updatesAdd waitSessionIdle after mutations

Phase 3: AFTER Screenshot + Hard Gate

  await expect(fixedElement).toBeVisible()
  await screenshot.captureAfter("feature-working")

Hard gate — ALL three must be true before PR:

  • Test passes (exit code 0)
  • BEFORE-*.png exists
  • AFTER-*.png exists

Phase 4: PR + Screenshot Comment

# Stage, commit, push
git add -A
git commit -m "fix: <issue-description> (closes #<issue-number>)"
git push origin fix/<slug>

# Create PR referencing the issue
gh pr create \
  --title "fix: <short-description>" \
  --body "Closes #<issue-number>

## Summary
<Brief description of the fix>

## Screenshots
| Before | After |
|--------|-------|
| ![Before](<BEFORE-screenshot-url>) | ![After](<AFTER-screenshot-url>) |

## Verification
- [x] E2E test passes
- [x] BEFORE screenshot captured
- [x] AFTER screenshot captured" \
  --repo <owner/repo>

# Push screenshots to branch for GitHub raw URLs
git add e2e-screenshots/
git commit -m "chore: add e2e screenshots"
git push origin fix/<slug>

gh pr comment has no --attach — push images to branch, use raw GitHub URLs.


Backend-Only PRs

For PRs without direct UI changes, find the closest UI-exercisable path:

Change TypeE2E StrategyReal Example
---------
Config utilityOpen settings dialogopenSettings(page) → screenshot config panel
Python resolverRun terminal commandrunTerminal(page, {cmd: "python3 --version"}) → show output
Race conditionTrigger rapid operationsCreate file externally → click refresh → verify
State managementMulti-session switchingSelect file in session A → switch to B → back to A
Cache bypassForce refreshAdd external file → click refresh button → verify
URL parsingCheck connection statusopenStatusPopover(page) → verify connected
Focus managementVerify focus after actionOpen file → check prompt still focused

NEVER use page.setContent() — always test through the real application.


Quick Reference

# Select an issue (manual or random)
gh issue list --repo owner/repo --state open --json number,title

# Create worktree
git worktree add .worktrees/fix/ISSUE -b fix/ISSUE
cd .worktrees/fix/ISSUE

# Set screenshot dir
export E2E_SCREENSHOT_DIR="$(pwd)/e2e-screenshots"

# Run E2E test
npm run test:e2e -- <test-file>

# Push and create PR
git push origin fix/ISSUE
gh pr create --title "fix: ..." --body "Closes #N" --repo owner/repo

Constraints

  • One issue at a time — complete one PR before starting the next
  • BEFORE and AFTER must BOTH exist before PR comment — hard gate, no exceptions
  • Screenshots save to worktree via E2E_SCREENSHOT_DIR, never to main repo
  • Always study ≥2 passing tests first — this is the #1 rule
  • NEVER use page.setContent() — real app only
  • Playwright TS transform rejects inline object params — always extract to variable
  • screenshot-reporter.ts must be copied to each worktree's e2e/ (not on fix branches)
  • Test MUST pass before PR — never create PR with failing tests

版本历史

共 1 个版本

  • v1.0.0 当前
    2026-05-07 18:59 安全 安全

安全检测

腾讯云安全 (Keen)

安全,无风险
查看报告

腾讯云安全 (Sanbu)

安全,无风险
查看报告

🔗 相关推荐

ai-agent

Self-Improving + Proactive Agent

ivangdavila
自我反思+自我批评+自我学习+自组织记忆。智能体评估自身工作、发现错误并持续改进。
★ 1,376 📥 320,195
ai-agent

Skill Vetter

spclaudehome
AI智能体技能安全预审工具。安装ClawdHub、GitHub等来源技能前,检查风险信号、权限范围及可疑模式。
★ 1,225 📥 267,663
ai-agent

self-improving agent

pskoett
捕获经验教训、错误及修正内容,以实现持续改进。适用于以下场景:(1)命令或操作意外失败;(2)用户纠正Claude(如“不,那不对……”“实际上……”);(3)用户请求的功能不存在;(4)外部API或工具出现故障;(5)Claude发现自身
★ 4,078 📥 808,678