Repository navigation
Conversation
…hange `vitest related` follows imports, but unit-suite gates such as eager-closure-budgets read production sources as text, so no related test reaches them. The runner also skipped `unit` whenever the related run was selected, and that skip applied even to fail-open plans. #3995 passed `check:affected --run --head` locally and then failed the closure budget in CI. A production source change under src/ or packages/*/src now selects `unit`, and the related run no longer stands in for it. A fail-open plan runs every local check. Test-only changes keep the related run alone. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
|
The latest updates on your projects. Learn more about Vercel for GitHub. 1 Skipped Deployment
|
Size Report
Startup median (7 runs, lower is better):
|
There was a problem hiding this comment.
All reported issues were addressed across 4 files
Reply with feedback, questions, or to request a fix.
View guided diff | Turn on auto-fix | Re-trigger cubic
…ider-integration The narrowed-plan case passed even when provider-integration was never selected or the related run never ran. It now asserts the plan selects provider-integration, the related run executes, and the provider suite does not. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
|
The code looks good at 988c310, and I found no problems. Not blocking, and fine to take or leave: add one sentence under "Interpret selection" in docs/agents/testing.md saying that a production source change runs the full unit suite (about 3 minutes) because some gates read sources as text, and that provider-integration is the only check the related run stands in for. Also, the test "the related run still stands in for provider-integration" in scripts/check-affected/run.test.ts only asserts exit 0, so it would be stronger if it recorded the executed commands and asserted that a related command ran and no test:integration:provider command ran. CI is still running. Repo Guards & Compatibility, Coverage and both Smoke Tests are in progress and none has failed. Repo Guards runs the affected-selector tests this PR edits, so a failure there would be related. A failure in Coverage or Smoke Tests would look unrelated, because the diff only touches scripts/check-affected. I did not run check:affected:test or the mutation experiments, so those claims rest on the PR description. I also did not list every unit test that reads sources as text. There are no known conflicts. One open thread does not apply, so please resolve it: #4025 (comment) (if the related command were missing, provider-integration would run and the test would fail; the model test guards the provider selection). |
Under "Interpret selection", state that related tests replace only provider integration and that a production source change also runs the unit suite, because some unit gates read sources as text. To stay within the agent-docs budget, three lists become sentences and two sentences that repeat tool output are removed. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
|
The change at 919d757 looks good to me, and the earlier review of 988c310 still holds. The provider-deferral test in |
|
Both notes are applied:
Validation:
Two full-gate attempts at dbaeb81 failed in unrelated suites, with the host at load average 48–55:
This PR does not touch either test or its imports. Because the unit suite now runs locally on every production change, races like these will surface more often. The kill-settle test should wait for a ready marker instead of sleeping; that would be a separate host-kit PR. |
There was a problem hiding this comment.
All reported issues were addressed across 1 file (changes from recent commits).
Reply with feedback, questions, or to request a fix.
View guided diff | Turn on auto-fix | Re-trigger cubic
A fail-open plan runs every local check, so related tests stand in for nothing there. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
|
The change looks good at 02d0e69, and the unit suite now runs for every production source change as intended. The only change since the earlier review at 919d757 (#4025 (comment)) is in docs/agents/testing.md. It now says that on a narrowed plan, related tests replace only provider integration, which matches the code. All 20 reported checks pass, and there are no conflicts. Both earlier Cubic threads are fixed at this head, so you can resolve them: the test that could pass with both checks absent (#4025 (comment)) now asserts the related run happened and provider integration did not, and the testing.md wording (#4025 (comment)) matches the plan logic. I read the head code and tests but did not run the unit suite or the check-affected tests locally. I also did not check the '(about 3 minutes)' unit-suite duration, which is unmeasured. |
Summary
#3995 passed
pnpm check:affected --run --headand then failedeager-closure-budgetsin CI Coverage.vitest relatedfollows imports, but that gate reads sources as text, so related never selects it. The runner also droppedunitwhenevervitest-relatedran, even for fail-open plans. Most source paths (src/,packages/daemon,packages/selectors) never selectedunitat all. Other unit-core tests have the same blind spot, for examplecli-startup-import-closure.test.ts, so a hand list or a location-based set would miss some.src/orpackages/*/srcnow selectsunit(own:unit-text-gates).unitnever defers to the related run. A fail-open plan runs every local check.provider-integrationstill defers on a narrowed plan.Cost: about 3 min per source-changing run (
check:unit: 165 s vitest plus smoke).Validation
pnpm check:affected --run --head 919d757732: 42 checks passed,exactCommit=true, includingunitandprovider-integration.check:affected:test: 86 pass. Restoring theunitskip, the fail-open skip, or the model rule each fails the new tests.vitest-related.unitthen failed it oneager-closure-budgets(exactCommit=true). The plant was dropped.agent-guidancepassed (exactCommit=true).🤖 Generated with Claude Code