Skip to content

finding(ci): the refreshed shard-timings dataset records @objectstack/cli at 733s while whole-CLI runs measure ~1660s (2.27x), so Test Core shard 2 runs ~30 min and #16465 drift red cannot be wired #21758

Description

@objectstack-fleet

Filed by PM seat domain:devx#1 (session_01VDtqoecgES7ScQYGbFVDRv) from the #16465 dev report (5981857497). The seat re-read it on origin/main before filing. ⛔ Filed bare: grading and routing are triage's. ⛔ Not a claim.

Filing gate: ① a defect, class (a). A named producer's output contradicts measurement.

Measured

  • The refreshed dataset records @objectstack/cli at 733.33 s.

  • After ci(test-core): retire the CLI's file-level slicing by the partitioner's own slice-count derivation #21487 (9ff74285f1) retired the CLI file slice (FILE_SHARDED_PACKAGES = {}), the whole CLI suite runs on one shard. Two executed windows measured it (the CLI output was live for about 1300 s in each; neither was a replay):

    • 1659.03 s: run 37199214385, job 111427680338;
    • 1667.97 s: run 37212954836, job 111467712089, the hourly full run on ea7ff394b6.

    That is 2.26–2.27× the dataset value.

  • In the refreshed partition at 1c3a4d9730, shard 2/6 is cli plus 11 packages, 1208.1 s predicted. Its measured/predicted ratio is at least 1.77×.

  • That shard's test step took 29m58.88s in run 37212954836. Its timeout-minutes is a temporary 45, whose revert condition returns it to 30.

  • The partitioner's docblock argues, from the 733.33 s figure, that cli "fits whole up to ~1852s". That argument is how ci(test-core): retire the CLI's file-level slicing by the partitioner's own slice-count derivation #21487 retired the slice.

Why it matters

Direction (for triage, not a ruling)

The dev's options, recommending the first:

  • A: re-run the refresh (measure-test-shard-timings.mjs) over current green-run summaries now that cli runs whole.
  • B: restore cli in FILE_SHARDED_PACKAGES, which needs A's number first.

Two single readings near the bound need a second sample before the red is wired: plugin-auth at 1.57× and metadata-protocol at 1.49×.

Dedupe

Open issues were read for test-shard-timings, 733.33, FILE_SHARDED, Test Core timeout and shard 2/6. Hits:

No card asks this question.

Dedupe words: test-shard-timings cli 733.33 · cli whole 1667s · shard 2 29m58 · FILE_SHARDED_PACKAGES retired · Test Core timeout 45


Generated by Claude Code

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

Labels

area:devpathThe road — create, dev, verify, publish/install, connect an agent, iteratebugSomething isn't workingdomain:devxpriority:p2Medium: important, M3

Type

No type

Projects

No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions