virtctl v1.9.1-CE-scratch-r1 build trail
How ReadyStack built readystack/virtctl:v1.9.1-CE-scratch-r1 and its build kit, copied record by record: why the release exists, every chain, drive and stage it went through, the model work, the review rounds, the defects, the checks that verified it and when it was published. Each line names the record it comes from in brackets; a record that does not exist for this release says so.
This trail
As JSON- Image
readystack/virtctl:v1.9.1-CE-scratch-r1 - Index digestsha256:e6a803966e6883d92b85d30dbabe3228b1e772a114bff5d355abf034e0c9b1c3
- linux/amd64 digestsha256:634431da66d601627ffc0cddd0e41d02678ff5c1a2f6407661ae9f8a85091501
- Archive
ReadyStack-virtctl-v1.9.1-CE-scratch-r1.tar.gz - Archive SHA-256 nowea37097bd62ae5003de45240d115844707817d4ad0b4c973225a8ab7d4dfe292
- Generated2026-11-02T23:33:35Z by KitForge release/build_trail.py
- Sections9 sections, 4 fully recorded; 11 items not recorded
Signed with the release key The trail's signature is a Sigstore bundle beside it. Check it is ours before you rely on it:
cosign verify-blob --key https://readystack.dev/keys/cosign.pub \ --bundle ReadyStack-virtctl-v1.9.1-CE-scratch-r1.trail.json.sigstore ReadyStack-virtctl-v1.9.1-CE-scratch-r1.trail.json
IdentityWhy this release existsThe path through the harnessModel work per stageReviewDefectsVerificationPublicationPackages and CPU level
Identity
1 item not recorded- Productvirtctl (virtctl) [MANIFEST.json]
- Release tagv1.9.1-CE-scratch-r1 [MANIFEST.json]
- Imagereadystack/virtctl:v1.9.1-CE-scratch-r1 [MANIFEST.json]
- Image index digestsha256:e6a803966e6883d92b85d30dbabe3228b1e772a114bff5d355abf034e0c9b1c3 [docs/provenance/LOCKED_DIGEST.txt]
- linux/amd64 image digestsha256:634431da66d601627ffc0cddd0e41d02678ff5c1a2f6407661ae9f8a85091501 [ReadyStack-virtctl-v1.9.1-CE-scratch-r1.rebuild.json, subject.image_manifest_digest]
- ArchiveReadyStack-virtctl-v1.9.1-CE-scratch-r1.tar.gz (bytes 1149027126) [MANIFEST.json]
- Archive sha256 at publish590a617a2343da9260da3ca4a429d98560fec980a237e245e5b2c20c2522c271 [MANIFEST.json, repack_history[0].previous_tarball_sha256]
- Archive sha256 nowea37097bd62ae5003de45240d115844707817d4ad0b4c973225a8ab7d4dfe292 [MANIFEST.json, tarball_sha256]
- Archive records agreeyes [MANIFEST.json, PUBLISH_MANIFEST.json and .cutover.json name the same sha256]
- Repack history
- at 2026-10-29 · label stackdocs · reason documents brought up to the stack's current runbook record (2026-10-29T02:34:55Z run, re-recorded with the runbook corrections); documents only, not image inputs; image and every build input unchanged · previous sha256 590a617a2343da9260da3ca4a429d98560fec980a237e245e5b2c20c2522c271 · sha256 3cd583fdf818b0fb1a9116bcbaa6ee80e8f0b2825303521700ec472de8cec9ed · replaced docs/admin-guide/ADMIN_HANDBOOK.md, docs/db-handbook/DB_HANDBOOK.md, docs/db-handbook/DB_HANDBOOK.md.command-transcripts.json, docs/stack/RUNBOOK.md, docs/stack/RUNBOOK_EVIDENCE.json, rebuild.json
- at 2026-11-01 · label kitfix · reason customer kit files brought up to the current engine: BUILD_OFFLINE.sh (kit root, docs/offline, docs/docker); the header of BUILD_OFFLINE.sh no longer says a --provenance rebuild meets a SLSA build level, comment lines only; not image inputs; image and every build input unchanged · previous sha256 3cd583fdf818b0fb1a9116bcbaa6ee80e8f0b2825303521700ec472de8cec9ed · sha256 ea37097bd62ae5003de45240d115844707817d4ad0b4c973225a8ab7d4dfe292 · replaced BUILD_OFFLINE.sh, docs/docker/BUILD_OFFLINE.sh, docs/offline/BUILD_OFFLINE.sh, rebuild.json
- Upstream repositoryhttps://github.com/kubevirt/kubevirt [docs/provenance/SOURCE_TREE_HASH.json]
- Upstream refv1.9.1 [docs/provenance/SOURCE_TREE_HASH.json]
- Upstream commitc3d19093f9c7b843b3879b18dc088911c081c39e [docs/provenance/SOURCE_TREE_HASH.json]
- Source tree hashde7abf04e51b6cf004d0365dfe6d8c5251edeeb69bfa0caa3d8b366b85fe6f36 (files 12717) [docs/provenance/SOURCE_TREE_HASH.json, tree_listing_sha256 (sha256 of the sorted file listing)]
- Kit tree hashsha256:3809efb426b123b85a478fa9b0522b2ee107e5df7188880e8027ca789bc0732a [ReadyStack-virtctl-v1.9.1-CE-scratch-r1.rebuild.json, inputs.tree_hash]
- SOURCE_DATE_EPOCH1791523273 (utc 2026-10-09T05:21:13Z) [ReadyStack-virtctl-v1.9.1-CE-scratch-r1.rebuild.json, inputs.source_date_epoch]
- Base images
- ref quay.io/kubevirt/builder:2606231619-4fe2cd536f@sha256:a48a7dd5a1b80602269b8c714fdaa54f729a9a4a4d096f7ee0d15c94cef343e8 · platform digest sha256:a48a7dd5a1b80602269b8c714fdaa54f729a9a4a4d096f7ee0d15c94cef343e8
- BuildKitmoby/buildkit:v0.31.2 (image digest sha256:e0e67ea9c4bb07bdef683e29f70f3b623d1eb9c82274a9ec04e6bb0511449fb0) [ReadyStack-virtctl-v1.9.1-CE-scratch-r1.rebuild.json, engine]
- Not recorded: the engine commit(s) that built it (drive_runs records them for drives from 2026-11-02; this release's drives were rebuilt from line logs, which do not name it)
Why this release exists
Fully recorded- Chain791 (created 2026-10-29T07:15:46Z · trigger customer_request · upstream version v1.9.1) [chains, chains #791]
- Requestbuild request #466 (new_product) (requested at 2026-10-29T03:14:10Z · requested by agent · version v1.9.1) [build_requests, build_requests #466]
- ReasonKubernetes VM Stack Kits (DevOps 2026-10-28); owner 2026-10-28 "pause all other efforts. This build list is your top priority"; owner 2026-10-29: publish every component through the normal pipeline, listed only at A (virthandler/virtlauncher may be unlisted, grade disclosed); both bundles ship as images [build_requests, build_requests #466 request_reason]
The path through the harness
2 items not recorded1 chain · 5 drives · 18 stages · 3 rewinds
Chain 791 release · shipped
Created 2026-10-29T07:15:46Z, upstream v1.9.1, build request 466 [chains, chains #791]
| Drive | Started | Minutes | Build host | How it stopped |
|---|---|---|---|---|
| 1098 | 2026-10-29T07:15:58Z | 27 | build host 4 withhold-publish | infra_hub_rate_limit at package_archive [drive_runs, drive_runs #1098] rebuilt from a build line's log |
| 1099 | 2026-10-29T08:09:15Z | 10.9 | build host 4 withhold-publish | ready_to_ship [drive_runs, drive_runs #1099] rebuilt from a build line's log |
| 1105 | 2026-10-29T09:31:00Z | 6.5 | build host 4 publish-held | infra_hub_rate_limit at package_archive [drive_runs, drive_runs #1105] rebuilt from a build line's log |
| 1108 | 2026-10-29T10:17:27Z | 5.3 | build host 4 publish-held | stage_failed at package_archive [drive_runs, drive_runs #1108] rebuilt from a build line's log |
| 1111 | 2026-10-29T10:50:28Z | 8.8 | build host 4 publish-held | shipped [drive_runs, drive_runs #1111] rebuilt from a build line's log |
Stages, in order
| Stage | First start | Passed | Attempts | Gate checks passed | Artifacts (SHA-256) |
|---|---|---|---|---|---|
intake |
2026-10-29T07:16:04Z | 2026-10-29T07:16:05Z | 1 | 4
|
— |
acquire |
2026-10-29T07:16:13Z | 2026-10-29T07:16:14Z | 1 | 12
|
— |
plan |
2026-10-29T07:16:39Z | 2026-10-29T07:16:40Z | 1 | 10
|
— |
assemble_kit |
2026-10-29T07:24:12Z | 2026-10-29T07:24:13Z | 1 | 27
|
— |
remediate |
2026-10-29T07:24:57Z | 2026-10-29T07:24:58Z | 1 | 8
|
— |
build_kit |
2026-10-29T07:35:34Z | 2026-10-29T07:35:35Z | 1 | 9
|
— |
verdict |
2026-10-29T07:36:04Z | 2026-10-29T07:36:05Z | 1 | 8
|
— |
publish_image |
2026-10-29T07:36:55Z | 2026-10-29T07:36:56Z | 1 | 7
|
— |
boot_instance |
2026-10-29T07:36:58Z | 2026-10-29T07:36:58Z | 1 | 3
|
— |
sbom |
2026-10-29T07:37:06Z | 2026-10-29T07:37:07Z | 1 | 5
|
— |
schema_discovery |
2026-10-29T07:37:09Z | 2026-10-29T07:37:10Z | 1 | 7
|
— |
admin_handbook |
2026-10-29T07:37:11Z | 2026-10-29T07:37:12Z | 1 | 7
|
— |
db_handbook |
2026-10-29T07:37:14Z | 2026-10-29T07:37:15Z | 1 | 8
|
— |
seed_data |
2026-10-29T07:37:16Z | 2026-10-29T07:37:17Z | 1 | 6
|
— |
seed_validate |
2026-10-29T07:37:19Z | 2026-10-29T07:37:20Z | 1 | 3
|
— |
usecase_validate |
2026-10-29T07:37:22Z | 2026-10-29T07:37:23Z | 1 | 10
|
— |
finalize_docs |
2026-10-29T07:37:26Z | 2026-10-29T07:37:27Z | 1 | 9
|
— |
package_archive |
2026-10-29T08:20:08Z | 2026-10-29T10:59:16Z | 3 | 33 (final gate PASS)
|
— |
[stage_runs]
Rewinds
- 2026-10-29T09:30:27Z:
package_archivetopackage_archiveon docs_redo (scripts/redo-docs.py) [stage_events, stage_events #1303] - 2026-10-29T10:16:57Z:
package_archivetopackage_archiveon docs_redo (scripts/redo-docs.py) [stage_events, stage_events #1306] - 2026-10-29T10:49:58Z:
package_archivetopackage_archiveon docs_redo (scripts/redo-docs.py) [stage_events, stage_events #1311]
- Not recorded: each drive's ticks and first failed check (drive_runs records them for drives from 2026-11-02; these drives were rebuilt from line logs)
- Not recorded: the sha256 of each stage's artifacts (stage_events records them for stages passed from 2026-11-02; this chain's events were rebuilt from stage_runs and logs) — the archive's CHECKSUMS.sha256 lists the sha256 of every file it ships
Model work per stage
3 items not recordedRole: writer model. Calls up to 2026-10-29T10:59:16Z.
4 calls over 2 stages
| Stage | Calls | Refused | Errors | Max attempt | Forced commits | Real tokens | Lesson rules shown |
|---|---|---|---|---|---|---|---|
plan | 2 | 0 | 0 | 1 | not recorded | not recorded | — |
remediate | 2 | 0 | 0 | 1 | not recorded | not recorded | — |
[micro_step_runs]
- Not recorded: forced commits (micro_step_runs records them for calls from 2026-11-02)
- Not recorded: real token counts (recorded per call from 2026-11-02; earlier rows hold only an estimate, which is not shown)
- Not recorded: the lesson rules shown to the writer model (lesson_recalls holds no rows for this chain: its recorder was silent from 2026-06-06 to 2026-11-02)
Review
3 items not recordedRole: review model.
1 round, 1 counted, $0.95 recorded cost
| Round | Started | Critical | Major | Minor | Verdict | Cost | Cap in force | Archive reviewed |
|---|---|---|---|---|---|---|---|---|
| 1 | 2026-10-29T08:20:40Z | 0 | 0 | 2 | clean to publish [held_rounds, held_rounds #196] rebuilt from a held-review state file | $0.95 | not recorded | not recorded |
Overrides
max_rounds: — to 6; by not recorded; why: not recorded predates override recording (2026-11-02): found in runstate/held-auto/virtctl.json, last written 2026-10-29T08:44Z; who set it, why, when and the value before are not known [review_overrides, review_overrides #23]
- Not recorded: the sha256 of the archive each round reviewed (held_rounds records it for rounds from 2026-11-02; these rounds were rebuilt from state files)
- Not recorded: the round cap in force at each round (the state files did not keep it)
- Not recorded: who raised max_rounds to 6 and why (review_overrides #23 was backfilled from a state file; overrides are recorded with who and why from 2026-11-02)
Defects
Fully recorded- Ledger entries2 [defects, defects where product_slug=virtctl and this tag or chain]
- Disclosed in the archive2 [docs/defects/defects.json, entries]
2 ledger entries: by severity low 2; by status open 2.
| Defect | Severity | Status | Found by | Fixed in |
|---|---|---|---|---|
RSD-virtctl-c18bd06d33Docker Hub README: The sentence says the image runs only inside a cluster and that the admin guide shows how it is started there. [defects, defects #135072] | low | open | held review (review model) | — |
RSD-virtctl-00cc1cf699REBUILD.md: virtctl is not a cluster component and does not run only inside a cluster; the statement contradicts the admin handbook and the strategy's deployment_model. [defects, defects #135073] | low | open | held review (review model) | — |
Verification
2 items not recorded- Reproduced before publishingyes (rebuilt digest sha256:634431da66d601627ffc0cddd0e41d02678ff5c1a2f6407661ae9f8a85091501 · published digest sha256:634431da66d601627ffc0cddd0e41d02678ff5c1a2f6407661ae9f8a85091501 · digest match yes · builder moby/buildkit:v0.31.2 · build seconds 277) [docs/provenance/REPRO_VERIFICATION.json, verified]
- Final contract gate (G8)PASS (checks cosign, scan_grade, tag_base_os, vex_shipped, scout_grade_a, script_copies, three_way_sha, offline_rebuild, rebuild_manifest, artifact_coverage, assetchain_coverage) [stage_runs, stage_runs chain 791 package_archive gate_result.g8.result]
- Grade at releaseA (percent 100 · tool docker scout policy 1.26.0 · config docker-default · org vex no · at 2026-10-29T10:50:44Z) [SCOUT_EVIDENCE.json, docker_scout_policy]
- First own scan of the releaseA (at 2026-10-29T10:59:30Z · score 100 · rubric cerodeo-v1 · fixable critical 0 · fixable high 0 · syft 1.54.1 · grype 0.120.1 · grype db v6.1.10@2026-10-29T06:23:34Z) [image_scans, image_scans #1551]
- Image signatureverified on the index and the linux/amd64 manifest (key fingerprint 04daa92344a52dbc · at 2026-10-29T10:50:33Z) [docs/provenance/IMAGE_EVIDENCE.json, signed]
- Image signature transparency-log entries
- log index 3561552341 · transparency-log entry
- log index 3561556700 · transparency-log entry
- rebuild.json signatureSigstore bundle, release key (key fingerprint 04daa92344a52dbc · log index 3631633198 · transparency-log entry · integrated 2026-11-01T13:48:11Z) [ReadyStack-virtctl-v1.9.1-CE-scratch-r1.rebuild.json.sigstore, verificationMaterial.tlogEntries[0]]
- Signed attestations
- kind provenance · digest sha256:e6a803966e6883d92b85d30dbabe3228b1e772a114bff5d355abf034e0c9b1c3 · state attached · log index 3565480514 · transparency-log entry
- kind sbom · digest sha256:e6a803966e6883d92b85d30dbabe3228b1e772a114bff5d355abf034e0c9b1c3 · state attached · log index 3565483491 · transparency-log entry
- kind vsa · digest sha256:e6a803966e6883d92b85d30dbabe3228b1e772a114bff5d355abf034e0c9b1c3 · state attached · log index 3565488261 · transparency-log entry
- kind provenance · digest sha256:634431da66d601627ffc0cddd0e41d02678ff5c1a2f6407661ae9f8a85091501 · state attached · log index 3565491886 · transparency-log entry
- kind sbom · digest sha256:634431da66d601627ffc0cddd0e41d02678ff5c1a2f6407661ae9f8a85091501 · state attached · log index 3565497567 · transparency-log entry
- kind vsa · digest sha256:634431da66d601627ffc0cddd0e41d02678ff5c1a2f6407661ae9f8a85091501 · state attached · log index 3565504120 · transparency-log entry
Offline clean-room rebuilds
- 2026-10-29T08:20:44Z on build host 4 (Docker-in-Docker daemon with --network none): bit for bit yes, digest match yes, customer verify yes
rebuilt sha256:634431da66d601627ffc0cddd0e41d02678ff5c1a2f6407661ae9f8a85091501 [clean-room rebuild ledger, runs[543]]
- Not recorded: the policy tool's --result-file itself (its per-policy results are copied into SCOUT_EVIDENCE.json and the archive's IMAGE_EVIDENCE.json; the file is not kept)
- Not recorded: the pins record (docs/PINS.md is not in this archive as generated; a repack that adds it is appended to this trail's history)
Publication
Fully recorded- Image pushed (internal tag), publish_image passed2026-10-29T07:36:56Z [stage_runs, stage_runs chain 791 stage publish_image]
- Release tag promoted2026-10-29T10:58:46Z (method imagetools_create_retag_by_digest_no_rebuild · digest sha256:e6a803966e6883d92b85d30dbabe3228b1e772a114bff5d355abf034e0c9b1c3 · tag readystack/virtctl:v1.9.1-CE-scratch-r1) [deliverables/provenance/PROMOTION_RECORD.json, promoted_at]
- Archive manifests written2026-10-29T10:54:16Z [PUBLISH_MANIFEST.json, published_at]
- Archive cut over on prodasset, package_archive passed2026-10-29T10:59:16Z [stage_runs, stage_runs chain 791 stage package_archive]
- Cut-over markerpresent (chain 791) [.cutover.json]
- Release checklist and site event2026-10-29T10:59:14Z (status complete · site event 275 · steps grade a verified done · release tag promoted done · cosign signed done · release evidence recorded done · contract gate passed done · archive published done · hub readme live done · reproducibility recorded done · defects ledger published done · catalog available done · build request fulfilled done · seo regenerated skipped · site catalogue refreshed done · site grade recorded done · site queue synced done · customer requests charged done · owners notified done) [deliverables/provenance/RELEASE_CHECKLIST.json, run_at]
Packages and CPU level
Fully recorded- Packages in the image92 (scanned 2026-11-02T06:30:04Z · source backfill:daily-scan) [release_images, package_count]
- x86-64 level the image needsv1 (used v4 · baseline v2 · elf files 1 · probed 2026-11-02T17:14:24Z · source backfill) [release_images, isa_level_hard]
History
1 event- 2026-11-02T23:33:35Z generated: by KitForge release/build_trail.py · generator commit 916780cc218cf013bd623a8c085aaf73d3b053d0 · note backfill: built after the release from its records
Records
26 records| Record | Where it is | Rows |
|---|---|---|
docs/defects/defects.json | inside the archive (ReadyStack-virtctl-v1.9.1-CE-scratch-r1.tar.gz) | — |
docs/provenance/IMAGE_EVIDENCE.json | inside the archive (ReadyStack-virtctl-v1.9.1-CE-scratch-r1.tar.gz) | — |
docs/provenance/LOCKED_DIGEST.txt | inside the archive (ReadyStack-virtctl-v1.9.1-CE-scratch-r1.tar.gz) | — |
docs/provenance/REPRO_VERIFICATION.json | inside the archive (ReadyStack-virtctl-v1.9.1-CE-scratch-r1.tar.gz) | — |
docs/provenance/SOURCE_TREE_HASH.json | inside the archive (ReadyStack-virtctl-v1.9.1-CE-scratch-r1.tar.gz) | — |
.cutover.json | beside the archive (prodasset /data/production/virtctl/v1.9.1-CE-scratch-r1/) | — |
MANIFEST.json | beside the archive (prodasset /data/production/virtctl/v1.9.1-CE-scratch-r1/) | — |
PUBLISH_MANIFEST.json | beside the archive (prodasset /data/production/virtctl/v1.9.1-CE-scratch-r1/) | — |
ReadyStack-virtctl-v1.9.1-CE-scratch-r1.rebuild.json | beside the archive (prodasset /data/production/virtctl/v1.9.1-CE-scratch-r1/) | — |
ReadyStack-virtctl-v1.9.1-CE-scratch-r1.rebuild.json.sigstore | beside the archive (prodasset /data/production/virtctl/v1.9.1-CE-scratch-r1/) | — |
SCOUT_EVIDENCE.json | beside the archive (prodasset /data/production/virtctl/v1.9.1-CE-scratch-r1/) | — |
clean-room rebuild ledger | the clean-room rebuild ledger (runstate/audit-2026-09/bit4bit.json, not published) | — |
build_requests | sadb, ReadyStack's engine database (not published) | 466 |
chains | sadb, ReadyStack's engine database (not published) | 791 |
defects | sadb, ReadyStack's engine database (not published) | virtctl v1.9.1-CE-scratch-r1 |
drive_runs | sadb, ReadyStack's engine database (not published) | chain 791 |
held_rounds | sadb, ReadyStack's engine database (not published) | chain 791 |
image_scans | sadb, ReadyStack's engine database (not published) | 1551 |
micro_step_runs | sadb, ReadyStack's engine database (not published) | chain 791 |
release_images | sadb, ReadyStack's engine database (not published) | virtctl v1.9.1-CE-scratch-r1 |
review_overrides | sadb, ReadyStack's engine database (not published) | 23 |
stage_events | sadb, ReadyStack's engine database (not published) | chain 791 |
stage_runs | sadb, ReadyStack's engine database (not published) | chain 791 |
attestations.json | the chain's workspace on the controller (not published) | — |
deliverables/provenance/PROMOTION_RECORD.json | the chain's workspace on the controller (not published) | — |
deliverables/provenance/RELEASE_CHECKLIST.json | the chain's workspace on the controller (not published) | — |