OpenSearch 3.9.0-CE-ubuntu24.04-r5 build trail
How ReadyStack built readystack/opensearch:3.9.0-CE-ubuntu24.04-r5 and its build kit, copied record by record: why the release exists, every chain, drive and stage it went through, the model work, the review rounds, the defects, the checks that verified it and when it was published. Each line names the record it comes from in brackets; a record that does not exist for this release says so.
This trail
As JSON- Image
readystack/opensearch:3.9.0-CE-ubuntu24.04-r5 - Index digestsha256:962652a66b19922329944964be045c4a6933bc877ea3000bff6e97634371c764
- linux/amd64 digestsha256:8844b52424f2d447c860a350d272c688cc071e215ea28bf1bf2e9e12c4f9a75f
- Archive
ReadyStack-opensearch-3.9.0-CE-ubuntu24.04-r5.tar.gz - Archive SHA-256 now80a6be152ced2e5599546d34c6ed20a1ae31707d2948472367da225a42fc4ec9
- Pins record
docs/PINS.md,docs/provenance/PINS.jsonin the archive (since generated) - Generated2026-11-10T08:36:15Z by KitForge release/build_trail.py
- Sections9 sections, 8 fully recorded; 1 item not recorded
Signed with the release key The trail's signature is a Sigstore bundle beside it. Check it is ours before you rely on it:
cosign verify-blob --key https://readystack.dev/keys/cosign.pub \ --bundle ReadyStack-opensearch-3.9.0-CE-ubuntu24.04-r5.trail.json.sigstore ReadyStack-opensearch-3.9.0-CE-ubuntu24.04-r5.trail.json
IdentityWhy this release existsThe path through the harnessModel work per stageReviewDefectsVerificationPublicationPackages and CPU level
Identity
Fully recorded- ProductOpenSearch (opensearch) [MANIFEST.json]
- Release tag3.9.0-CE-ubuntu24.04-r5 [MANIFEST.json]
- Imagereadystack/opensearch:3.9.0-CE-ubuntu24.04-r5 [MANIFEST.json]
- Image index digestsha256:962652a66b19922329944964be045c4a6933bc877ea3000bff6e97634371c764 [docs/provenance/LOCKED_DIGEST.txt]
- linux/amd64 image digestsha256:8844b52424f2d447c860a350d272c688cc071e215ea28bf1bf2e9e12c4f9a75f [ReadyStack-opensearch-3.9.0-CE-ubuntu24.04-r5.rebuild.json, subject.image_manifest_digest]
- ArchiveReadyStack-opensearch-3.9.0-CE-ubuntu24.04-r5.tar.gz (bytes 1154315746) [MANIFEST.json]
- Archive sha256 at publish80a6be152ced2e5599546d34c6ed20a1ae31707d2948472367da225a42fc4ec9 [MANIFEST.json, tarball_sha256]
- Archive records agreeyes [MANIFEST.json, PUBLISH_MANIFEST.json and .cutover.json name the same sha256]
- Repack historynone: the archive is as first published [MANIFEST.json, repack_history]
- Upstream repositoryhttps://github.com/opensearch-project/OpenSearch [docs/provenance/SOURCE_TREE_HASH.json]
- Upstream ref3.9.0 [docs/provenance/SOURCE_TREE_HASH.json]
- Upstream commit4ee42a94e87f66fbf1e62a9871b1b87f91e02472 [docs/provenance/SOURCE_TREE_HASH.json]
- Source tree hash2ae217a7cfe15e67871dcb85116f6032694851802f619e60e9921326333b0902 (files 19243) [docs/provenance/SOURCE_TREE_HASH.json, tree_listing_sha256 (sha256 of the sorted file listing)]
- Kit tree hashsha256:98643e608fe37df2a90ed2689a8478cb5287eb860bbef1514ebd1e7d8a1d19ca [ReadyStack-opensearch-3.9.0-CE-ubuntu24.04-r5.rebuild.json, inputs.tree_hash]
- SOURCE_DATE_EPOCH1794290164 (utc 2026-11-10T05:56:04Z) [ReadyStack-opensearch-3.9.0-CE-ubuntu24.04-r5.rebuild.json, inputs.source_date_epoch]
- Base images
- ref ubuntu:24.04@sha256:fe81560990fae86dc4743202b2cb4d3df98d0bcf949173cecef15ce1127ef852 · platform digest sha256:78d4744ead1f5b19b04d0df558ab182a5300903900755e515b2ca4d10eb2044d
- BuildKitmoby/buildkit:v0.31.2 (image digest sha256:e0e67ea9c4bb07bdef683e29f70f3b623d1eb9c82274a9ec04e6bb0511449fb0) [ReadyStack-opensearch-3.9.0-CE-ubuntu24.04-r5.rebuild.json, engine]
- Engine commit(s)
- commit 6fed961ca4c69b080b8235683aad09bec590f2c6 · dirty yes · first drive 4158
- commit 8f330f31aa066ed1381d543d473df5415ecba80a · dirty yes · first drive 4165
Why this release exists
Fully recorded- Chain950 (created 2026-11-10T07:04:23Z · trigger customer_request · upstream version 3.9.0) [chains, chains #950]
- Requestbuild request #630 (rebuild) (requested at 2026-11-10T06:02:21Z · requested by kitforge-agent · version 3.9.0) [build_requests, build_requests #630]
- Reasonrevision 3.9.0-CE-ubuntu24.04-r5: same upstream version re-dated by its own release (owner 2026-11-10 "date images correctly") [build_requests, build_requests #630 request_reason]
- Supersedesreadystack/opensearch:3.9.0-CE-ubuntu24.04-r4 (chain 907) [chains, chains #907]
The path through the harness
Fully recorded1 chain · 2 drives · 18 stages · 1 rewind
Chain 950 release · ready_to_ship
Created 2026-11-10T07:04:23Z, upstream 3.9.0, build request 630 [chains, chains #950]
| Drive | Started | Minutes | Build host | How it stopped |
|---|---|---|---|---|
| 4158 | 2026-11-10T07:04:55Z | 60 | build host 5 withhold-publish | ready_to_ship at package_archive; 19 ticks [drive_runs, drive_runs #4158] |
| 4165 | 2026-11-10T08:19:40Z | — | build host 5 publish-held | not recorded [drive_runs, drive_runs #4165] |
Stages, in order
| Stage | First start | Passed | Attempts | Gate checks passed | Artifacts (SHA-256) |
|---|---|---|---|---|---|
intake |
2026-11-10T07:05:06Z | 2026-11-10T07:05:07Z | 1 | 4
|
order_json 4ffe224aef5b… |
acquire |
2026-11-10T07:05:20Z | 2026-11-10T07:05:22Z | 1 | 12
|
source_tree 3c1cb97d3c4b…license_file c71d239df917…custody_inputs 03a7007d1349…source_tree_hash 979bf36d89aa…source_file_manifest 9fa22841de5a… |
plan |
2026-11-10T07:05:45Z | 2026-11-10T07:05:46Z | 1 | 10
|
recon_report 1d01f60919e5…input_pin_plan f2a73ee4134d…toolchain_lock ee26b9f75a34… |
assemble_kit |
2026-11-10T07:15:35Z | 2026-11-10T07:15:35Z | 1 | 27
|
dockerfile f9a446a8c58d…build_recipe c67a0bb41f4a…system_pinning f516a236c6e3…build_offline_sh 6633aa31b6b4…generate_sbom_sh ce0f1e6f1e70…first_boot_health c484c0636464…verify_offline_sh 3e8184ea230c…base_image_digests 79ac4273d7fe…dockerfile_offline d2ae17057ff4…first_build_digest b1eeea8a1a51… |
remediate |
2026-11-10T07:15:58Z | 2026-11-10T07:15:59Z | 1 | 8
|
vendored_apt e3b0c44298fc…remediation_log abcb6daadbc3…security_report 71463a576c8d… |
build_kit |
2026-11-10T07:29:54Z | 2026-11-10T07:29:55Z | 1 | 9
|
cosign_stamp 7f04bdee1268…locked_digest 15605a0b1d86…freeze_manifest 774f22647ef2…offline_rebuild_transcript d57e9ab1150a… |
verdict |
2026-11-10T07:36:41Z | 2026-11-10T07:36:42Z | 1 | 8
|
scout_verdict 195f7213c945… |
publish_image |
2026-11-10T07:39:20Z | 2026-11-10T07:39:20Z | 1 | 7
|
hub_readme 4a65cb8b176f…promotion_record 5ec64174c491… |
boot_instance |
2026-11-10T07:40:02Z | 2026-11-10T07:40:06Z | 2 | 3
|
instance_handle 77e3d93f4166… |
sbom |
2026-11-10T07:42:04Z | 2026-11-10T07:42:04Z | 1 | 5
|
sbom_md 3bdda40d81d0…sbom_json 514875306ef6… |
schema_discovery |
2026-11-10T07:42:07Z | 2026-11-10T07:42:08Z | 1 | 7
|
schema_hash 31cadb103c72…dependency_tree b7845dcbda08…table_classification 7c88836984f9… |
admin_handbook |
2026-11-10T07:42:19Z | 2026-11-10T07:42:20Z | 1 | 7
|
api_map c0c143c6c12d…admin_handbook 22e7248a4406… |
db_handbook |
2026-11-10T07:42:32Z | 2026-11-10T07:42:33Z | 1 | 8
|
db_handbook 82f33c6d9930…seed_isolation 65084d083961… |
seed_data |
2026-11-10T07:42:41Z | 2026-11-10T07:42:41Z | 1 | 6
|
seed_data_sql 9f648e8e5404…seed_cases_json ee876c9fa600… |
seed_validate |
2026-11-10T07:42:44Z | 2026-11-10T07:42:45Z | 1 | 3
|
seed_data_contract a12aed668912… |
usecase_validate |
2026-11-10T07:43:20Z | 2026-11-10T07:43:21Z | 1 | 10
|
failed_tests b2247b16f5f7…passed_tests 9098855fec8e…test_results 4d287f8358b6…usecase_contract 81f97b5ad778… |
finalize_docs |
2026-11-10T07:43:26Z | 2026-11-10T07:43:27Z | 1 | 9
|
defects_json 986d7d21ffaa…release_notes 06ec970debc6…api_integration_guide 2088caaaebc7… |
package_archive invalidated 2026-11-10T08:19:11Z |
2026-11-10T08:04:51Z | 2026-11-10T08:04:55Z | 1 | 35 (final gate PASS)
|
sale_tar 7ebfceb40392…checksums 4fdc0d0c3d90…verify_md 5ab1d6089a68…rebuild_md 0aa33c741bc7…manifest_txt 716ee0ccd9b5…actions_jsonl 5e5932b35edc…provenance_md b9e945539189…assetchain_log_md e9eccaec0c0f…assetchain_log_json 8bc2dd0c0d5c… |
[stage_runs]
Rewinds
- 2026-11-10T08:19:11Z:
package_archivetopackage_archiveon docs_redo (scripts/redo-docs.py --stage package_archive) [stage_events, stage_events #30406]
Model work per stage
Fully recordedRole: writer model. Calls up to 2026-11-10T08:04:55Z.
15 calls over 4 stages
| Stage | Calls | Refused | Errors | Max attempt | Forced commits | Real tokens | Lesson rules shown |
|---|---|---|---|---|---|---|---|
plan | 2 | 0 | 0 | 1 | 0 | 5304 | L-A183, L-A15 |
remediate | 2 | 0 | 0 | 1 | 0 | 5554 | L-A183, L-A15 |
usecase_validate | 1 | 0 | 0 | 1 | 0 | 2357 | L-A59 |
finalize_docs | 10 | 0 | 0 | 1 | 0 | 58198 | L-A180, L-A181, L-A182, L-A183, L-A184, L-A155, L-A114, L-A25, L-A15 |
[micro_step_runs] [lesson_recalls]
Review
Fully recordedRole: review model.
1 round, 1 counted, $0.24 recorded cost
| Round | Started | Critical | Major | Minor | Verdict | Cost | Cap in force | Archive reviewed |
|---|---|---|---|---|---|---|---|---|
| 1 | 2026-11-10T08:06:47Z | 0 | 0 | 0 | clean to publish [held_rounds, held_rounds #1691] | $0.24 | 3 rounds, $40.00 | 7ebfceb40392… |
Defects
Fully recorded- Ledger entries5 [defects, defects where product_slug=opensearch and this tag or chain]
- Disclosed in the archive5 [docs/defects/defects.json, entries]
5 ledger entries: by severity low 5; by status open 5.
| Defect | Severity | Status | Found by | Fixed in |
|---|---|---|---|---|
RSD-opensearch-00eb0da657Admin handbook: Environment-variable list presented as complete omits LD_LIBRARY_PATH, new in r4 (needed by the k-NN faiss engine). [defects, defects #229706] | low | open | held review (review model) | — |
RSD-opensearch-7d2f394444Admin handbook: Environment-variable list presented as complete omits LD_LIBRARY_PATH, new in r4 (needed by the k-NN faiss engine). [defects, defects #229707] | low | open | held review (review model) | — |
RSD-opensearch-73b228f779Database handbook: Environment-variable list presented as complete omits LD_LIBRARY_PATH, new in r4 (needed by the k-NN faiss engine). [defects, defects #229708] | low | open | held review (review model) | — |
RSD-opensearch-3d8d89dfacDatabase handbook: Environment-variable list presented as complete omits LD_LIBRARY_PATH, new in r4 (needed by the k-NN faiss engine). [defects, defects #229709] | low | open | held review (review model) | — |
RSD-opensearch-5014ffb686Admin handbook: Environment-variable list presented as complete omits LD_LIBRARY_PATH, new in r4 (needed by the k-NN faiss engine). [defects, defects #229710] | low | open | held review (review model) | — |
Verification
1 item not recorded- Reproduced before publishingyes (rebuilt digest sha256:8844b52424f2d447c860a350d272c688cc071e215ea28bf1bf2e9e12c4f9a75f · published digest sha256:8844b52424f2d447c860a350d272c688cc071e215ea28bf1bf2e9e12c4f9a75f · digest match yes · builder moby/buildkit:v0.31.2 · build seconds 337) [docs/provenance/REPRO_VERIFICATION.json, verified]
- Final contract gate (G8)PASS (checks artifact_coverage, assetchain_coverage, cosign, cpu_baseline, offline_rebuild, rebuild_manifest, scan_grade, scout_grade_a, script_copies, tag_base_os, thread_exit, trademark_shipped, vex_shipped) [g8_result.json, result]
- Grade at releaseA (percent 94 · tool docker scout policy 1.26.0 · config docker-default · org vex no · at 2026-11-10T08:21:08Z · failing Docker Scout counts 104 packages with copyleft licences (GPL, LGPL, MPL), all of them operating-system packages (it counts only packages whose licence it can read; the SBOM lists every component).) [SCOUT_EVIDENCE.json, docker_scout_policy]
- Image signatureverified on the index and the linux/amd64 manifest (key fingerprint 04daa92344a52dbc · at 2026-11-10T08:19:51Z) [docs/provenance/IMAGE_EVIDENCE.json, signed]
- Image signature transparency-log entries
- log index 3781169069 · transparency-log entry
- log index 3781171582 · transparency-log entry
- rebuild.json signatureSigstore bundle, release key (key fingerprint 04daa92344a52dbc · log index 3782172060 · transparency-log entry · integrated 2026-11-10T08:34:34Z) [ReadyStack-opensearch-3.9.0-CE-ubuntu24.04-r5.rebuild.json.sigstore, verificationMaterial.tlogEntries[0]]
- Signed attestations
- kind provenance · digest sha256:962652a66b19922329944964be045c4a6933bc877ea3000bff6e97634371c764 · state attached · log index 3782173939 · transparency-log entry
- kind sbom · digest sha256:962652a66b19922329944964be045c4a6933bc877ea3000bff6e97634371c764 · state attached · log index 3782174583 · transparency-log entry
- kind vsa · digest sha256:962652a66b19922329944964be045c4a6933bc877ea3000bff6e97634371c764 · state attached · log index 3782175601 · transparency-log entry
- kind provenance · digest sha256:8844b52424f2d447c860a350d272c688cc071e215ea28bf1bf2e9e12c4f9a75f · state attached · log index 3782176538 · transparency-log entry
- kind sbom · digest sha256:8844b52424f2d447c860a350d272c688cc071e215ea28bf1bf2e9e12c4f9a75f · state attached · log index 3782177861 · transparency-log entry
- kind vsa · digest sha256:8844b52424f2d447c860a350d272c688cc071e215ea28bf1bf2e9e12c4f9a75f · state attached · log index 3782179065 · transparency-log entry
- Pins recorddocs/PINS.md and docs/provenance/PINS.json in the archive (https://readystack.dev/products/opensearch/recipe) [docs/provenance/PINS.json]
Offline clean-room rebuilds
- 2026-11-10T08:06:54Z on build host 5 (Docker-in-Docker daemon with --network none): bit for bit yes, digest match yes, customer verify yes
rebuilt sha256:8844b52424f2d447c860a350d272c688cc071e215ea28bf1bf2e9e12c4f9a75f [clean-room rebuild ledger, runs[723]]
- Not recorded: the policy tool's --result-file itself (its per-policy results are copied into SCOUT_EVIDENCE.json and the archive's IMAGE_EVIDENCE.json; the file is not kept)
Publication
Fully recorded 1 pending at generation- Image pushed (internal tag), publish_image passed2026-11-10T07:39:20Z [stage_runs, stage_runs chain 950 stage publish_image]
- Archive manifests written2026-11-10T08:26:24Z [PUBLISH_MANIFEST.json, published_at]
- Pending at generation: the archive cut-over on prodasset, the release tag's promotion and the site event (this trail was generated after G8 and before them; they are appended as a 'publication' event in History)
Packages and CPU level
Fully recorded- x86-64 level the image needsv1 (used v4 · baseline v2 · elf files 815 · probed 2026-11-10T07:23:57Z · source build_kit) [release_images, isa_level_hard]
History
2 events- 2026-11-10T08:36:15Z generated: by KitForge release/build_trail.py · generator commit 8f330f31aa066ed1381d543d473df5415ecba80a
- 2026-11-10T08:40:04Z publication: promoted at 2026-11-10T08:37:00Z · promoted digest sha256:962652a66b19922329944964be045c4a6933bc877ea3000bff6e97634371c764 · promotion method imagetools_create_retag_by_digest_no_rebuild · site event 446 · checklist status complete · checklist at 2026-11-10T08:40:04Z · record workspace: deliverables/provenance/PROMOTION_RECORD.json, RELEASE_CHECKLIST.json
Records
25 records| Record | Where it is | Rows |
|---|---|---|
docs/defects/defects.json | inside the archive (ReadyStack-opensearch-3.9.0-CE-ubuntu24.04-r5.tar.gz) | — |
docs/provenance/IMAGE_EVIDENCE.json | inside the archive (ReadyStack-opensearch-3.9.0-CE-ubuntu24.04-r5.tar.gz) | — |
docs/provenance/LOCKED_DIGEST.txt | inside the archive (ReadyStack-opensearch-3.9.0-CE-ubuntu24.04-r5.tar.gz) | — |
docs/provenance/PINS.json | inside the archive (ReadyStack-opensearch-3.9.0-CE-ubuntu24.04-r5.tar.gz) | — |
docs/provenance/REPRO_VERIFICATION.json | inside the archive (ReadyStack-opensearch-3.9.0-CE-ubuntu24.04-r5.tar.gz) | — |
docs/provenance/SOURCE_TREE_HASH.json | inside the archive (ReadyStack-opensearch-3.9.0-CE-ubuntu24.04-r5.tar.gz) | — |
MANIFEST.json | beside the archive (prodasset /data/production/opensearch/3.9.0-CE-ubuntu24.04-r5/), as staged for publishing | — |
PUBLISH_MANIFEST.json | beside the archive (prodasset /data/production/opensearch/3.9.0-CE-ubuntu24.04-r5/), as staged for publishing | — |
ReadyStack-opensearch-3.9.0-CE-ubuntu24.04-r5.rebuild.json | beside the archive (prodasset /data/production/opensearch/3.9.0-CE-ubuntu24.04-r5/), as staged for publishing | — |
ReadyStack-opensearch-3.9.0-CE-ubuntu24.04-r5.rebuild.json.sigstore | beside the archive (prodasset /data/production/opensearch/3.9.0-CE-ubuntu24.04-r5/), as staged for publishing | — |
SCOUT_EVIDENCE.json | beside the archive (prodasset /data/production/opensearch/3.9.0-CE-ubuntu24.04-r5/), as staged for publishing | — |
clean-room rebuild ledger | the clean-room rebuild ledger (runstate/audit-2026-09/bit4bit.json, not published) | — |
build_requests | sadb, ReadyStack's engine database (not published) | 630 |
chains | sadb, ReadyStack's engine database (not published) | 950 |
defects | sadb, ReadyStack's engine database (not published) | opensearch 3.9.0-CE-ubuntu24.04-r5 |
drive_runs | sadb, ReadyStack's engine database (not published) | chain 950 |
held_rounds | sadb, ReadyStack's engine database (not published) | chain 950 |
lesson_recalls | sadb, ReadyStack's engine database (not published) | chain 950 |
micro_step_runs | sadb, ReadyStack's engine database (not published) | chain 950 |
release_images | sadb, ReadyStack's engine database (not published) | opensearch 3.9.0-CE-ubuntu24.04-r5 |
stage_events | sadb, ReadyStack's engine database (not published) | chain 950 |
stage_runs | sadb, ReadyStack's engine database (not published) | chain 950 |
attestations.json | the chain's workspace on the controller (not published) | — |
deliverables/provenance/PROMOTION_RECORD.json | the chain's workspace on the controller (not published) | — |
g8_result.json | the chain's workspace on the controller (not published) | — |