OpenSearch 3.9.0-CE-ubuntu24.04-r6 build trail
How ReadyStack built readystack/opensearch:3.9.0-CE-ubuntu24.04-r6 and its build kit, copied record by record: why the release exists, every chain, drive and stage it went through, the model work, the review rounds, the defects, the checks that verified it and when it was published. Each line names the record it comes from in brackets; a record that does not exist for this release says so.
This trail
As JSON- Image
readystack/opensearch:3.9.0-CE-ubuntu24.04-r6 - Index digestsha256:d6c4be09922155bf2c3ce3af345d2dc3ee3474ffea047c2b9a6a1620e3e0e14b
- linux/amd64 digestsha256:687be85440a39fb230685387295a5d3735424681d0d6349bcf4aaa64c587e47e
- Archive
ReadyStack-opensearch-3.9.0-CE-ubuntu24.04-r6.tar.gz - Archive SHA-256 now78419fa743a3d9c289651c8acf05e772e4c2084084a630cdab93a57cee278a57
- Pins record
docs/PINS.md,docs/provenance/PINS.jsonin the archive (since generated) - Generated2026-11-13T13:35:44Z by KitForge release/build_trail.py
- Sections9 sections, 8 fully recorded; 1 item not recorded
Signed with the release key The trail's signature is a Sigstore bundle beside it. Check it is ours before you rely on it:
cosign verify-blob --key https://readystack.dev/keys/cosign.pub \ --bundle ReadyStack-opensearch-3.9.0-CE-ubuntu24.04-r6.trail.json.sigstore ReadyStack-opensearch-3.9.0-CE-ubuntu24.04-r6.trail.json
IdentityWhy this release existsThe path through the harnessModel work per stageReviewDefectsVerificationPublicationPackages and CPU level
Identity
Fully recorded- ProductOpenSearch (opensearch) [MANIFEST.json]
- Release tag3.9.0-CE-ubuntu24.04-r6 [MANIFEST.json]
- Imagereadystack/opensearch:3.9.0-CE-ubuntu24.04-r6 [MANIFEST.json]
- Image index digestsha256:d6c4be09922155bf2c3ce3af345d2dc3ee3474ffea047c2b9a6a1620e3e0e14b [docs/provenance/LOCKED_DIGEST.txt]
- linux/amd64 image digestsha256:687be85440a39fb230685387295a5d3735424681d0d6349bcf4aaa64c587e47e [ReadyStack-opensearch-3.9.0-CE-ubuntu24.04-r6.rebuild.json, subject.image_manifest_digest]
- ArchiveReadyStack-opensearch-3.9.0-CE-ubuntu24.04-r6.tar.gz (bytes 1155855539) [MANIFEST.json]
- Archive sha256 at publish78419fa743a3d9c289651c8acf05e772e4c2084084a630cdab93a57cee278a57 [MANIFEST.json, tarball_sha256]
- Archive records agreeyes [MANIFEST.json, PUBLISH_MANIFEST.json and .cutover.json name the same sha256]
- Repack historynone: the archive is as first published [MANIFEST.json, repack_history]
- Upstream repositoryhttps://github.com/opensearch-project/OpenSearch [docs/provenance/SOURCE_TREE_HASH.json]
- Upstream ref3.9.0 [docs/provenance/SOURCE_TREE_HASH.json]
- Upstream commit4ee42a94e87f66fbf1e62a9871b1b87f91e02472 [docs/provenance/SOURCE_TREE_HASH.json]
- Source tree hash2ae217a7cfe15e67871dcb85116f6032694851802f619e60e9921326333b0902 (files 19243) [docs/provenance/SOURCE_TREE_HASH.json, tree_listing_sha256 (sha256 of the sorted file listing)]
- Kit tree hashsha256:a2d24ec9438a0652eafb401728d4ae78259738ac88e81c70df5e0c8477ba5047 [ReadyStack-opensearch-3.9.0-CE-ubuntu24.04-r6.rebuild.json, inputs.tree_hash]
- SOURCE_DATE_EPOCH1794448271 (utc 2026-11-12T01:51:11Z) [ReadyStack-opensearch-3.9.0-CE-ubuntu24.04-r6.rebuild.json, inputs.source_date_epoch]
- Base images
- ref ubuntu:24.04@sha256:2198e4c65076e9cb0b3d695219df667c0e3b0072da64ca3c2648aca17dcecaf5 · platform digest sha256:77eb101c607d6e3d4f5ad0c8a02c2136c689b98aba1f359e6502ba517e5c57ec
- BuildKitmoby/buildkit:v0.31.2 (image digest sha256:e0e67ea9c4bb07bdef683e29f70f3b623d1eb9c82274a9ec04e6bb0511449fb0) [ReadyStack-opensearch-3.9.0-CE-ubuntu24.04-r6.rebuild.json, engine]
- Engine commit(s)
- commit 96f3323140891ba62fe76c4b7c36875344807578 · dirty yes · first drive 4540
- commit 53328f4754ecefc18b308504e3b02f89c9062497 · dirty yes · first drive 4558
- commit 1762e17ee8e9761d80444e254bf92fa18d39ea4a · dirty yes · first drive 4579
Why this release exists
Fully recorded- Chain1062 (created 2026-11-13T04:14:12Z · trigger customer_request · upstream version 3.9.0) [chains, chains #1062]
- Requestbuild request #710 (rebuild) (requested at 2026-11-12T01:51:12Z · requested by kitforge-agent · version 3.9.0) [build_requests, build_requests #710]
- Reasonrevision 3.9.0-CE-ubuntu24.04-r6: same upstream version rebuilt (retarget.py --rev-bump) [build_requests, build_requests #710 request_reason]
- Supersedesreadystack/opensearch:3.9.0-CE-ubuntu24.04-r5 (chain 950) [chains, chains #950]
The path through the harness
Fully recorded1 chain · 3 drives · 18 stages · 1 rewind
Chain 1062 release · ready_to_ship
Created 2026-11-13T04:14:12Z, upstream 3.9.0, build request 710 [chains, chains #1062]
| Drive | Started | Minutes | Build host | How it stopped |
|---|---|---|---|---|
| 4540 | 2026-11-13T04:14:46Z | 35.4 | build host 5 withhold-publish | stage_failed at usecase_validate; first failed check test_results:usecase_thresholds:80,70; 16 ticks [drive_runs, drive_runs #4540] |
| 4558 | 2026-11-13T10:42:19Z | 27.2 | build host 5 withhold-publish | ready_to_ship at package_archive; 4 ticks [drive_runs, drive_runs #4558] |
| 4579 | 2026-11-13T13:19:19Z | — | build host 5 publish-held | not recorded [drive_runs, drive_runs #4579] |
Stages, in order
| Stage | First start | Passed | Attempts | Gate checks passed | Artifacts (SHA-256) |
|---|---|---|---|---|---|
intake |
2026-11-13T04:14:58Z | 2026-11-13T04:14:59Z | 1 | 4
|
order_json 04a3130097a3… |
acquire |
2026-11-13T04:15:14Z | 2026-11-13T04:15:16Z | 1 | 12
|
source_tree 3c1cb97d3c4b…license_file c71d239df917…custody_inputs 03a7007d1349…source_tree_hash 979bf36d89aa…source_file_manifest 9fa22841de5a… |
plan |
2026-11-13T04:15:39Z | 2026-11-13T04:15:40Z | 1 | 10
|
recon_report d87669d80276…input_pin_plan 2392bc510fdf…toolchain_lock c078b1724478… |
assemble_kit |
2026-11-13T04:23:12Z | 2026-11-13T04:23:13Z | 1 | 27
|
dockerfile d8c7bf7ea1c4…build_recipe f1c4ca36e742…system_pinning f516a236c6e3…build_offline_sh 6ab4f08a6ec7…generate_sbom_sh ce0f1e6f1e70…first_boot_health c72563db932d…verify_offline_sh 3e8184ea230c…base_image_digests 79ac4273d7fe…dockerfile_offline 0ce9332479a7…first_build_digest 43dffbda6ec6… |
remediate |
2026-11-13T04:23:35Z | 2026-11-13T04:23:36Z | 1 | 8
|
vendored_apt e3b0c44298fc…remediation_log 584db6d3d561…security_report 83afb54ad795… |
build_kit |
2026-11-13T04:37:42Z | 2026-11-13T04:37:43Z | 1 | 9
|
cosign_stamp 33528fa58977…locked_digest 899b33bba47c…freeze_manifest 9cae9d6a8245…offline_rebuild_transcript e0076bb809ef… |
verdict |
2026-11-13T04:44:08Z | 2026-11-13T04:44:09Z | 1 | 8
|
scout_verdict 08bdb3202dab… |
publish_image |
2026-11-13T04:46:43Z | 2026-11-13T04:46:44Z | 1 | 7
|
hub_readme 3a9e36cb9634…promotion_record 8f67262e7962… |
boot_instance |
2026-11-13T04:47:26Z | 2026-11-13T10:44:12Z | 3 | — | instance_handle d58f2ccae31e… |
sbom |
2026-11-13T04:49:16Z | 2026-11-13T04:49:17Z | 1 | 5
|
sbom_md ae46b32c438c…sbom_json c0a6167b772a… |
schema_discovery |
2026-11-13T04:49:20Z | 2026-11-13T04:49:20Z | 1 | 7
|
schema_hash 31cadb103c72…dependency_tree b7845dcbda08…table_classification 7c88836984f9… |
admin_handbook |
2026-11-13T04:49:32Z | 2026-11-13T04:49:33Z | 1 | 7
|
api_map c0c143c6c12d…admin_handbook 3d8f3e2164fb… |
db_handbook |
2026-11-13T04:49:46Z | 2026-11-13T04:49:47Z | 1 | 8
|
db_handbook 28ef67498398…seed_isolation 65084d083961… |
seed_data |
2026-11-13T04:49:54Z | 2026-11-13T04:49:55Z | 1 | 6
|
seed_data_sql 9f648e8e5404…seed_cases_json 20caa7cbfb06… |
seed_validate |
2026-11-13T04:49:58Z | 2026-11-13T04:49:59Z | 1 | 3
|
seed_data_contract d56d0029ae2b… |
usecase_validate |
2026-11-13T04:50:10Z | 2026-11-13T10:44:42Z | 2 | 10
|
failed_tests ecb5a22fa59f…passed_tests 27f8ecb4c920…test_results 6304a90451e5…usecase_contract 23e4903780bb… |
finalize_docs |
2026-11-13T10:44:48Z | 2026-11-13T10:44:49Z | 1 | 9
|
defects_json 413a0c0bddce…release_notes 587c688f1cd7…api_integration_guide 1b1efbcb1d6f… |
package_archive invalidated 2026-11-13T13:18:52Z |
2026-11-13T11:09:25Z | 2026-11-13T11:09:28Z | 1 | 37 (final gate PASS)
|
sale_tar f474ab269f40…checksums c614a5667d73…verify_md ef9e60a03892…rebuild_md e34e1f6b9c7b…manifest_txt 1ecc466191f1…actions_jsonl 78352341d7a6…provenance_md 649f43c9e3a9…assetchain_log_md e9eccaec0c0f…assetchain_log_json 2c422d9ce73b… |
[stage_runs]
Rewinds
- 2026-11-13T13:18:52Z:
package_archivetopackage_archiveon docs_redo (scripts/redo-docs.py --stage package_archive) [stage_events, stage_events #36099]
Model work per stage
Fully recordedRole: writer model. Calls up to 2026-11-13T11:09:28Z.
17 calls over 4 stages
| Stage | Calls | Refused | Errors | Max attempt | Forced commits | Real tokens | Lesson rules shown |
|---|---|---|---|---|---|---|---|
plan | 2 | 0 | 0 | 1 | 0 | 5196 | L-A183, L-A15 |
remediate | 2 | 0 | 0 | 1 | 0 | 5411 | L-A183, L-A15 |
usecase_validate | 2 | 0 | 1 | 1 | 0 | 2157 | L-A59 |
finalize_docs | 11 | 1 | 0 | 2 | 0 | 63336 | L-A180, L-A181, L-A182, L-A183, L-A184, L-A155, L-A114, L-A25, L-A15 |
[micro_step_runs] [lesson_recalls]
Review
Fully recordedRole: review model.
1 round, 1 counted, $0.59 recorded cost
| Round | Started | Critical | Major | Minor | Verdict | Cost | Cap in force | Archive reviewed |
|---|---|---|---|---|---|---|---|---|
| 1 | 2026-11-13T11:10:14Z | 0 | 0 | 1 | clean to publish [held_rounds, held_rounds #1867] | $0.59 | 3 rounds, $40.00 | f474ab269f40… |
Defects
Fully recorded- Ledger entries6 [defects, defects where product_slug=opensearch and this tag or chain]
- Disclosed in the archive6 [docs/defects/defects.json, entries]
6 ledger entries: by severity low 6; by status fixed-before-release 6.
| Defect | Severity | Status | Found by | Fixed in |
|---|---|---|---|---|
RSD-opensearch-3cb3a5dcf2Admin handbook: Environment-variable list presented as complete omits LD_LIBRARY_PATH, new in r4 (needed by the k-NN faiss engine). [defects, defects #279067] | low | fixed-before-release | held review (review model) | — |
RSD-opensearch-3184f4417fAdmin handbook: Environment-variable list presented as complete omits LD_LIBRARY_PATH, new in r4 (needed by the k-NN faiss engine). [defects, defects #279068] | low | fixed-before-release | held review (review model) | — |
RSD-opensearch-9a67dd003eDatabase handbook: Environment-variable list presented as complete omits LD_LIBRARY_PATH, new in r4 (needed by the k-NN faiss engine). [defects, defects #279069] | low | fixed-before-release | held review (review model) | — |
RSD-opensearch-988fbb7659Database handbook: Environment-variable list presented as complete omits LD_LIBRARY_PATH, new in r4 (needed by the k-NN faiss engine). [defects, defects #279070] | low | fixed-before-release | held review (review model) | — |
RSD-opensearch-3a6670c009Admin handbook: Environment-variable list presented as complete omits LD_LIBRARY_PATH, new in r4 (needed by the k-NN faiss engine). [defects, defects #279071] | low | fixed-before-release | held review (review model) | — |
RSD-opensearch-5ad0f78cebAPI guide: The 'Common Endpoints' list presents build-seed demo paths (rs-demo, rs, rsknn) as available on this instance; on a fresh container the rs-demo search returns 404. [defects, defects #279512] | low | fixed-before-release | held review (review model) | — |
Verification
1 item not recorded- Reproduced before publishingyes (rebuilt digest sha256:687be85440a39fb230685387295a5d3735424681d0d6349bcf4aaa64c587e47e · published digest sha256:687be85440a39fb230685387295a5d3735424681d0d6349bcf4aaa64c587e47e · digest match yes · builder moby/buildkit:v0.31.2 · build seconds 327) [docs/provenance/REPRO_VERIFICATION.json, verified]
- Final contract gate (G8)PASS (checks artifact_coverage, assetchain_coverage, cosign, cpu_baseline, offline_rebuild, rebuild_manifest, scan_grade, scout_grade_a, script_copies, tag_base_os, thread_exit, trademark_shipped, unpack_files, upgrade_check, vex_shipped) [g8_result.json, result]
- Grade at releaseA (percent 94 · docker grade B · docker percent 83 · tool docker scout policy 1.26.0 · config docker-default · org vex no · at 2026-11-13T13:20:42Z · failing Docker Scout counts 104 packages with copyleft licences (GPL, LGPL, MPL), all of them operating-system packages (it counts only packages whose licence it can read; the SBOM lists every component). · corrections No outdated base images) [SCOUT_EVIDENCE.json, docker_scout_policy.corrected]
- Image signatureverified on the index and the linux/amd64 manifest (key fingerprint 04daa92344a52dbc · at 2026-11-13T13:19:30Z) [docs/provenance/IMAGE_EVIDENCE.json, signed]
- Image signature transparency-log entries
- log index 3846355481 · transparency-log entry
- log index 3846356764 · transparency-log entry
- rebuild.json signatureSigstore bundle, release key (key fingerprint 04daa92344a52dbc · log index 3854953705 · transparency-log entry · integrated 2026-11-13T13:33:39Z) [ReadyStack-opensearch-3.9.0-CE-ubuntu24.04-r6.rebuild.json.sigstore, verificationMaterial.tlogEntries[0]]
- Signed attestations
- kind provenance · digest sha256:d6c4be09922155bf2c3ce3af345d2dc3ee3474ffea047c2b9a6a1620e3e0e14b · state attached · log index 3854956949 · transparency-log entry
- kind sbom · digest sha256:d6c4be09922155bf2c3ce3af345d2dc3ee3474ffea047c2b9a6a1620e3e0e14b · state attached · log index 3854958406 · transparency-log entry
- kind vsa · digest sha256:d6c4be09922155bf2c3ce3af345d2dc3ee3474ffea047c2b9a6a1620e3e0e14b · state attached · log index 3854960420 · transparency-log entry
- kind provenance · digest sha256:687be85440a39fb230685387295a5d3735424681d0d6349bcf4aaa64c587e47e · state attached · log index 3854961905 · transparency-log entry
- kind sbom · digest sha256:687be85440a39fb230685387295a5d3735424681d0d6349bcf4aaa64c587e47e · state attached · log index 3854963206 · transparency-log entry
- kind vsa · digest sha256:687be85440a39fb230685387295a5d3735424681d0d6349bcf4aaa64c587e47e · state attached · log index 3854964833 · transparency-log entry
- Pins recorddocs/PINS.md and docs/provenance/PINS.json in the archive (https://readystack.dev/products/opensearch/recipe) [docs/provenance/PINS.json]
Offline clean-room rebuilds
- 2026-11-13T11:10:21Z on build host 5 (Docker-in-Docker daemon with --network none): bit for bit yes, digest match yes, customer verify yes
rebuilt sha256:687be85440a39fb230685387295a5d3735424681d0d6349bcf4aaa64c587e47e [clean-room rebuild ledger, runs[825]]
- Not recorded: the policy tool's --result-file itself (its per-policy results are copied into SCOUT_EVIDENCE.json and the archive's IMAGE_EVIDENCE.json; the file is not kept)
Publication
Fully recorded 1 pending at generation- Image pushed (internal tag), publish_image passed2026-11-13T04:46:44Z [stage_runs, stage_runs chain 1062 stage publish_image]
- Archive manifests written2026-11-13T13:25:28Z [PUBLISH_MANIFEST.json, published_at]
- Pending at generation: the archive cut-over on prodasset, the release tag's promotion and the site event (this trail was generated after G8 and before them; they are appended as a 'publication' event in History)
Packages and CPU level
Fully recorded- x86-64 level the image needsv1 (used v4 · baseline v2 · elf files 815 · probed 2026-11-13T04:31:55Z · source build_kit) [release_images, isa_level_hard]
History
2 events- 2026-11-13T13:35:44Z generated: by KitForge release/build_trail.py · generator commit 1762e17ee8e9761d80444e254bf92fa18d39ea4a
- 2026-11-13T13:39:51Z publication: promoted at 2026-11-13T13:36:49Z · promoted digest sha256:d6c4be09922155bf2c3ce3af345d2dc3ee3474ffea047c2b9a6a1620e3e0e14b · promotion method imagetools_create_retag_by_digest_no_rebuild · site event 542 · checklist status complete · checklist at 2026-11-13T13:39:51Z · record workspace: deliverables/provenance/PROMOTION_RECORD.json, RELEASE_CHECKLIST.json
Records
25 records| Record | Where it is | Rows |
|---|---|---|
docs/defects/defects.json | inside the archive (ReadyStack-opensearch-3.9.0-CE-ubuntu24.04-r6.tar.gz) | — |
docs/provenance/IMAGE_EVIDENCE.json | inside the archive (ReadyStack-opensearch-3.9.0-CE-ubuntu24.04-r6.tar.gz) | — |
docs/provenance/LOCKED_DIGEST.txt | inside the archive (ReadyStack-opensearch-3.9.0-CE-ubuntu24.04-r6.tar.gz) | — |
docs/provenance/PINS.json | inside the archive (ReadyStack-opensearch-3.9.0-CE-ubuntu24.04-r6.tar.gz) | — |
docs/provenance/REPRO_VERIFICATION.json | inside the archive (ReadyStack-opensearch-3.9.0-CE-ubuntu24.04-r6.tar.gz) | — |
docs/provenance/SOURCE_TREE_HASH.json | inside the archive (ReadyStack-opensearch-3.9.0-CE-ubuntu24.04-r6.tar.gz) | — |
MANIFEST.json | beside the archive (prodasset /data/production/opensearch/3.9.0-CE-ubuntu24.04-r6/), as staged for publishing | — |
PUBLISH_MANIFEST.json | beside the archive (prodasset /data/production/opensearch/3.9.0-CE-ubuntu24.04-r6/), as staged for publishing | — |
ReadyStack-opensearch-3.9.0-CE-ubuntu24.04-r6.rebuild.json | beside the archive (prodasset /data/production/opensearch/3.9.0-CE-ubuntu24.04-r6/), as staged for publishing | — |
ReadyStack-opensearch-3.9.0-CE-ubuntu24.04-r6.rebuild.json.sigstore | beside the archive (prodasset /data/production/opensearch/3.9.0-CE-ubuntu24.04-r6/), as staged for publishing | — |
SCOUT_EVIDENCE.json | beside the archive (prodasset /data/production/opensearch/3.9.0-CE-ubuntu24.04-r6/), as staged for publishing | — |
clean-room rebuild ledger | the clean-room rebuild ledger (runstate/audit-2026-09/bit4bit.json, not published) | — |
build_requests | sadb, ReadyStack's engine database (not published) | 710 |
chains | sadb, ReadyStack's engine database (not published) | 1062 |
defects | sadb, ReadyStack's engine database (not published) | opensearch 3.9.0-CE-ubuntu24.04-r6 |
drive_runs | sadb, ReadyStack's engine database (not published) | chain 1062 |
held_rounds | sadb, ReadyStack's engine database (not published) | chain 1062 |
lesson_recalls | sadb, ReadyStack's engine database (not published) | chain 1062 |
micro_step_runs | sadb, ReadyStack's engine database (not published) | chain 1062 |
release_images | sadb, ReadyStack's engine database (not published) | opensearch 3.9.0-CE-ubuntu24.04-r6 |
stage_events | sadb, ReadyStack's engine database (not published) | chain 1062 |
stage_runs | sadb, ReadyStack's engine database (not published) | chain 1062 |
attestations.json | the chain's workspace on the controller (not published) | — |
deliverables/provenance/PROMOTION_RECORD.json | the chain's workspace on the controller (not published) | — |
g8_result.json | the chain's workspace on the controller (not published) | — |