Prometheus v3.16.0-CE-ubuntu24.04-r4 build trail
How ReadyStack built readystack/prometheus:v3.16.0-CE-ubuntu24.04-r4 and its build kit, copied record by record: why the release exists, every chain, drive and stage it went through, the model work, the review rounds, the defects, the checks that verified it and when it was published. Each line names the record it comes from in brackets; a record that does not exist for this release says so.
This trail
As JSON- Image
readystack/prometheus:v3.16.0-CE-ubuntu24.04-r4 - Index digestsha256:11973f133696e92b6dba03aaac57cfdf5c076c80ab8ccf94b0d2d9df5a204589
- linux/amd64 digestsha256:9c5c22442864bc05e0e0c197e131e31c30b56da95a342501687f9f950770e3fe
- Archive
ReadyStack-prometheus-v3.16.0-CE-ubuntu24.04-r4.tar.gz - Archive SHA-256 now6e0a4bc93fb93c3ca3313f92f6114ae57c9c98163792e9fdcdb506dac253ee6a
- Pins record
docs/PINS.md,docs/provenance/PINS.jsonin the archive (since generated) - Generated2026-11-22T17:41:00Z by KitForge release/build_trail.py
- Sections9 sections, 8 fully recorded; 1 item not recorded
Signed with the release key The trail's signature is a Sigstore bundle beside it. Check it is ours before you rely on it:
cosign verify-blob --key https://readystack.dev/keys/cosign.pub \ --bundle ReadyStack-prometheus-v3.16.0-CE-ubuntu24.04-r4.trail.json.sigstore ReadyStack-prometheus-v3.16.0-CE-ubuntu24.04-r4.trail.json
IdentityWhy this release existsThe path through the harnessModel work per stageReviewDefectsVerificationPublicationPackages and CPU level
Identity
Fully recorded- ProductPrometheus (prometheus) [MANIFEST.json]
- Release tagv3.16.0-CE-ubuntu24.04-r4 [MANIFEST.json]
- Imagereadystack/prometheus:v3.16.0-CE-ubuntu24.04-r4 [MANIFEST.json]
- Image index digestsha256:11973f133696e92b6dba03aaac57cfdf5c076c80ab8ccf94b0d2d9df5a204589 [docs/provenance/LOCKED_DIGEST.txt]
- linux/amd64 image digestsha256:9c5c22442864bc05e0e0c197e131e31c30b56da95a342501687f9f950770e3fe [ReadyStack-prometheus-v3.16.0-CE-ubuntu24.04-r4.rebuild.json, subject.image_manifest_digest]
- ArchiveReadyStack-prometheus-v3.16.0-CE-ubuntu24.04-r4.tar.gz (bytes 623116502) [MANIFEST.json]
- Archive sha256 at publish6e0a4bc93fb93c3ca3313f92f6114ae57c9c98163792e9fdcdb506dac253ee6a [MANIFEST.json, tarball_sha256]
- Archive records agreeyes [MANIFEST.json, PUBLISH_MANIFEST.json and .cutover.json name the same sha256]
- Repack historynone: the archive is as first published [MANIFEST.json, repack_history]
- Upstream repositoryhttps://github.com/prometheus/prometheus [docs/provenance/SOURCE_TREE_HASH.json]
- Upstream refv3.16.0 [docs/provenance/SOURCE_TREE_HASH.json]
- Upstream commite2e28adeee2c5883d000fc82aca6008cfbf7e96d [docs/provenance/SOURCE_TREE_HASH.json]
- Source tree hashdbee8a20cb6bdde803a797b6ba7906ee1c8a010292fce25e73721ed51e1c0980 (files 1714) [docs/provenance/SOURCE_TREE_HASH.json, tree_listing_sha256 (sha256 of the sorted file listing)]
- Kit tree hashsha256:f8e569970da5131731a0b4a294c9e6fd610fd354812f2599f34612af5c8be737 [ReadyStack-prometheus-v3.16.0-CE-ubuntu24.04-r4.rebuild.json, inputs.tree_hash]
- SOURCE_DATE_EPOCH1795161192 (utc 2026-11-20T07:53:12Z) [ReadyStack-prometheus-v3.16.0-CE-ubuntu24.04-r4.rebuild.json, inputs.source_date_epoch]
- Base images
- ref golang:1.26.11-bookworm@sha256:dc40a13b61304647ed7e5d581d246b86413dfc29d63c6d018310feb93cd98fc0 · platform digest sha256:79ecd0a7157c7a4cf3b281ced8465350591bf54fedab540e75374a003e1fde7e
- ref ubuntu:24.04@sha256:9c7f200c07e3d4a03e7249d2c16bf66a51120fb876aa2242cf31451412543289 · platform digest sha256:9a04f13b3f80ef056361e30868593b1cfd2279fe19e4081cb93a90bf56819d6a
- BuildKitmoby/buildkit:v0.31.2 (image digest sha256:e0e67ea9c4bb07bdef683e29f70f3b623d1eb9c82274a9ec04e6bb0511449fb0) [ReadyStack-prometheus-v3.16.0-CE-ubuntu24.04-r4.rebuild.json, engine]
- Engine commit(s)
- commit 4c8a35a67cf8e7120c52e4f0ff5b0ee7dc76f14e · dirty yes · first drive 4956
- commit c5a0c6843c306dba2dfdfd519b7aca7308e79931 · dirty yes · first drive 5071
- commit b251a6f5fae0ac9a81d01ea2edb502a52e609d24 · dirty yes · first drive 5118
- commit 31b351bdcfef2c0e27d4a151a734f952413b7ffe · dirty yes · first drive 5135
- commit 87b50e2983b3836b118b13f530923c6efe0fce7a · dirty yes · first drive 5147
Why this release exists
Fully recorded- Chain1143 (created 2026-11-20T11:07:43Z · trigger customer_request · upstream version v3.16.0) [chains, chains #1143]
- Requestbuild request #841 (rebuild) (requested at 2026-11-20T07:53:14Z · requested by kitforge-agent · version v3.16.0) [build_requests, build_requests #841]
- Reasonrevision v3.16.0-CE-ubuntu24.04-r4: same upstream version rebuilt (retarget.py --rev-bump) [build_requests, build_requests #841 request_reason]
- Supersedesreadystack/prometheus:v3.16.0-CE-ubuntu24.04-r3 (chain 999) [chains, chains #999]
The path through the harness
Fully recorded1 chain · 5 drives · 18 stages · 1 rewind
Chain 1143 release · ready_to_ship
Created 2026-11-20T11:07:43Z, upstream v3.16.0, build request 841 [chains, chains #1143]
| Drive | Started | Minutes | Build host | How it stopped |
|---|---|---|---|---|
| 4956 | 2026-11-20T11:08:27Z | 67.1 | build host 4 withhold-publish | stage_failed at package_archive; first failed check exists:checksums; 18 ticks [drive_runs, drive_runs #4956] |
| 5071 | 2026-11-21T08:16:48Z | 3.6 | build host 4 withhold-publish | stage_failed at package_archive; first failed check exists:checksums; 1 tick [drive_runs, drive_runs #5071] |
| 5118 | 2026-11-22T07:01:26Z | 2.9 | build host 4 withhold-publish | stage_failed at package_archive; first failed check exists:checksums; 1 tick [drive_runs, drive_runs #5118] |
| 5135 | 2026-11-22T16:39:33Z | 13.5 | build host 4 withhold-publish | ready_to_ship at package_archive; 2 ticks [drive_runs, drive_runs #5135] |
| 5147 | 2026-11-22T17:32:25Z | — | build host 4 publish-held | not recorded [drive_runs, drive_runs #5147] |
Stages, in order
| Stage | First start | Passed | Attempts | Gate checks passed | Artifacts (SHA-256) |
|---|---|---|---|---|---|
intake |
2026-11-20T11:08:37Z | 2026-11-20T11:08:38Z | 1 | 4
|
order_json 27afda5d4775… |
acquire |
2026-11-20T11:08:43Z | 2026-11-20T11:08:44Z | 1 | 12
|
source_tree 63f060102fd5…license_file c71d239df917…custody_inputs 3fcd27c28b76…source_tree_hash a2d03641017a…source_file_manifest 03180dc43fcf… |
plan |
2026-11-20T11:09:18Z | 2026-11-20T11:09:19Z | 1 | 10
|
recon_report d51a96f48bdb…input_pin_plan 266286ee414e…toolchain_lock f0f677d51278… |
assemble_kit |
2026-11-20T11:21:36Z | 2026-11-20T11:21:37Z | 1 | 27
|
dockerfile 9dc61fdbaf04…build_recipe 3ae18287ac5c…system_pinning aa8db05a9a8a…build_offline_sh 6ab4f08a6ec7…generate_sbom_sh ce0f1e6f1e70…first_boot_health 14c33f82d91d…verify_offline_sh 3e8184ea230c…base_image_digests fa7f0c25cf17…dockerfile_offline 9dc61fdbaf04…first_build_digest 0d7e78590c59… |
remediate |
2026-11-20T11:22:11Z | 2026-11-20T11:22:12Z | 1 | 8
|
vendored_apt e3b0c44298fc…remediation_log f154a058ad8d…security_report b2b391bdbd4b… |
build_kit |
2026-11-20T11:34:26Z | 2026-11-20T11:34:27Z | 1 | 9
|
cosign_stamp 4c517de9470e…locked_digest 4cca3f0bcf8e…freeze_manifest 9d88050f546c…offline_rebuild_transcript 2df8e197c3e6… |
verdict |
2026-11-20T11:35:14Z | 2026-11-20T11:35:15Z | 1 | 8
|
scout_verdict f7e8867b2179… |
publish_image |
2026-11-20T11:35:51Z | 2026-11-20T11:35:52Z | 1 | 7
|
hub_readme f6b92a02b22f…promotion_record 16002dabd0fc… |
boot_instance |
2026-11-20T11:35:57Z | 2026-11-20T11:36:02Z | 2 | 3
|
instance_handle 200e55a36940… |
sbom |
2026-11-20T11:36:16Z | 2026-11-20T11:36:17Z | 1 | 5
|
sbom_md 9bc1f3e0cf70…sbom_json b62c1caf906d… |
schema_discovery |
2026-11-20T11:36:20Z | 2026-11-20T11:36:20Z | 1 | 7
|
schema_hash d311e2886763…dependency_tree 77fe7001d873…table_classification c75fa9c5e1a8… |
admin_handbook |
2026-11-20T11:46:55Z | 2026-11-20T11:46:55Z | 1 | 7
|
api_map 87a4a1a5f7f8…admin_handbook a495826fea49… |
db_handbook |
2026-11-20T11:52:48Z | 2026-11-20T11:52:48Z | 1 | 8
|
db_handbook fbd93ed8b503…seed_isolation ece6e82a0623… |
seed_data |
2026-11-20T11:52:57Z | 2026-11-20T11:52:58Z | 1 | 6
|
seed_data_sql 4857e7c347b3…seed_cases_json e1d48046887e… |
seed_validate |
2026-11-20T11:53:01Z | 2026-11-20T11:53:02Z | 1 | 3
|
seed_data_contract 73d006a98e17… |
usecase_validate |
2026-11-20T11:53:19Z | 2026-11-20T11:53:20Z | 1 | 10
|
failed_tests b2247b16f5f7…passed_tests 7f3e6b626009…test_results 4f4559eafd84…usecase_contract 3ae4966804ff… |
finalize_docs |
2026-11-20T12:07:57Z | 2026-11-20T12:07:58Z | 1 | 9
|
defects_json edbd2ea8380c…release_notes 0697ee353cb5…api_integration_guide 1655174a40da… |
package_archive invalidated 2026-11-22T17:32:02Z |
2026-11-20T12:15:31Z | 2026-11-22T16:53:04Z | 4 | 37 (final gate PASS)
|
sale_tar 50f0c5d90e0d…checksums 8386fa26d0c8…verify_md 5010e6926b0d…rebuild_md 603f56105484…manifest_txt 0f3b76b99487…actions_jsonl e6f9dd95f3fd…provenance_md d3ca99730f25…assetchain_log_md e9eccaec0c0f…assetchain_log_json 179a277aecb2… |
[stage_runs]
Rewinds
- 2026-11-22T17:32:02Z:
package_archivetopackage_archiveon docs_redo (scripts/redo-docs.py --stage package_archive) [stage_events, stage_events #43043]
Model work per stage
Fully recordedRole: writer model. Calls up to 2026-11-22T16:53:04Z.
169 calls over 6 stages
| Stage | Calls | Refused | Errors | Max attempt | Forced commits | Real tokens | Lesson rules shown |
|---|---|---|---|---|---|---|---|
plan | 2 | 0 | 0 | 1 | 0 | 12874 | L-A183, L-A15 |
remediate | 2 | 0 | 0 | 1 | 0 | 13606 | L-A183, L-A15 |
admin_handbook | 52 | 26 | 0 | 3 | 5 | 475779 | L-A180, L-A181, L-A182, L-A183, L-A184, L-A155, L-A114, L-A25, L-A15, L-A14 |
db_handbook | 31 | 5 | 0 | 2 | 0 | 237881 | L-A180, L-A181, L-A182, L-A183, L-A184, L-A114, L-A15 |
usecase_validate | 1 | 0 | 0 | 1 | 0 | 2274 | L-A59 |
finalize_docs | 81 | 43 | 0 | 3 | 11 | 925358 | L-A180, L-A181, L-A182, L-A183, L-A184, L-A155, L-A114, L-A25, L-A15 |
[micro_step_runs] [lesson_recalls]
Review
Fully recordedRole: review model.
1 round, 1 counted, $1.13 recorded cost
| Round | Started | Critical | Major | Minor | Verdict | Cost | Cap in force | Archive reviewed |
|---|---|---|---|---|---|---|---|---|
| 1 | 2026-11-22T16:54:08Z | 0 | 0 | 11 | clean to publish [held_rounds, held_rounds #2108] | $1.13 | 3 rounds, $40.00 | 50f0c5d90e0d… |
Defects
Fully recorded- Ledger entries12 [defects, defects where product_slug=prometheus and this tag or chain]
- Disclosed in the archive12 [docs/defects/defects.json, entries]
12 ledger entries: by severity high 1, low 11; by status open 1, fixed-before-release 11.
| Defect | Severity | Status | Found by | Fixed in |
|---|---|---|---|---|
RSD-prometheus-b3e31c3ddeUnauthenticated access by default [defects, defects #342965] | high | open | build strategy record | — |
RSD-prometheus-b275e1bc91Admin handbook: Verified false or contradictory customer-facing statement [defects, defects #366724] | low | fixed-before-release | held review (review model) | — |
RSD-prometheus-f96a5a80bfAdmin handbook: Verified false or contradictory customer-facing statement [defects, defects #366725] | low | fixed-before-release | held review (review model) | — |
RSD-prometheus-11ad6a805dDatabase handbook: Verified false or contradictory customer-facing statement [defects, defects #366726] | low | fixed-before-release | held review (review model) | — |
RSD-prometheus-163be2178aAPI guide: Verified false or contradictory customer-facing statement [defects, defects #366727] | low | fixed-before-release | held review (review model) | — |
RSD-prometheus-0bf25d64fcAdmin handbook: Verified false or contradictory customer-facing statement [defects, defects #366728] | low | fixed-before-release | held review (review model) | — |
RSD-prometheus-ee787ce34cDatabase handbook: Verified false or contradictory customer-facing statement [defects, defects #366729] | low | fixed-before-release | held review (review model) | — |
RSD-prometheus-34ff40950cDatabase handbook: Verified false or contradictory customer-facing statement [defects, defects #366730] | low | fixed-before-release | held review (review model) | — |
RSD-prometheus-df2e6ed98eAPI guide: Verified false or contradictory customer-facing statement [defects, defects #366731] | low | fixed-before-release | held review (review model) | — |
RSD-prometheus-380f680e87API guide: Verified false or contradictory customer-facing statement [defects, defects #366732] | low | fixed-before-release | held review (review model) | — |
RSD-prometheus-d42211a558API guide: Verified false or contradictory customer-facing statement [defects, defects #366733] | low | fixed-before-release | held review (review model) | — |
RSD-prometheus-f99b8557a1Database handbook: Verified false or contradictory customer-facing statement [defects, defects #366734] | low | fixed-before-release | held review (review model) | — |
Verification
1 item not recorded- Reproduced before publishingyes (rebuilt digest sha256:9c5c22442864bc05e0e0c197e131e31c30b56da95a342501687f9f950770e3fe · published digest sha256:9c5c22442864bc05e0e0c197e131e31c30b56da95a342501687f9f950770e3fe · digest match yes · builder moby/buildkit:v0.31.2 · build seconds 353) [docs/provenance/REPRO_VERIFICATION.json, verified]
- Final contract gate (G8)PASS (checks artifact_coverage, assetchain_coverage, cosign, cpu_baseline, offline_rebuild, rebuild_manifest, scan_grade, scout_grade_a, script_copies, tag_base_os, thread_exit, trademark_shipped, unpack_files, upgrade_check, vex_shipped) [g8_result.json, result]
- Grade at releaseA (percent 94 · tool docker scout policy 1.26.0 · config docker-default · org vex no · at 2026-11-22T17:32:45Z · failing Docker Scout counts 11 packages with copyleft licences (GPL, LGPL, MPL), all of them operating-system packages (it counts only packages whose licence it can read; the SBOM lists every component).) [SCOUT_EVIDENCE.json, docker_scout_policy]
- Image signatureverified on the index and the linux/amd64 manifest (key fingerprint 04daa92344a52dbc · at 2026-11-22T17:32:34Z) [docs/provenance/IMAGE_EVIDENCE.json, signed]
- Image signature transparency-log entries
- log index 4024082565 · transparency-log entry
- log index 4024083768 · transparency-log entry
- rebuild.json signatureSigstore bundle, release key (key fingerprint 04daa92344a52dbc · log index 4047231691 · transparency-log entry · integrated 2026-11-22T17:39:00Z) [ReadyStack-prometheus-v3.16.0-CE-ubuntu24.04-r4.rebuild.json.sigstore, verificationMaterial.tlogEntries[0]]
- Signed attestations
- kind provenance · digest sha256:11973f133696e92b6dba03aaac57cfdf5c076c80ab8ccf94b0d2d9df5a204589 · state attached · log index 4047232084 · transparency-log entry
- kind sbom · digest sha256:11973f133696e92b6dba03aaac57cfdf5c076c80ab8ccf94b0d2d9df5a204589 · state attached · log index 4047232167 · transparency-log entry
- kind vsa · digest sha256:11973f133696e92b6dba03aaac57cfdf5c076c80ab8ccf94b0d2d9df5a204589 · state attached · log index 4047232253 · transparency-log entry
- kind provenance · digest sha256:9c5c22442864bc05e0e0c197e131e31c30b56da95a342501687f9f950770e3fe · state attached · log index 4047232322 · transparency-log entry
- kind sbom · digest sha256:9c5c22442864bc05e0e0c197e131e31c30b56da95a342501687f9f950770e3fe · state attached · log index 4047232408 · transparency-log entry
- kind vsa · digest sha256:9c5c22442864bc05e0e0c197e131e31c30b56da95a342501687f9f950770e3fe · state attached · log index 4047232549 · transparency-log entry
- Pins recorddocs/PINS.md and docs/provenance/PINS.json in the archive (https://readystack.dev/products/prometheus/recipe) [docs/provenance/PINS.json]
Offline clean-room rebuilds
- 2026-11-22T16:54:14Z on build host 4 (Docker-in-Docker daemon with --network none): bit for bit yes, digest match yes, customer verify yes
rebuilt sha256:9c5c22442864bc05e0e0c197e131e31c30b56da95a342501687f9f950770e3fe [clean-room rebuild ledger, runs[965]]
- Not recorded: the policy tool's --result-file itself (its per-policy results are copied into SCOUT_EVIDENCE.json and the archive's IMAGE_EVIDENCE.json; the file is not kept)
Publication
Fully recorded 1 pending at generation- Image pushed (internal tag), publish_image passed2026-11-20T11:35:52Z [stage_runs, stage_runs chain 1143 stage publish_image]
- Archive manifests written2026-11-22T17:35:54Z [PUBLISH_MANIFEST.json, published_at]
- Pending at generation: the archive cut-over on prodasset, the release tag's promotion and the site event (this trail was generated after G8 and before them; they are appended as a 'publication' event in History)
Packages and CPU level
Fully recorded- x86-64 level the image needsv1 (used v4 · baseline v2 · elf files 63 · probed 2026-11-20T11:28:17Z · source build_kit) [release_images, isa_level_hard]
History
2 events- 2026-11-22T17:41:00Z generated: by KitForge release/build_trail.py · generator commit 87b50e2983b3836b118b13f530923c6efe0fce7a
- 2026-11-22T17:43:27Z publication: promoted at 2026-11-22T17:41:44Z · promoted digest sha256:11973f133696e92b6dba03aaac57cfdf5c076c80ab8ccf94b0d2d9df5a204589 · promotion method imagetools_create_retag_by_digest_no_rebuild · site event 674 · checklist status complete · checklist at 2026-11-22T17:43:27Z · record workspace: deliverables/provenance/PROMOTION_RECORD.json, RELEASE_CHECKLIST.json
Records
25 records| Record | Where it is | Rows |
|---|---|---|
docs/defects/defects.json | inside the archive (ReadyStack-prometheus-v3.16.0-CE-ubuntu24.04-r4.tar.gz) | — |
docs/provenance/IMAGE_EVIDENCE.json | inside the archive (ReadyStack-prometheus-v3.16.0-CE-ubuntu24.04-r4.tar.gz) | — |
docs/provenance/LOCKED_DIGEST.txt | inside the archive (ReadyStack-prometheus-v3.16.0-CE-ubuntu24.04-r4.tar.gz) | — |
docs/provenance/PINS.json | inside the archive (ReadyStack-prometheus-v3.16.0-CE-ubuntu24.04-r4.tar.gz) | — |
docs/provenance/REPRO_VERIFICATION.json | inside the archive (ReadyStack-prometheus-v3.16.0-CE-ubuntu24.04-r4.tar.gz) | — |
docs/provenance/SOURCE_TREE_HASH.json | inside the archive (ReadyStack-prometheus-v3.16.0-CE-ubuntu24.04-r4.tar.gz) | — |
MANIFEST.json | beside the archive (prodasset /data/production/prometheus/v3.16.0-CE-ubuntu24.04-r4/), as staged for publishing | — |
PUBLISH_MANIFEST.json | beside the archive (prodasset /data/production/prometheus/v3.16.0-CE-ubuntu24.04-r4/), as staged for publishing | — |
ReadyStack-prometheus-v3.16.0-CE-ubuntu24.04-r4.rebuild.json | beside the archive (prodasset /data/production/prometheus/v3.16.0-CE-ubuntu24.04-r4/), as staged for publishing | — |
ReadyStack-prometheus-v3.16.0-CE-ubuntu24.04-r4.rebuild.json.sigstore | beside the archive (prodasset /data/production/prometheus/v3.16.0-CE-ubuntu24.04-r4/), as staged for publishing | — |
SCOUT_EVIDENCE.json | beside the archive (prodasset /data/production/prometheus/v3.16.0-CE-ubuntu24.04-r4/), as staged for publishing | — |
clean-room rebuild ledger | the clean-room rebuild ledger (runstate/audit-2026-09/bit4bit.json, not published) | — |
build_requests | sadb, ReadyStack's engine database (not published) | 841 |
chains | sadb, ReadyStack's engine database (not published) | 1143 |
defects | sadb, ReadyStack's engine database (not published) | prometheus v3.16.0-CE-ubuntu24.04-r4 |
drive_runs | sadb, ReadyStack's engine database (not published) | chain 1143 |
held_rounds | sadb, ReadyStack's engine database (not published) | chain 1143 |
lesson_recalls | sadb, ReadyStack's engine database (not published) | chain 1143 |
micro_step_runs | sadb, ReadyStack's engine database (not published) | chain 1143 |
release_images | sadb, ReadyStack's engine database (not published) | prometheus v3.16.0-CE-ubuntu24.04-r4 |
stage_events | sadb, ReadyStack's engine database (not published) | chain 1143 |
stage_runs | sadb, ReadyStack's engine database (not published) | chain 1143 |
attestations.json | the chain's workspace on the controller (not published) | — |
deliverables/provenance/PROMOTION_RECORD.json | the chain's workspace on the controller (not published) | — |
g8_result.json | the chain's workspace on the controller (not published) | — |