Prometheus v3.16.0-CE-ubuntu24.04-r3 build trail

How ReadyStack built readystack/prometheus:v3.16.0-CE-ubuntu24.04-r3 and its build kit, copied record by record: why the release exists, every chain, drive and stage it went through, the model work, the review rounds, the defects, the checks that verified it and when it was published. Each line names the record it comes from in brackets; a record that does not exist for this release says so.

This trail

As JSON
  • Imagereadystack/prometheus:v3.16.0-CE-ubuntu24.04-r3
  • Index digestsha256:f65b74122b60be02a63a5c709ddbc71a940aad501d0a5a375d232b26ef35136a
  • linux/amd64 digestsha256:2bd24488db7b256a90d64def262830c9aadfed0bb341022ea506b86ff3330efd
  • ArchiveReadyStack-prometheus-v3.16.0-CE-ubuntu24.04-r3.tar.gz
  • Archive SHA-256 nowb448aec4e29f59c1975d16e02117d5780710204ffa07e8e49e428ea0f4173333
  • Pins recorddocs/PINS.md, docs/provenance/PINS.json in the archive (since generated)
  • Generated2026-11-17T13:53:21Z by KitForge release/build_trail.py
  • Sections9 sections, 8 fully recorded; 1 item not recorded

Signed with the release key The trail's signature is a Sigstore bundle beside it. Check it is ours before you rely on it:

cosign verify-blob --key https://readystack.dev/keys/cosign.pub \
  --bundle ReadyStack-prometheus-v3.16.0-CE-ubuntu24.04-r3.trail.json.sigstore ReadyStack-prometheus-v3.16.0-CE-ubuntu24.04-r3.trail.json

IdentityWhy this release existsThe path through the harnessModel work per stageReviewDefectsVerificationPublicationPackages and CPU level

Identity

Fully recorded
  • ProductPrometheus (prometheus) [MANIFEST.json]
  • Release tagv3.16.0-CE-ubuntu24.04-r3 [MANIFEST.json]
  • Imagereadystack/prometheus:v3.16.0-CE-ubuntu24.04-r3 [MANIFEST.json]
  • Image index digestsha256:f65b74122b60be02a63a5c709ddbc71a940aad501d0a5a375d232b26ef35136a [docs/provenance/LOCKED_DIGEST.txt]
  • linux/amd64 image digestsha256:2bd24488db7b256a90d64def262830c9aadfed0bb341022ea506b86ff3330efd [ReadyStack-prometheus-v3.16.0-CE-ubuntu24.04-r3.rebuild.json, subject.image_manifest_digest]
  • ArchiveReadyStack-prometheus-v3.16.0-CE-ubuntu24.04-r3.tar.gz (bytes 623129797) [MANIFEST.json]
  • Archive sha256 at publishb448aec4e29f59c1975d16e02117d5780710204ffa07e8e49e428ea0f4173333 [MANIFEST.json, tarball_sha256]
  • Archive records agreeyes [MANIFEST.json, PUBLISH_MANIFEST.json and .cutover.json name the same sha256]
  • Repack historynone: the archive is as first published [MANIFEST.json, repack_history]
  • Upstream repositoryhttps://github.com/prometheus/prometheus [docs/provenance/SOURCE_TREE_HASH.json]
  • Upstream refv3.16.0 [docs/provenance/SOURCE_TREE_HASH.json]
  • Upstream commite2e28adeee2c5883d000fc82aca6008cfbf7e96d [docs/provenance/SOURCE_TREE_HASH.json]
  • Source tree hashdbee8a20cb6bdde803a797b6ba7906ee1c8a010292fce25e73721ed51e1c0980 (files 1714) [docs/provenance/SOURCE_TREE_HASH.json, tree_listing_sha256 (sha256 of the sorted file listing)]
  • Kit tree hashsha256:dd74b427167f01875a58022ce3f60fafeabb2941eb5304b9df85fbe0d9577851 [ReadyStack-prometheus-v3.16.0-CE-ubuntu24.04-r3.rebuild.json, inputs.tree_hash]
  • SOURCE_DATE_EPOCH1794448305 (utc 2026-11-12T01:51:45Z) [ReadyStack-prometheus-v3.16.0-CE-ubuntu24.04-r3.rebuild.json, inputs.source_date_epoch]
  • Base images
    • ref golang:1.26.11-bookworm@sha256:dc40a13b61304647ed7e5d581d246b86413dfc29d63c6d018310feb93cd98fc0 · platform digest sha256:79ecd0a7157c7a4cf3b281ced8465350591bf54fedab540e75374a003e1fde7e
    • ref ubuntu:24.04@sha256:2198e4c65076e9cb0b3d695219df667c0e3b0072da64ca3c2648aca17dcecaf5 · platform digest sha256:77eb101c607d6e3d4f5ad0c8a02c2136c689b98aba1f359e6502ba517e5c57ec
    [ReadyStack-prometheus-v3.16.0-CE-ubuntu24.04-r3.rebuild.json, bases]
  • BuildKitmoby/buildkit:v0.31.2 (image digest sha256:e0e67ea9c4bb07bdef683e29f70f3b623d1eb9c82274a9ec04e6bb0511449fb0) [ReadyStack-prometheus-v3.16.0-CE-ubuntu24.04-r3.rebuild.json, engine]
  • Engine commit(s)
    • commit 951c2d7173217f0c093320b3435ff72318b997a5 · dirty yes · first drive 4341
    • commit 0d6cfe73bbf4df66989e87099ed978c9b446fd18 · dirty yes · first drive 4355
    • commit d4a7afb5b3612b0c920b8922d8aaa63e07e805eb · dirty yes · first drive 4406
    • commit 4ec06344cf47f5b6c4f1894a79db5611e589923c · dirty yes · first drive 4436
    • commit 9bf62fc46cb5a4c666ae0d83ee6d1056e96b052a · dirty yes · first drive 4485
    • commit a8f9a7a13a5afbd6dd0df0a91e7d0fbee76954b4 · dirty yes · first drive 4491
    • commit 53328f4754ecefc18b308504e3b02f89c9062497 · dirty yes · first drive 4543
    • commit 7e5e859529535df572f4abd7beb5734967bb5f63 · dirty yes · first drive 4649
    • commit 729c6303da5fecc0584ae931e9968f4902ba833a · dirty yes · first drive 4674
    • commit 402eae1f1f1dde945a70ac3d58b7b568c3231e67 · dirty yes · first drive 4692
    • commit d4d16433f5c29fa720dde7dcb9217235d818f6bf · dirty yes · first drive 4704
    • commit 77d5f772f1ba55e386ce8859a4125e2d03c8da5a · dirty yes · first drive 4726
    • commit 7a1bfee4ab47134f61c24769449b58f870913f2d · dirty yes · first drive 4757
    • commit 938ab8d395553b2cb50ae42e1de7334bbc479288 · dirty yes · first drive 4772
    • commit 2e98107c7e4d62b52f3035264e95e97133bf61c9 · dirty yes · first drive 4800
    • commit 7f92f870f8fc219071f0269aa59fcc0347fd3a82 · dirty yes · first drive 4814
    • commit 9beb24ce02584e4a289909bec38478af456e9225 · dirty yes · first drive 4819
    [drive_runs, engine_sha]

Why this release exists

Fully recorded
  • Chain999 (created 2026-11-12T03:24:03Z · trigger customer_request · upstream version v3.16.0) [chains, chains #999]
  • Requestbuild request #713 (rebuild) (requested at 2026-11-12T01:51:47Z · requested by kitforge-agent · version v3.16.0) [build_requests, build_requests #713]
  • Reasonrevision v3.16.0-CE-ubuntu24.04-r3: same upstream version rebuilt (retarget.py --rev-bump) [build_requests, build_requests #713 request_reason]
  • Supersedesreadystack/prometheus:v3.16.0-CE-ubuntu24.04-r2 (chain 862) [chains, chains #862]

The path through the harness

Fully recorded

1 chain · 17 drives · 18 stages · 6 rewinds

Chain 999 release · ready_to_ship

Created 2026-11-12T03:24:03Z, upstream v3.16.0, build request 713 [chains, chains #999]

DriveStartedMinutesBuild hostHow it stopped
43412026-11-12T03:24:48Z61.8build host 3 withhold-publish stage_failed at package_archive; first failed check exists:checksums; 18 ticks [drive_runs, drive_runs #4341]
43552026-11-12T06:05:33Z0.8build host 3 withhold-publish stage_failed at package_archive; first failed check exists:checksums; 1 tick [drive_runs, drive_runs #4355]
44062026-11-12T11:12:53Z1.3build host 3 withhold-publish stage_failed at package_archive; first failed check exists:checksums; 1 tick [drive_runs, drive_runs #4406]
44362026-11-12T14:39:10Z0.9build host 3 withhold-publish stage_failed at package_archive; first failed check exists:checksums; 1 tick [drive_runs, drive_runs #4436]
44852026-11-12T22:21:30Z1.3build host 3 withhold-publish stage_failed at package_archive; first failed check exists:checksums; 1 tick [drive_runs, drive_runs #4485]
44912026-11-12T22:30:05Z0.9build host 3 withhold-publish stage_failed at package_archive; first failed check exists:checksums; 1 tick [drive_runs, drive_runs #4491]
45432026-11-13T10:01:54Z1.9build host 3 withhold-publish stage_failed at package_archive; first failed check exists:checksums; 1 tick [drive_runs, drive_runs #4543]
46492026-11-14T07:30:59Z1.3build host 3 withhold-publish stage_failed at package_archive; first failed check exists:checksums; 1 tick [drive_runs, drive_runs #4649]
46742026-11-17T01:50:20Z8.9build host 3 withhold-publish stage_failed at package_archive; first failed check g8; 1 tick [drive_runs, drive_runs #4674]
46922026-11-17T02:56:15Z42.2build host 3 withhold-publish ready_to_ship at package_archive; 16 ticks [drive_runs, drive_runs #4692]
47042026-11-17T04:27:50Z1.8build host 3 withhold-publish stage_failed at package_archive; first failed check g8; 1 tick [drive_runs, drive_runs #4704]
47262026-11-17T07:13:48Z2.1build host 3 withhold-publish stage_failed at package_archive; first failed check g8; 1 tick [drive_runs, drive_runs #4726]
47572026-11-17T09:33:11Z7.8build host 3 withhold-publish ready_to_ship at package_archive; 2 ticks [drive_runs, drive_runs #4757]
47722026-11-17T10:30:21Z7.2build host 3 withhold-publish ready_to_ship at package_archive; 2 ticks [drive_runs, drive_runs #4772]
48002026-11-17T12:12:48Z7.4build host 3 withhold-publish ready_to_ship at package_archive; 2 ticks [drive_runs, drive_runs #4800]
48142026-11-17T13:07:13Z6.9build host 3 withhold-publish ready_to_ship at package_archive; 2 ticks [drive_runs, drive_runs #4814]
48192026-11-17T13:44:39Z—build host 3 publish-held not recorded [drive_runs, drive_runs #4819]

Stages, in order

StageFirst startPassedAttemptsGate checks passedArtifacts (SHA-256)
intake 2026-11-12T03:24:58Z2026-11-12T03:24:59Z1
4
  • exists:order_json
  • order_json:json_parses
  • order_json:no_forbidden_placeholders
  • produces_paths_exist
order_json 3edb83ddc61e…
acquire 2026-11-12T03:25:04Z2026-11-12T03:25:05Z1
12
  • exists:source_tree
  • exists:source_tree_hash
  • exists:source_file_manifest
  • exists:custody_inputs
  • exists:license_file
  • source_tree:dir_nonempty
  • source_tree_hash:json_parses
  • source_file_manifest:json_parses
  • custody_inputs:json_parses
  • license_file:file_nonempty
  • produces_paths_exist
  • custody_inputs:json_true:ce_audit.ce_only
source_tree 63f060102fd5…
license_file c71d239df917…
custody_inputs 3fcd27c28b76…
source_tree_hash a2d03641017a…
source_file_manifest 03180dc43fcf…
plan 2026-11-12T03:25:41Z2026-11-12T03:25:42Z1
10
  • exists:recon_report
  • exists:input_pin_plan
  • exists:toolchain_lock
  • recon_report:md_min_sections:3
  • recon_report:no_forbidden_placeholders
  • input_pin_plan:md_min_sections:2
  • input_pin_plan:no_forbidden_placeholders
  • toolchain_lock:file_nonempty
  • toolchain_lock:no_forbidden_placeholders
  • produces_paths_exist
recon_report 61e9b651edb4…
input_pin_plan a4ab66456e95…
toolchain_lock 0b1a7e06eb31…
assemble_kit 2026-11-12T03:39:04Z2026-11-17T03:09:31Z2
27
  • exists:dockerfile
  • exists:base_image_digests
  • exists:system_pinning
  • exists:build_recipe
  • exists:first_build_digest
  • exists:first_boot_health
  • exists:dockerfile_offline
  • exists:verify_offline_sh
  • exists:build_offline_sh
  • exists:generate_sbom_sh
  • dockerfile:file_nonempty
  • dockerfile:no_forbidden_placeholders
  • base_image_digests:file_nonempty
  • system_pinning:file_nonempty
  • build_recipe:json_parses
  • first_build_digest:file_nonempty
  • first_boot_health:file_nonempty
  • dockerfile_offline:file_nonempty
  • dockerfile_offline:no_forbidden_placeholders
  • verify_offline_sh:file_nonempty
  • verify_offline_sh:no_forbidden_placeholders
  • build_offline_sh:file_nonempty
  • build_offline_sh:no_forbidden_placeholders
  • generate_sbom_sh:file_nonempty
  • generate_sbom_sh:no_forbidden_placeholders
  • produces_paths_exist
  • first_boot_health:file_contains:healthy=True
dockerfile d0bcfae6f9d1…
build_recipe ad880e5af2de…
system_pinning aa8db05a9a8a…
build_offline_sh 6ab4f08a6ec7…
generate_sbom_sh ce0f1e6f1e70…
first_boot_health 634c133fa767…
verify_offline_sh 3e8184ea230c…
base_image_digests fa7f0c25cf17…
dockerfile_offline d0bcfae6f9d1…
first_build_digest 87aa1c32225e…
remediate 2026-11-12T03:39:48Z2026-11-17T03:09:35Z2
8
  • exists:vendored_apt
  • exists:remediation_log
  • exists:security_report
  • vendored_apt:dir_exists
  • remediation_log:json_parses
  • security_report:md_min_sections:2
  • security_report:no_forbidden_placeholders
  • produces_paths_exist
vendored_apt e3b0c44298fc…
remediation_log 4e15b3f68da4…
security_report 318eb4402acc…
build_kit 2026-11-12T03:52:22Z2026-11-17T03:22:18Z2
9
  • exists:freeze_manifest
  • exists:locked_digest
  • exists:cosign_stamp
  • exists:offline_rebuild_transcript
  • freeze_manifest:json_parses
  • locked_digest:file_nonempty
  • cosign_stamp:file_nonempty
  • offline_rebuild_transcript:json_parses
  • produces_paths_exist
cosign_stamp 7fced64dcb17…
locked_digest c8c3c0d12c41…
freeze_manifest b3545af9a77c…
offline_rebuild_transcript 9d521295627b…
verdict 2026-11-12T03:53:10Z2026-11-17T03:23:05Z2
8
  • exists:scout_verdict
  • scout_verdict:json_parses
  • produces_paths_exist
  • scout_verdict:release_check_passed
  • scout_verdict:nonroot_green
  • scout_verdict:zero_fixable_crit_high
  • scout_verdict:osv_clean
  • scout_verdict:no_baked_secrets
scout_verdict fd2d52519e1f…
publish_image 2026-11-12T03:54:00Z2026-11-17T03:23:45Z2
7
  • exists:promotion_record
  • exists:hub_readme
  • promotion_record:json_parses
  • hub_readme:md_min_sections:2
  • hub_readme:no_forbidden_placeholders
  • produces_paths_exist
  • promotion_record:json_true:signed
hub_readme 3e8d53fdd975…
promotion_record 482a51dc3942…
boot_instance 2026-11-12T03:54:07Z2026-11-17T03:23:56Z4
3
  • exists:instance_handle
  • instance_handle:json_parses
  • produces_paths_exist
instance_handle f4a056510fab…
sbom 2026-11-12T03:54:25Z2026-11-17T03:24:09Z2
5
  • exists:sbom_json
  • exists:sbom_md
  • sbom_json:json_parses
  • sbom_md:md_min_sections:1
  • produces_paths_exist
sbom_md 6e926886317b…
sbom_json ff6baed857e2…
schema_discovery 2026-11-12T03:54:30Z2026-11-17T03:24:12Z2
7
  • exists:dependency_tree
  • exists:table_classification
  • exists:schema_hash
  • dependency_tree:json_parses
  • table_classification:json_parses
  • schema_hash:file_nonempty
  • produces_paths_exist
schema_hash d311e2886763…
dependency_tree 77fe7001d873…
table_classification c75fa9c5e1a8…
admin_handbook 2026-11-12T04:03:55Z2026-11-17T03:24:19Z2
7
  • exists:admin_handbook
  • exists:api_map
  • admin_handbook:md_min_sections:10
  • admin_handbook:no_forbidden_placeholders
  • api_map:json_parses
  • produces_paths_exist
  • admin_handbook:command_transcripts_clean
api_map 87a4a1a5f7f8…
admin_handbook 478f5f2d4540…
db_handbook 2026-11-12T04:08:46Z2026-11-17T03:24:28Z2
8
  • exists:db_handbook
  • exists:seed_isolation
  • db_handbook:md_min_sections:5
  • db_handbook:no_forbidden_placeholders
  • seed_isolation:md_min_sections:1
  • seed_isolation:no_forbidden_placeholders
  • produces_paths_exist
  • db_handbook:command_transcripts_clean
db_handbook 8f78757d3374…
seed_isolation ece6e82a0623…
seed_data 2026-11-12T04:08:56Z2026-11-17T03:24:38Z2
6
  • exists:seed_data_sql
  • exists:seed_cases_json
  • seed_data_sql:sql_parses
  • seed_data_sql:no_forbidden_placeholders
  • seed_cases_json:json_parses
  • produces_paths_exist
seed_data_sql 4857e7c347b3…
seed_cases_json 2b92b5658639…
seed_validate 2026-11-12T04:08:59Z2026-11-17T03:24:41Z2
3
  • exists:seed_data_contract
  • seed_data_contract:json_parses
  • produces_paths_exist
seed_data_contract 87cfcc6a583e…
usecase_validate 2026-11-12T04:09:18Z2026-11-17T03:24:55Z2
10
  • exists:usecase_contract
  • exists:passed_tests
  • exists:failed_tests
  • exists:test_results
  • usecase_contract:json_parses
  • passed_tests:md_min_sections:1
  • failed_tests:md_min_sections:1
  • test_results:json_parses
  • produces_paths_exist
  • test_results:usecase_thresholds:80,70
failed_tests b2247b16f5f7…
passed_tests 3a3bcac803cd…
test_results 15471739faf0…
usecase_contract 7e61c87e7f56…
finalize_docs 2026-11-12T04:18:32Z2026-11-17T03:25:02Z2
9
  • exists:api_integration_guide
  • exists:release_notes
  • exists:defects_json
  • api_integration_guide:md_min_sections:3
  • api_integration_guide:no_forbidden_placeholders
  • release_notes:md_min_sections:3
  • release_notes:no_forbidden_placeholders
  • defects_json:json_parses
  • produces_paths_exist
defects_json 095c33dc78c3…
release_notes 1b586ca46fba…
api_integration_guide 8960b802b4c7…
package_archive invalidated 2026-11-17T13:44:14Z 2026-11-12T04:26:36Z2026-11-17T13:14:09Z16
37 (final gate PASS)
  • exists:checksums
  • exists:verify_md
  • exists:rebuild_md
  • exists:provenance_md
  • exists:manifest_txt
  • exists:assetchain_log_md
  • exists:assetchain_log_json
  • exists:actions_jsonl
  • exists:sale_tar
  • checksums:file_nonempty
  • verify_md:md_min_sections:2
  • verify_md:no_forbidden_placeholders
  • rebuild_md:md_min_sections:2
  • rebuild_md:no_forbidden_placeholders
  • provenance_md:md_min_sections:2
  • provenance_md:no_forbidden_placeholders
  • manifest_txt:file_nonempty
  • assetchain_log_md:md_min_sections:1
  • assetchain_log_json:json_parses
  • actions_jsonl:file_nonempty
  • sale_tar:file_nonempty
  • produces_paths_exist
  • G8 cosign
  • G8 scan_grade
  • G8 tag_base_os
  • G8 thread_exit
  • G8 vex_shipped
  • G8 cpu_baseline
  • G8 unpack_files
  • G8 scout_grade_a
  • G8 script_copies
  • G8 upgrade_check
  • G8 offline_rebuild
  • G8 rebuild_manifest
  • G8 artifact_coverage
  • G8 trademark_shipped
  • G8 assetchain_coverage
sale_tar b4a9faf2d325…
checksums 78413e447fb3…
verify_md 8fe13f9b1a9a…
rebuild_md d6ce62a63c06…
manifest_txt 2701fe526a93…
actions_jsonl f5d903fd523c…
provenance_md 0a46b8da75fb…
assetchain_log_md e9eccaec0c0f…
assetchain_log_json a2034570fe2b…

[stage_runs]

Rewinds

  • 2026-11-17T02:56:20Z: package_archive to assemble_kit on strategy_changed (strategy changed (df5dd72e9fe3 -> 5c368227267a)) [stage_events, stage_events #37355]
  • 2026-11-17T04:16:32Z: package_archive to package_archive on docs_redo (scripts/redo-docs.py --stage package_archive) [stage_events, stage_events #37612]
  • 2026-11-17T10:11:17Z: package_archive to package_archive on docs_redo (scripts/redo-docs.py --stage package_archive) [stage_events, stage_events #38384]
  • 2026-11-17T11:50:47Z: package_archive to package_archive on docs_redo (scripts/redo-docs.py --stage package_archive) [stage_events, stage_events #38516]
  • 2026-11-17T13:03:08Z: package_archive to package_archive on docs_redo (scripts/redo-docs.py --stage package_archive) [stage_events, stage_events #38632]
  • 2026-11-17T13:44:14Z: package_archive to package_archive on docs_redo (scripts/redo-docs.py --stage package_archive) [stage_events, stage_events #38713]

Model work per stage

Fully recorded

Role: writer model. Calls up to 2026-11-17T13:14:09Z.

211 calls over 6 stages

StageCallsRefusedErrorsMax attemptForced commitsReal tokensLesson rules shown
plan2001 08426 —
remediate2001 012110 L-A08, L-038, L-036, L-034, L-032
admin_handbook603003 10317753 L-A180, L-A181, L-A182, L-A183, L-A184, L-A155, L-A114, L-A25, L-A15, L-A14
db_handbook361303 3165004 L-A180, L-A181, L-A182, L-A183, L-A184, L-A114, L-A15
usecase_validate1001 01695 —
finalize_docs1105903 25599643 L-A180, L-A181, L-A182, L-A183, L-A184, L-A155, L-A114, L-A25, L-A15

[micro_step_runs] [lesson_recalls]

Review

Fully recorded

Role: review model.

5 rounds, 5 counted, $6.44 recorded cost

RoundStartedCriticalMajorMinorVerdictCostCap in forceArchive reviewed
12026-11-17T03:40:56Z 0715 findings to repackage [held_rounds, held_rounds #1919] $1.72 3 rounds, $40.00 915ab7261262…
22026-11-17T09:41:32Z 029 findings to repackage [held_rounds, held_rounds #1947] $1.09 3 rounds, $40.00 97e6b8ec29bf…
32026-11-17T10:38:24Z 0010 clean to repackage [held_rounds, held_rounds #1960] $1.31 3 rounds, $40.00 a0a8c759aa00…
42026-11-17T12:20:47Z 005 clean to repackage [held_rounds, held_rounds #1972] $1.25 3 rounds, $40.00 89503162d4d3…
52026-11-17T13:14:46Z 004 clean to publish [held_rounds, held_rounds #1978] $1.07 3 rounds, $40.00 b4a9faf2d325…

Defects

Fully recorded
  • Ledger entries53 [defects, defects where product_slug=prometheus and this tag or chain]
  • Disclosed in the archive53 [docs/defects/defects.json, entries]

53 ledger entries: by severity high 10, low 43; by status open 1, fixed-before-release 52.

DefectSeverityStatusFound byFixed in
RSD-prometheus-dcb0d83ede
Unauthenticated access by default [defects, defects #256869]
highopenbuild strategy record—
RSD-prometheus-60759ed682
Docker Hub README: Says the kit is free (also line 15 'free with an account'); the shipped bundle/MANIFEST.json prices it and marks the release not free. [defects, defects #289113]
lowfixed-before-releaseheld review (review model)—
RSD-prometheus-e4fee44f51
Admin handbook: Ran the line's tr set on bcrypt hashes: tr -d ':\\n' (as written on line 984) deletes ':', backslash AND the letter 'n', so any hash containing 'n' is cut (59 chars instead of 60); promtool check… [defects, defects #292269]
highfixed-before-releaseheld review (review model)—
RSD-prometheus-24743c6cc9
Admin handbook: Ran line 595 on the held image with web.yml in the mounted dir: container went 'unhealthy'; health log ExitCode 1, Output 'usage: rs-probe [-k] [-cert FILE -key FILE] [-body|-code]… [defects, defects #292270]
highfixed-before-releaseheld review (review model)—
RSD-prometheus-d72d874a56
Admin handbook: Same run as line 595: the shown override leaves the container unhealthy (rs-probe usage error), so 'allows Docker's own healthcheck to pass without authentication' is false for the command above it. [defects, defects #292271]
highfixed-before-releaseheld review (review model)—
RSD-prometheus-c20f2a25aa
Admin handbook: Contradicts lines 153/161. [defects, defects #292272]
lowfixed-before-releaseheld review (review model)—
RSD-prometheus-06cdb00b6b
Admin handbook: Ran the procedure (prom-config mounted :ro at /etc/prometheus plus prom-rules at /etc/prometheus/rules:ro, no prom-config/rules directory): docker run failed 'error mounting ... [defects, defects #292273]
highfixed-before-releaseheld review (review model)—
RSD-prometheus-4c0f73631b
Admin handbook: Measured: docker run ... IMAGE --web.enable-admin-api --web.enable-lifecycle -> POST /api/v1/admin/tsdb/snapshot returned status success and POST /-/reload 200. No rebuild is needed and docker exec… [defects, defects #292274]
lowfixed-before-releaseheld review (review model)—
RSD-prometheus-7d731c9f20
Admin handbook: Generated the certificate exactly as written (CN only, no subjectAltName) and used it per lines 1195-1206 (scheme https, ca_file cert.pem, target localhost:9090): /api/v1/targets shows health down,… [defects, defects #292275]
highfixed-before-releaseheld review (review model)—
RSD-prometheus-f78aacd5b0
Admin handbook: Measured with the line-1180 certificate: curl --cacert cert.pem https://localhost:PORT/-/healthy exits 60 (certificate verify failed); the same against https://127.0.0.1 prints 'Prometheus Server is… [defects, defects #292276]
lowfixed-before-releaseheld review (review model)—
RSD-prometheus-0c4732b268
Database handbook: The image has no curl (provenance/IMAGE_BINARIES.txt: only prometheus, promtool, rs-probe and coreutils) and the docker flag is --health-cmd with two dashes; the working override is the rs-probe… [defects, defects #292277]
highfixed-before-releaseheld review (review model)—
RSD-prometheus-782537b5bc
Database handbook: The start command (line 248) uses --name prometheus; `nobody` is the runtime user (docs audit flagged this area). [defects, defects #292278]
lowfixed-before-releaseheld review (review model)—
RSD-prometheus-c0e6cc14c8
Database handbook: Contradicts lines 127, 384 and 414 (arguments after the image name are added; --web.config.file is the documented way to enable authentication). [defects, defects #292279]
lowfixed-before-releaseheld review (review model)—
RSD-prometheus-24543b0cb8
Database handbook: 'atomic from the perspective of query consistency ... [defects, defects #292280]
lowfixed-before-releaseheld review (review model)—
RSD-prometheus-3a2d982ccf
Database handbook: BASES.tsv in the kit: golang:1.26.11-bookworm@sha256:dc40a13b... [defects, defects #292281]
lowfixed-before-releaseheld review (review model)—
RSD-prometheus-d26393a527
Database handbook: Contradicts the Data and backups facts: the TSDB under /prometheus holds all state and needs a named volume; the container is not stateless. [defects, defects #292282]
lowfixed-before-releaseheld review (review model)—
RSD-prometheus-76256ca3c7
API guide: docker run --entrypoint cat IMAGE /etc/passwd shows 'nobody:*:65534:65534:nobody:/nonexistent:/usr/sbin/nologin' and /etc/group has 'nogroup:*:65534:'; the guide's own Container Identity section… [defects, defects #292283]
lowfixed-before-releaseheld review (review model)—
RSD-prometheus-99f8cf3f03
API guide: Measured: curl -X POST -d 'query=up' /api/v1/query returns 200 with the vector result. [defects, defects #292284]
lowfixed-before-releaseheld review (review model)—
RSD-prometheus-361bb4a241
API guide: 'mode 600 required' inverts the cause: handbook lines 149/153 and this guide's own TLS text say a host-owned key at mode 600 is what stops Prometheus with 'permission denied'; the key must be… [defects, defects #292285]
highfixed-before-releaseheld review (review model)—
RSD-prometheus-77c09624bf
API guide: Only /-/healthy is listed under the sentence. [defects, defects #292286]
lowfixed-before-releaseheld review (review model)—
RSD-prometheus-999dea0f2e
API guide: Contradicts this guide's Volume Mounting text and admin handbook line 165: a host-created directory at default permissions fails with exit code 1. [defects, defects #292287]
lowfixed-before-releaseheld review (review model)—
RSD-prometheus-92fe06d3e6
API guide: Contradicts the guide's own Adding Basic Authentication procedure and the Running Custom Programs section, which append --web.config.file after the image name. [defects, defects #292288]
lowfixed-before-releaseheld review (review model)—
RSD-prometheus-b80c73eee8
Admin handbook: The paragraph says a reload 'whether by SIGHUP or restart' reads the old file, then that the old behaviour lasts only 'until you perform a full docker restart'; it also names 'the old basic-auth… [defects, defects #292289]
lowfixed-before-releaseheld review (review model)—
RSD-prometheus-fa685f7602
Admin handbook: prom-data is a named volume: there is no host path /path/to/prom-data, and the image has no du (IMAGE_BINARIES.txt). [defects, defects #292290]
lowfixed-before-releaseheld review (review model)—
RSD-prometheus-eac32da91e
Admin handbook: The 'keep both files in prom-config' command enables basic authentication without the --health-cmd override that every other basic-auth command and lines 149/161 require; the container is reported… [defects, defects #306922]
highfixed-before-releaseheld review (review model)—
RSD-prometheus-7e7e5e387f
API guide: The docker run block that follows (lines 850-856) enables basic authentication with no --health-cmd override and the sentence does not mention one, so the container is reported unhealthy. [defects, defects #306923]
highfixed-before-releaseheld review (review model)—
RSD-prometheus-808953fba4
API guide: The example path given for cert_file/key_file is the web.yml path itself. [defects, defects #306924]
lowfixed-before-releaseheld review (review model)—
RSD-prometheus-574ffa2c80
API guide: Attributes readiness semantics to /-/healthy; contradicts lines 1108 and 1314 of this guide and DB handbook line 698 (healthy is liveness only, 'regardless of whether the TSDB is ready'). [defects, defects #306925]
lowfixed-before-releaseheld review (review model)—
RSD-prometheus-bb134e7ea3
API guide: Methods table lists only GET for /api/v1/query while line 1122 says it also accepts POST (r1 measured POST 200 with the vector result). [defects, defects #306926]
lowfixed-before-releaseheld review (review model)—
RSD-prometheus-67929389cb
API guide: Says unauthenticated users get 'administrative operations', contradicting line 436 and the Operating facts (admin API and /-/reload, /-/quit are off). [defects, defects #306927]
lowfixed-before-releaseheld review (review model)—
RSD-prometheus-a341d6182b
Admin handbook: The worked figure is shown by no record and contradicts its own formula: 10,000 x 1,296,000 s = 1.3e10 samples; dividing by a 'compression ratio' is not the formula; at 1-2 bytes per sample this is… [defects, defects #306928]
lowfixed-before-releaseheld review (review model)—
RSD-prometheus-39d12211a8
Admin handbook: 'Corrupting the dataset' is shown by no record and contradicts lines 165/517 (the extra blocks stay queryable). [defects, defects #306929]
lowfixed-before-releaseheld review (review model)—
RSD-prometheus-7adb3c6180
Admin handbook: A cross-release compatibility guarantee no record shows (only the v3.16.0 -> v3.16.0 rebuild is documented in RELEASE_NOTES). [defects, defects #306930]
lowfixed-before-releaseheld review (review model)—
RSD-prometheus-7df1105be8
Database handbook: False: the -i is not needed for -c to run, and with -i the shell prints a job-control warning. [defects, defects #306931]
lowfixed-before-releaseheld review (review model)—
RSD-prometheus-ca45184d64
Database handbook: Advises a host directory/volume, contradicting lines 143, 471 and 475 (a host directory owned by the user makes Prometheus exit with exit code 1). [defects, defects #306932]
lowfixed-before-releaseheld review (review model)—
RSD-prometheus-a0b9e4fff3
API guide: The --health-cmd override only replaces the container HEALTHCHECK (IMAGE_CONFIG.json Healthcheck); the self-scrape 401 comes from basic authentication covering /metrics. [defects, defects #313116]
lowfixed-before-releaseheld review (review model)—
RSD-prometheus-0b04d61f06
API guide: Ran the command that follows (prom-config only, web.yml and prometheus.yml inside it, no web subdirectory) with --web.config.file=/etc/prometheus/web.yml: container healthy, 401 without password,… [defects, defects #313117]
lowfixed-before-releaseheld review (review model)—
RSD-prometheus-ffd23a88b7
API guide: Same live run as the previous item: the docker run printed under this sentence starts without prom-config/web. [defects, defects #313118]
lowfixed-before-releaseheld review (review model)—
RSD-prometheus-7fa6487dce
API guide: Contradicts the guide's own commands: `docker run --rm --entrypoint promtool ... [defects, defects #313119]
lowfixed-before-releaseheld review (review model)—
RSD-prometheus-9bf0786adc
Admin handbook: Contradicts line 600 of the same guide ('a SIGHUP reload is for prometheus.yml only') and Operating facts. [defects, defects #313120]
lowfixed-before-releaseheld review (review model)—
RSD-prometheus-6d98ecaba2
Admin handbook: Ran the section's sequence: `docker rm prometheus` on a running container fails (`cannot remove container ... [defects, defects #313121]
lowfixed-before-releaseheld review (review model)—
RSD-prometheus-b5c867c9f6
Database handbook: The block under it starts with `docker rm prometheus`: ran against a running container, it fails with 'container is running: stop the container before removing or force remove', and the following… [defects, defects #313122]
lowfixed-before-releaseheld review (review model)—
RSD-prometheus-25c9a26e8f
Database handbook: Contradicts line 433 two paragraphs up (with -c the shell runs and exits whether or not -i is given). [defects, defects #313123]
lowfixed-before-releaseheld review (review model)—
RSD-prometheus-8380e08aaa
Database handbook: Ran the alpine command below this sentence: into a NEW empty volume it restores (3 samples back, healthy), but `docker volume create prom-data` is a no-op on an existing volume, so the tar then adds… [defects, defects #313124]
lowfixed-before-releaseheld review (review model)—
RSD-prometheus-ab4f6cd769
Database handbook: Contradicts line 698 of this handbook ('liveness check only and does not indicate whether the TSDB is ready') and API guide line 199; ran /-/ready -> `Prometheus Server is Ready.` [defects, defects #313125]
lowfixed-before-releaseheld review (review model)—
RSD-prometheus-f88b37afcf
Admin handbook: The block still starts with a plain `docker rm`, which refuses a running container; the sentence above it says to use `docker rm -f`. [defects, defects #318555]
lowfixed-before-releaseheld review (review model)—
RSD-prometheus-8d01f0e3cf
Admin handbook: Contradicts the next sentences of the same paragraph (`a docker restart picks up the edited file`). [defects, defects #318556]
lowfixed-before-releaseheld review (review model)—
RSD-prometheus-58d18be9ba
API guide: Contradicts line 199 and line 1117 of the same guide, which send readers to `/-/ready`. [defects, defects #318557]
lowfixed-before-releaseheld review (review model)—
RSD-prometheus-5ba40bc5ee
Database handbook: Operating facts (lines 145-147) lists only GET /-/healthy; /-/ready is documented in the Health Check section (line 312). [defects, defects #318558]
lowfixed-before-releaseheld review (review model)—
RSD-prometheus-e20958f6a7
Admin handbook: Ran the release image with a bad web.yml and a mode-600 rule file: every error line reads `level=ERROR source=main.go:1286 msg="Unable to validate web configuration file"`; a case-sensitive grep for… [defects, defects #320779]
lowfixed-before-releaseheld review (review model)—
RSD-prometheus-b9e7abd6d2
Admin handbook: Started the image, sent 3 /api/v1/query requests, waited 20 s: `docker logs` holds only startup, TSDB/WAL and config-load lines; no ingestion or query-activity lines. [defects, defects #320780]
lowfixed-before-releaseheld review (review model)—
RSD-prometheus-18df15b802
Admin handbook: The step list above ends with `docker start prometheus`, so the czf command that follows runs against a running container, while the section says to back up with the container stopped. [defects, defects #320781]
lowfixed-before-releaseheld review (review model)—
RSD-prometheus-00ebc73a41
Database handbook: The preceding block already ends with `docker start prometheus`; the czf command that follows has no stop, against the stated rule that backups are taken with the container stopped. [defects, defects #320782]
lowfixed-before-releaseheld review (review model)—

Verification

1 item not recorded
  • Reproduced before publishingyes (rebuilt digest sha256:2bd24488db7b256a90d64def262830c9aadfed0bb341022ea506b86ff3330efd · published digest sha256:2bd24488db7b256a90d64def262830c9aadfed0bb341022ea506b86ff3330efd · digest match yes · builder moby/buildkit:v0.31.2 · build seconds 367) [docs/provenance/REPRO_VERIFICATION.json, verified]
  • Final contract gate (G8)PASS (checks artifact_coverage, assetchain_coverage, cosign, cpu_baseline, offline_rebuild, rebuild_manifest, scan_grade, scout_grade_a, script_copies, tag_base_os, thread_exit, trademark_shipped, unpack_files, upgrade_check, vex_shipped) [g8_result.json, result]
  • Grade at releaseA (percent 94 · tool docker scout policy 1.26.0 · config docker-default · org vex no · at 2026-11-17T13:45:01Z · failing Docker Scout counts 11 packages with copyleft licences (GPL, LGPL, MPL), all of them operating-system packages (it counts only packages whose licence it can read; the SBOM lists every component).) [SCOUT_EVIDENCE.json, docker_scout_policy]
  • Image signatureverified on the index and the linux/amd64 manifest (key fingerprint 04daa92344a52dbc · at 2026-11-17T13:44:48Z) [docs/provenance/IMAGE_EVIDENCE.json, signed]
  • Image signature transparency-log entries [deliverables/provenance/PROMOTION_RECORD.json, sign_stdout_tail]
  • rebuild.json signatureSigstore bundle, release key (key fingerprint 04daa92344a52dbc · log index 3946348336 · transparency-log entry · integrated 2026-11-17T13:51:23Z) [ReadyStack-prometheus-v3.16.0-CE-ubuntu24.04-r3.rebuild.json.sigstore, verificationMaterial.tlogEntries[0]]
  • Signed attestations
    • kind provenance · digest sha256:f65b74122b60be02a63a5c709ddbc71a940aad501d0a5a375d232b26ef35136a · state attached · log index 3946351879 · transparency-log entry
    • kind sbom · digest sha256:f65b74122b60be02a63a5c709ddbc71a940aad501d0a5a375d232b26ef35136a · state attached · log index 3946352619 · transparency-log entry
    • kind vsa · digest sha256:f65b74122b60be02a63a5c709ddbc71a940aad501d0a5a375d232b26ef35136a · state attached · log index 3946352899 · transparency-log entry
    • kind provenance · digest sha256:2bd24488db7b256a90d64def262830c9aadfed0bb341022ea506b86ff3330efd · state attached · log index 3946353401 · transparency-log entry
    • kind sbom · digest sha256:2bd24488db7b256a90d64def262830c9aadfed0bb341022ea506b86ff3330efd · state attached · log index 3946354455 · transparency-log entry
    • kind vsa · digest sha256:2bd24488db7b256a90d64def262830c9aadfed0bb341022ea506b86ff3330efd · state attached · log index 3946355650 · transparency-log entry
    (at 2026-11-17T13:51:24Z) [attestations.json, results]
  • Pins recorddocs/PINS.md and docs/provenance/PINS.json in the archive (https://readystack.dev/products/prometheus/recipe) [docs/provenance/PINS.json]

Offline clean-room rebuilds

  • 2026-11-17T03:41:02Z on build host 3 (Docker-in-Docker daemon with --network none): bit for bit yes, digest match yes, customer verify yes
    rebuilt sha256:2bd24488db7b256a90d64def262830c9aadfed0bb341022ea506b86ff3330efd [clean-room rebuild ledger, runs[861]]
  • Not recorded: the policy tool's --result-file itself (its per-policy results are copied into SCOUT_EVIDENCE.json and the archive's IMAGE_EVIDENCE.json; the file is not kept)

Publication

Fully recorded 1 pending at generation
  • Image pushed (internal tag), publish_image passed2026-11-17T03:23:45Z [stage_runs, stage_runs chain 999 stage publish_image]
  • Archive manifests written2026-11-17T13:48:12Z [PUBLISH_MANIFEST.json, published_at]
  • Pending at generation: the archive cut-over on prodasset, the release tag's promotion and the site event (this trail was generated after G8 and before them; they are appended as a 'publication' event in History)

Packages and CPU level

Fully recorded
  • x86-64 level the image needsv1 (used v4 · baseline v2 · elf files 63 · probed 2026-11-17T03:15:56Z · source build_kit) [release_images, isa_level_hard]

History

2 events
  • 2026-11-17T13:53:21Z generated: by KitForge release/build_trail.py · generator commit db91d6a75ba426dda271c268024ff89c6c0dd1c7
  • 2026-11-17T13:55:38Z publication: promoted at 2026-11-17T13:54:04Z · promoted digest sha256:f65b74122b60be02a63a5c709ddbc71a940aad501d0a5a375d232b26ef35136a · promotion method imagetools_create_retag_by_digest_no_rebuild · site event 589 · checklist status complete · checklist at 2026-11-17T13:55:38Z · record workspace: deliverables/provenance/PROMOTION_RECORD.json, RELEASE_CHECKLIST.json

Records

25 records
RecordWhere it isRows
docs/defects/defects.jsoninside the archive (ReadyStack-prometheus-v3.16.0-CE-ubuntu24.04-r3.tar.gz)—
docs/provenance/IMAGE_EVIDENCE.jsoninside the archive (ReadyStack-prometheus-v3.16.0-CE-ubuntu24.04-r3.tar.gz)—
docs/provenance/LOCKED_DIGEST.txtinside the archive (ReadyStack-prometheus-v3.16.0-CE-ubuntu24.04-r3.tar.gz)—
docs/provenance/PINS.jsoninside the archive (ReadyStack-prometheus-v3.16.0-CE-ubuntu24.04-r3.tar.gz)—
docs/provenance/REPRO_VERIFICATION.jsoninside the archive (ReadyStack-prometheus-v3.16.0-CE-ubuntu24.04-r3.tar.gz)—
docs/provenance/SOURCE_TREE_HASH.jsoninside the archive (ReadyStack-prometheus-v3.16.0-CE-ubuntu24.04-r3.tar.gz)—
MANIFEST.jsonbeside the archive (prodasset /data/production/prometheus/v3.16.0-CE-ubuntu24.04-r3/), as staged for publishing—
PUBLISH_MANIFEST.jsonbeside the archive (prodasset /data/production/prometheus/v3.16.0-CE-ubuntu24.04-r3/), as staged for publishing—
ReadyStack-prometheus-v3.16.0-CE-ubuntu24.04-r3.rebuild.jsonbeside the archive (prodasset /data/production/prometheus/v3.16.0-CE-ubuntu24.04-r3/), as staged for publishing—
ReadyStack-prometheus-v3.16.0-CE-ubuntu24.04-r3.rebuild.json.sigstorebeside the archive (prodasset /data/production/prometheus/v3.16.0-CE-ubuntu24.04-r3/), as staged for publishing—
SCOUT_EVIDENCE.jsonbeside the archive (prodasset /data/production/prometheus/v3.16.0-CE-ubuntu24.04-r3/), as staged for publishing—
clean-room rebuild ledgerthe clean-room rebuild ledger (runstate/audit-2026-09/bit4bit.json, not published)—
build_requestssadb, ReadyStack's engine database (not published)713
chainssadb, ReadyStack's engine database (not published)999
defectssadb, ReadyStack's engine database (not published)prometheus v3.16.0-CE-ubuntu24.04-r3
drive_runssadb, ReadyStack's engine database (not published)chain 999
held_roundssadb, ReadyStack's engine database (not published)chain 999
lesson_recallssadb, ReadyStack's engine database (not published)chain 999
micro_step_runssadb, ReadyStack's engine database (not published)chain 999
release_imagessadb, ReadyStack's engine database (not published)prometheus v3.16.0-CE-ubuntu24.04-r3
stage_eventssadb, ReadyStack's engine database (not published)chain 999
stage_runssadb, ReadyStack's engine database (not published)chain 999
attestations.jsonthe chain's workspace on the controller (not published)—
deliverables/provenance/PROMOTION_RECORD.jsonthe chain's workspace on the controller (not published)—
g8_result.jsonthe chain's workspace on the controller (not published)—