Tempo v3.1.1-CE-ubuntu24.04-r6 build trail

How ReadyStack built readystack/tempo:v3.1.1-CE-ubuntu24.04-r6 and its build kit, copied record by record: why the release exists, every chain, drive and stage it went through, the model work, the review rounds, the defects, the checks that verified it and when it was published. Each line names the record it comes from in brackets; a record that does not exist for this release says so.

This trail

As JSON
  • Imagereadystack/tempo:v3.1.1-CE-ubuntu24.04-r6
  • Index digestsha256:84860e3304e5268942666a1bed081f5c415c351d20589cf14e0085a63f90adb1
  • linux/amd64 digestsha256:ce5698404a6423c554a94c2f99d6c538b60b5d32237380748bd5edee55b1402c
  • ArchiveReadyStack-tempo-v3.1.1-CE-ubuntu24.04-r6.tar.gz
  • Archive SHA-256 now688add0c619243f104e0c2ac14d7e2190f567da3bb5c93c85ba93b4f49bae1ad
  • Pins recorddocs/PINS.md, docs/provenance/PINS.json in the archive (since generated)
  • Generated2026-11-17T20:47:24Z by KitForge release/build_trail.py
  • Sections9 sections, 8 fully recorded; 1 item not recorded

Signed with the release key The trail's signature is a Sigstore bundle beside it. Check it is ours before you rely on it:

cosign verify-blob --key https://readystack.dev/keys/cosign.pub \
  --bundle ReadyStack-tempo-v3.1.1-CE-ubuntu24.04-r6.trail.json.sigstore ReadyStack-tempo-v3.1.1-CE-ubuntu24.04-r6.trail.json

IdentityWhy this release existsThe path through the harnessModel work per stageReviewDefectsVerificationPublicationPackages and CPU level

Identity

Fully recorded
  • ProductTempo (tempo) [MANIFEST.json]
  • Release tagv3.1.1-CE-ubuntu24.04-r6 [MANIFEST.json]
  • Imagereadystack/tempo:v3.1.1-CE-ubuntu24.04-r6 [MANIFEST.json]
  • Image index digestsha256:84860e3304e5268942666a1bed081f5c415c351d20589cf14e0085a63f90adb1 [docs/provenance/LOCKED_DIGEST.txt]
  • linux/amd64 image digestsha256:ce5698404a6423c554a94c2f99d6c538b60b5d32237380748bd5edee55b1402c [ReadyStack-tempo-v3.1.1-CE-ubuntu24.04-r6.rebuild.json, subject.image_manifest_digest]
  • ArchiveReadyStack-tempo-v3.1.1-CE-ubuntu24.04-r6.tar.gz (bytes 525076088) [MANIFEST.json]
  • Archive sha256 at publish688add0c619243f104e0c2ac14d7e2190f567da3bb5c93c85ba93b4f49bae1ad [MANIFEST.json, tarball_sha256]
  • Archive records agreeyes [MANIFEST.json, PUBLISH_MANIFEST.json and .cutover.json name the same sha256]
  • Repack historynone: the archive is as first published [MANIFEST.json, repack_history]
  • Upstream repositoryhttps://github.com/grafana/tempo [docs/provenance/SOURCE_TREE_HASH.json]
  • Upstream refv3.1.1 [docs/provenance/SOURCE_TREE_HASH.json]
  • Upstream commit9db7df79d2af105a90d96484e6403e1fda0d011e [docs/provenance/SOURCE_TREE_HASH.json]
  • Source tree hashb564f0e22361849b102298712e20b1b23f7c5efe890d4c83d6b4c7f97b0ca113 (files 15740) [docs/provenance/SOURCE_TREE_HASH.json, tree_listing_sha256 (sha256 of the sorted file listing)]
  • Kit tree hashsha256:4a511fd156df93048a0380ef4498b1b23ab7f6e1e5b7e5e029115bdcf18c3256 [ReadyStack-tempo-v3.1.1-CE-ubuntu24.04-r6.rebuild.json, inputs.tree_hash]
  • SOURCE_DATE_EPOCH1794448359 (utc 2026-11-12T01:52:39Z) [ReadyStack-tempo-v3.1.1-CE-ubuntu24.04-r6.rebuild.json, inputs.source_date_epoch]
  • Base images
    • ref golang:1.27.4-bookworm@sha256:4fa7c968ba93f1635670522dbb01a2c78150443e1385746924566079f36570ea · platform digest sha256:fb7cceb528b47141eccd9b60bf3cbd27d5ef5f8cf5b7d338bec866da495b50dc
    • ref ubuntu:24.04@sha256:2198e4c65076e9cb0b3d695219df667c0e3b0072da64ca3c2648aca17dcecaf5 · platform digest sha256:77eb101c607d6e3d4f5ad0c8a02c2136c689b98aba1f359e6502ba517e5c57ec
    [ReadyStack-tempo-v3.1.1-CE-ubuntu24.04-r6.rebuild.json, bases]
  • BuildKitmoby/buildkit:v0.31.2 (image digest sha256:e0e67ea9c4bb07bdef683e29f70f3b623d1eb9c82274a9ec04e6bb0511449fb0) [ReadyStack-tempo-v3.1.1-CE-ubuntu24.04-r6.rebuild.json, engine]
  • Engine commit(s)
    • commit a8f9a7a13a5afbd6dd0df0a91e7d0fbee76954b4 · dirty yes · first drive 4497
    • commit 9fbb11db49b78b1c9773ff98e21edb0a8de90a60 · dirty yes · first drive 4664
    • commit 05c87c23872ce04b9d972bd7bf4e8eea622baa25 · dirty yes · first drive 4717
    • commit 255078008310f57e4d6fd7fac63cd7321ca95291 · dirty yes · first drive 4729
    • commit 84a0cbf0a5cd002b805a37ce762a8d02ebaaee94 · dirty yes · first drive 4785
    • commit 7f92f870f8fc219071f0269aa59fcc0347fd3a82 · dirty yes · first drive 4813
    • commit f92b20fcf040c69e68aa34c6f6bd1f26304a4c97 · dirty yes · first drive 4832
    • commit 9d1de92d9575fa14ce78c348ec5f52f258b2efe0 · dirty yes · first drive 4849
    • commit 27137417630c89ffaea23916b4ee6228c4b60de5 · dirty yes · first drive 4852
    • commit 393ea117781b956f92c2a4a4a6d84c1485ac2b61 · dirty yes · first drive 4858
    • commit 0aa760f5d92b1db30763493eb840b973c999897f · dirty yes · first drive 4870
    • commit e1afed5f6d31df5d6f6e1da2348049b7ea2b62a4 · dirty yes · first drive 4880
    [drive_runs, engine_sha]

Why this release exists

Fully recorded
  • Chain1044 (created 2026-11-12T22:38:42Z · trigger customer_request · upstream version v3.1.1) [chains, chains #1044]
  • Requestbuild request #721 (rebuild) (requested at 2026-11-12T01:52:40Z · requested by kitforge-agent · version v3.1.1) [build_requests, build_requests #721]
  • Reasonrevision v3.1.1-CE-ubuntu24.04-r6: same upstream version rebuilt (retarget.py --rev-bump) [build_requests, build_requests #721 request_reason]
  • Supersedesreadystack/tempo:v3.1.1-CE-ubuntu24.04-r5 (chain 930) [chains, chains #930]

The path through the harness

Fully recorded

1 chain · 12 drives · 18 stages · 4 rewinds

Chain 1044 release · ready_to_ship

Created 2026-11-12T22:38:42Z, upstream v3.1.1, build request 721 [chains, chains #1044]

DriveStartedMinutesBuild hostHow it stopped
44972026-11-12T22:39:13Z44.5build host 3 withhold-publish stage_failed at package_archive; first failed check exists:checksums; 18 ticks [drive_runs, drive_runs #4497]
46642026-11-15T08:08:15Z1.4build host 3 withhold-publish stage_failed at package_archive; first failed check exists:checksums; 1 tick [drive_runs, drive_runs #4664]
47172026-11-17T06:14:26Z1.8build host 3 withhold-publish stage_failed at package_archive; first failed check exists:checksums; 1 tick [drive_runs, drive_runs #4717]
47292026-11-17T07:24:37Z1.1build host 3 withhold-publish stage_failed at package_archive; first failed check exists:checksums; 1 tick [drive_runs, drive_runs #4729]
47852026-11-17T11:25:50Z10.6build host 3 withhold-publish ready_to_ship at package_archive; 2 ticks [drive_runs, drive_runs #4785]
48132026-11-17T13:03:14Z2.3build host 3 withhold-publish stage_failed at package_archive; first failed check g8; 1 tick [drive_runs, drive_runs #4813]
48322026-11-17T15:36:09Z1.8build host 3 withhold-publish stage_failed at package_archive; first failed check g8; 1 tick [drive_runs, drive_runs #4832]
48492026-11-17T17:59:30Z1.8build host 3 withhold-publish stage_failed at package_archive; first failed check g8; 1 tick [drive_runs, drive_runs #4849]
48522026-11-17T18:06:11Z4.8build host 3 withhold-publish ready_to_ship at package_archive; 2 ticks [drive_runs, drive_runs #4852]
48582026-11-17T18:40:56Z5.1build host 3 withhold-publish ready_to_ship at package_archive; 2 ticks [drive_runs, drive_runs #4858]
48702026-11-17T19:46:43Z5.1build host 3 withhold-publish ready_to_ship at package_archive; 2 ticks [drive_runs, drive_runs #4870]
48802026-11-17T20:40:59Z—build host 3 publish-held not recorded [drive_runs, drive_runs #4880]

Stages, in order

StageFirst startPassedAttemptsGate checks passedArtifacts (SHA-256)
intake 2026-11-12T22:39:23Z2026-11-12T22:39:24Z1
4
  • exists:order_json
  • order_json:json_parses
  • order_json:no_forbidden_placeholders
  • produces_paths_exist
order_json e846f36bc50d…
acquire 2026-11-12T22:39:32Z2026-11-12T22:39:34Z1
12
  • exists:source_tree
  • exists:source_tree_hash
  • exists:source_file_manifest
  • exists:custody_inputs
  • exists:license_file
  • source_tree:dir_nonempty
  • source_tree_hash:json_parses
  • source_file_manifest:json_parses
  • custody_inputs:json_parses
  • license_file:file_nonempty
  • produces_paths_exist
  • custody_inputs:json_true:ce_audit.ce_only
source_tree bad9747f4984…
license_file 0d96a4ff68ad…
custody_inputs f1b2c2a9dd5f…
source_tree_hash b9ffa483bfb9…
source_file_manifest 05deabc29605…
plan 2026-11-12T22:40:04Z2026-11-12T22:40:05Z1
10
  • exists:recon_report
  • exists:input_pin_plan
  • exists:toolchain_lock
  • recon_report:md_min_sections:3
  • recon_report:no_forbidden_placeholders
  • input_pin_plan:md_min_sections:2
  • input_pin_plan:no_forbidden_placeholders
  • toolchain_lock:file_nonempty
  • toolchain_lock:no_forbidden_placeholders
  • produces_paths_exist
recon_report 29118478b50c…
input_pin_plan 28dfcca44290…
toolchain_lock e808711545be…
assemble_kit 2026-11-12T22:46:46Z2026-11-12T22:46:47Z1
27
  • exists:dockerfile
  • exists:base_image_digests
  • exists:system_pinning
  • exists:build_recipe
  • exists:first_build_digest
  • exists:first_boot_health
  • exists:dockerfile_offline
  • exists:verify_offline_sh
  • exists:build_offline_sh
  • exists:generate_sbom_sh
  • dockerfile:file_nonempty
  • dockerfile:no_forbidden_placeholders
  • base_image_digests:file_nonempty
  • system_pinning:file_nonempty
  • build_recipe:json_parses
  • first_build_digest:file_nonempty
  • first_boot_health:file_nonempty
  • dockerfile_offline:file_nonempty
  • dockerfile_offline:no_forbidden_placeholders
  • verify_offline_sh:file_nonempty
  • verify_offline_sh:no_forbidden_placeholders
  • build_offline_sh:file_nonempty
  • build_offline_sh:no_forbidden_placeholders
  • generate_sbom_sh:file_nonempty
  • generate_sbom_sh:no_forbidden_placeholders
  • produces_paths_exist
  • first_boot_health:file_contains:healthy=True
dockerfile bd6b5b14009a…
build_recipe 54ddcd1595a0…
system_pinning aa8db05a9a8a…
build_offline_sh 6ab4f08a6ec7…
generate_sbom_sh ce0f1e6f1e70…
first_boot_health d006c2fe3795…
verify_offline_sh 3e8184ea230c…
base_image_digests 1ba63690c377…
dockerfile_offline bd6b5b14009a…
first_build_digest f699e28a0d6b…
remediate 2026-11-12T22:47:18Z2026-11-12T22:47:18Z1
8
  • exists:vendored_apt
  • exists:remediation_log
  • exists:security_report
  • vendored_apt:dir_exists
  • remediation_log:json_parses
  • security_report:md_min_sections:2
  • security_report:no_forbidden_placeholders
  • produces_paths_exist
vendored_apt e3b0c44298fc…
remediation_log f9e1413a315d…
security_report 1a14b9f807d7…
build_kit 2026-11-12T22:57:32Z2026-11-12T22:57:33Z1
9
  • exists:freeze_manifest
  • exists:locked_digest
  • exists:cosign_stamp
  • exists:offline_rebuild_transcript
  • freeze_manifest:json_parses
  • locked_digest:file_nonempty
  • cosign_stamp:file_nonempty
  • offline_rebuild_transcript:json_parses
  • produces_paths_exist
cosign_stamp d9fb39c04daf…
locked_digest cdbda98f7a2c…
freeze_manifest ae3da6c400c2…
offline_rebuild_transcript 925927730ffe…
verdict 2026-11-12T22:58:21Z2026-11-12T22:58:22Z1
8
  • exists:scout_verdict
  • scout_verdict:json_parses
  • produces_paths_exist
  • scout_verdict:release_check_passed
  • scout_verdict:nonroot_green
  • scout_verdict:zero_fixable_crit_high
  • scout_verdict:osv_clean
  • scout_verdict:no_baked_secrets
scout_verdict 8fd7e99e06c7…
publish_image 2026-11-12T22:58:57Z2026-11-12T22:58:58Z1
7
  • exists:promotion_record
  • exists:hub_readme
  • promotion_record:json_parses
  • hub_readme:md_min_sections:2
  • hub_readme:no_forbidden_placeholders
  • produces_paths_exist
  • promotion_record:json_true:signed
hub_readme 31106d799337…
promotion_record e1416fa8f894…
boot_instance 2026-11-12T22:59:04Z2026-11-12T22:59:10Z2
3
  • exists:instance_handle
  • instance_handle:json_parses
  • produces_paths_exist
instance_handle a2cbcb080f4d…
sbom 2026-11-12T22:59:23Z2026-11-12T22:59:24Z1
5
  • exists:sbom_json
  • exists:sbom_md
  • sbom_json:json_parses
  • sbom_md:md_min_sections:1
  • produces_paths_exist
sbom_md cac216cb5076…
sbom_json 7e1d9e555410…
schema_discovery 2026-11-12T22:59:27Z2026-11-12T22:59:27Z1
7
  • exists:dependency_tree
  • exists:table_classification
  • exists:schema_hash
  • dependency_tree:json_parses
  • table_classification:json_parses
  • schema_hash:file_nonempty
  • produces_paths_exist
schema_hash ac4cb87c1e83…
dependency_tree 811d02f25a95…
table_classification ed78e2356a6b…
admin_handbook 2026-11-12T23:06:36Z2026-11-12T23:06:37Z1
7
  • exists:admin_handbook
  • exists:api_map
  • admin_handbook:md_min_sections:10
  • admin_handbook:no_forbidden_placeholders
  • api_map:json_parses
  • produces_paths_exist
  • admin_handbook:command_transcripts_clean
api_map e79492036221…
admin_handbook 6e6468771ac2…
db_handbook 2026-11-12T23:11:39Z2026-11-12T23:11:40Z1
8
  • exists:db_handbook
  • exists:seed_isolation
  • db_handbook:md_min_sections:5
  • db_handbook:no_forbidden_placeholders
  • seed_isolation:md_min_sections:1
  • seed_isolation:no_forbidden_placeholders
  • produces_paths_exist
  • db_handbook:command_transcripts_clean
db_handbook 977551a9342e…
seed_isolation be18e57db332…
seed_data 2026-11-12T23:11:53Z2026-11-12T23:11:53Z1
6
  • exists:seed_data_sql
  • exists:seed_cases_json
  • seed_data_sql:sql_parses
  • seed_data_sql:no_forbidden_placeholders
  • seed_cases_json:json_parses
  • produces_paths_exist
seed_data_sql 0298abb13516…
seed_cases_json fbf7b9a7c6eb…
seed_validate 2026-11-12T23:11:56Z2026-11-12T23:11:57Z1
3
  • exists:seed_data_contract
  • seed_data_contract:json_parses
  • produces_paths_exist
seed_data_contract 57aab40fa7df…
usecase_validate 2026-11-12T23:12:20Z2026-11-12T23:12:21Z1
10
  • exists:usecase_contract
  • exists:passed_tests
  • exists:failed_tests
  • exists:test_results
  • usecase_contract:json_parses
  • passed_tests:md_min_sections:1
  • failed_tests:md_min_sections:1
  • test_results:json_parses
  • produces_paths_exist
  • test_results:usecase_thresholds:80,70
failed_tests b2247b16f5f7…
passed_tests 3559688a0195…
test_results 54650e4da7db…
usecase_contract f00cf79ab936…
finalize_docs 2026-11-12T23:18:54Z2026-11-12T23:18:55Z1
9
  • exists:api_integration_guide
  • exists:release_notes
  • exists:defects_json
  • api_integration_guide:md_min_sections:3
  • api_integration_guide:no_forbidden_placeholders
  • release_notes:md_min_sections:3
  • release_notes:no_forbidden_placeholders
  • defects_json:json_parses
  • produces_paths_exist
defects_json 79050dbfeea1…
release_notes 87e32737eed9…
api_integration_guide 3e8d59712e99…
package_archive invalidated 2026-11-17T20:40:31Z 2026-11-12T23:23:45Z2026-11-17T19:51:47Z11
37 (final gate PASS)
  • exists:checksums
  • exists:verify_md
  • exists:rebuild_md
  • exists:provenance_md
  • exists:manifest_txt
  • exists:assetchain_log_md
  • exists:assetchain_log_json
  • exists:actions_jsonl
  • exists:sale_tar
  • checksums:file_nonempty
  • verify_md:md_min_sections:2
  • verify_md:no_forbidden_placeholders
  • rebuild_md:md_min_sections:2
  • rebuild_md:no_forbidden_placeholders
  • provenance_md:md_min_sections:2
  • provenance_md:no_forbidden_placeholders
  • manifest_txt:file_nonempty
  • assetchain_log_md:md_min_sections:1
  • assetchain_log_json:json_parses
  • actions_jsonl:file_nonempty
  • sale_tar:file_nonempty
  • produces_paths_exist
  • G8 cosign
  • G8 scan_grade
  • G8 tag_base_os
  • G8 thread_exit
  • G8 vex_shipped
  • G8 cpu_baseline
  • G8 unpack_files
  • G8 scout_grade_a
  • G8 script_copies
  • G8 upgrade_check
  • G8 offline_rebuild
  • G8 rebuild_manifest
  • G8 artifact_coverage
  • G8 trademark_shipped
  • G8 assetchain_coverage
sale_tar 88af6a870783…
checksums 878f9f8d2548…
verify_md 226b001329e8…
rebuild_md 7cf3ae7fdec4…
manifest_txt afb89409e62b…
actions_jsonl 13fb2a854da7…
provenance_md 28cbd60ee632…
assetchain_log_md e9eccaec0c0f…
assetchain_log_json 52cfa8a5a5ae…

[stage_runs]

Rewinds

  • 2026-11-17T12:42:10Z: package_archive to package_archive on docs_redo (scripts/redo-docs.py --stage package_archive) [stage_events, stage_events #38590]
  • 2026-11-17T18:40:16Z: package_archive to package_archive on docs_redo (scripts/redo-docs.py --stage package_archive) [stage_events, stage_events #38974]
  • 2026-11-17T19:17:48Z: package_archive to package_archive on docs_redo (scripts/redo-docs.py --stage package_archive) [stage_events, stage_events #39063]
  • 2026-11-17T20:40:31Z: package_archive to package_archive on docs_redo (scripts/redo-docs.py --stage package_archive) [stage_events, stage_events #39257]

Model work per stage

Fully recorded

Role: writer model. Calls up to 2026-11-17T19:51:47Z.

151 calls over 6 stages

StageCallsRefusedErrorsMax attemptForced commitsReal tokensLesson rules shown
plan2001 08475 L-A183, L-A15
remediate2001 08943 L-A183, L-A15
admin_handbook814403 17380319 L-A180, L-A181, L-A182, L-A183, L-A184, L-A155, L-A114, L-A25, L-A15, L-A14
db_handbook29803 2107414 L-A180, L-A181, L-A182, L-A183, L-A184, L-A114, L-A15
usecase_validate1001 01894 L-A59
finalize_docs361403 3138720 L-A180, L-A181, L-A182, L-A183, L-A184, L-A155, L-A114, L-A25, L-A15

[micro_step_runs] [lesson_recalls]

Review

Fully recorded

Role: review model.

4 rounds, 4 counted, $4.58 recorded cost

RoundStartedCriticalMajorMinorVerdictCostCap in forceArchive reviewed
12026-11-17T11:36:47Z 0319 findings to repackage [held_rounds, held_rounds #1970] $1.30 3 rounds, $40.00 3a8deffa13a8…
22026-11-17T18:11:33Z 0215 findings to repackage [held_rounds, held_rounds #1990] $1.24 3 rounds, $40.00 84ca0a62f7e6…
32026-11-17T18:46:38Z 1010 findings to repackage [held_rounds, held_rounds #1994] $1.24 3 rounds, $40.00 93967cffc156…
42026-11-17T19:52:04Z 005 clean to publish [held_rounds, held_rounds #2003] $0.79 3 rounds, $40.00 88af6a870783…

Defects

Fully recorded
  • Ledger entries55 [defects, defects where product_slug=tempo and this tag or chain]
  • Disclosed in the archive55 [docs/defects/defects.json, entries]

55 ledger entries: by severity high 5, low 49, critical 1; by status fixed-before-release 55.

DefectSeverityStatusFound byFixed in
RSD-tempo-a53bfb2658
Admin handbook: False operational claim: an unhealthy container is not restarted. [defects, defects #317433]
highfixed-before-releaseheld review (review model)—
RSD-tempo-9fbac77fea
Admin handbook: False: a failing probe does not make the container exit. [defects, defects #317434]
highfixed-before-releaseheld review (review model)—
RSD-tempo-eb2fb06ae8
API guide: A procedure presented as a restore is a backup command; following it restores nothing. [defects, defects #317435]
highfixed-before-releaseheld review (review model)—
RSD-tempo-1a559a0889
Admin handbook: Unsupported claim of graceful stop under the default timeout. [defects, defects #317436]
lowfixed-before-releaseheld review (review model)—
RSD-tempo-bdf4108a03
Admin handbook: Cross-section contradiction: -u is documented as unusable and used in the same handbook. [defects, defects #317437]
lowfixed-before-releaseheld review (review model)—
RSD-tempo-60c5717eff
Admin handbook: Contradicts the bind-mount procedure elsewhere in the same handbook. [defects, defects #317438]
lowfixed-before-releaseheld review (review model)—
RSD-tempo-c59a20cb57
Admin handbook: Overgeneralised: ownership by another user is not what breaks startup, mode is. [defects, defects #317439]
lowfixed-before-releaseheld review (review model)—
RSD-tempo-a5df79ee4c
Admin handbook: live-store is on-disk data (and the only place spans are written), not an in-memory cache. [defects, defects #317440]
lowfixed-before-releaseheld review (review model)—
RSD-tempo-b45dcc80d1
Admin handbook: Names /var/tempo/wal/ as a place the write-ahead log lives, contradicting the API guide and the measured layout. [defects, defects #317441]
lowfixed-before-releaseheld review (review model)—
RSD-tempo-a35960b842
Admin handbook: Reads as if a configuration file must be mounted. [defects, defects #317442]
lowfixed-before-releaseheld review (review model)—
RSD-tempo-cdb529a13a
Admin handbook: Advice that cannot have an effect and contradicts the sentence above it. [defects, defects #317443]
lowfixed-before-releaseheld review (review model)—
RSD-tempo-6f58158ff1
Admin handbook: Self-contradiction about named-volume persistence. [defects, defects #317444]
lowfixed-before-releaseheld review (review model)—
RSD-tempo-cfa19b4bfe
Admin handbook: Names a port the image neither exposes nor probes without saying what it is. [defects, defects #317445]
lowfixed-before-releaseheld review (review model)—
RSD-tempo-62ed69fd39
Admin handbook: Incomplete backup procedure. [defects, defects #317446]
lowfixed-before-releaseheld review (review model)—
RSD-tempo-d331fc94b8
Admin handbook: 'Restore into an existing volume' does not return it to the backup state. [defects, defects #317447]
lowfixed-before-releaseheld review (review model)—
RSD-tempo-f8984cf305
Database handbook: Names /var/tempo/wal/ as the ingest-durability log; spans never go there. [defects, defects #317448]
lowfixed-before-releaseheld review (review model)—
RSD-tempo-72a5719dd2
Database handbook: live-store is persistent on-disk data. [defects, defects #317449]
lowfixed-before-releaseheld review (review model)—
RSD-tempo-a018c9a799
Database handbook: Ownership alone does not break startup. [defects, defects #317450]
lowfixed-before-releaseheld review (review model)—
RSD-tempo-a5621e4c2b
Database handbook: Misdescribes port 9095 and names a port the image does not expose. [defects, defects #317451]
lowfixed-before-releaseheld review (review model)—
RSD-tempo-a6b20ebed3
Database handbook: False prerequisite contradicting the Quick Start. [defects, defects #317452]
lowfixed-before-releaseheld review (review model)—
RSD-tempo-e63042507c
API guide: Contradicts itself: a directory owned by 10001 works. [defects, defects #317453]
lowfixed-before-releaseheld review (review model)—
RSD-tempo-85ce3b83d5
API guide: Says tag values; the endpoint returns names. [defects, defects #317454]
lowfixed-before-releaseheld review (review model)—
RSD-tempo-35a8ecbfa1
Admin handbook: Backup procedure without the stop lead-in the gate requires (silent data loss), and a false reason (tempo owns /var/tempo, so it can read it). [defects, defects #327315]
highfixed-before-releaseheld review (review model)—
RSD-tempo-640c7d7485
Admin handbook: A second backup lead-in with no instruction to stop Tempo first. [defects, defects #327316]
highfixed-before-releaseheld review (review model)—
RSD-tempo-5795135804
Admin handbook: Stop duration overstated (measured about 30 s). [defects, defects #327317]
lowfixed-before-releaseheld review (review model)—
RSD-tempo-b6ed69894c
Admin handbook: Backup procedures use the stop that kills Tempo, contradicting the handbook's own instruction. [defects, defects #327318]
lowfixed-before-releaseheld review (review model)—
RSD-tempo-b1c6abe999
Admin handbook: Same contradiction in Container Troubleshooting. [defects, defects #327319]
lowfixed-before-releaseheld review (review model)—
RSD-tempo-4c31eed48e
Database handbook: DB handbook backup uses the stop that kills Tempo. [defects, defects #327320]
lowfixed-before-releaseheld review (review model)—
RSD-tempo-b087d018f6
API guide: API guide backup uses the stop that kills Tempo. [defects, defects #327321]
lowfixed-before-releaseheld review (review model)—
RSD-tempo-1782f181c8
Database handbook: Restore procedure extracts into the volume of a running Tempo and is not a restore into a new volume. [defects, defects #327322]
lowfixed-before-releaseheld review (review model)—
RSD-tempo-af1fdd231b
Database handbook: Paraphrase of the corrected false claim that a failing probe makes the container exit. [defects, defects #327323]
lowfixed-before-releaseheld review (review model)—
RSD-tempo-608143e943
API guide: Ambiguous wording that can be read as the container exiting. [defects, defects #327324]
lowfixed-before-releaseheld review (review model)—
RSD-tempo-fde2a9b5f8
Database handbook: Overstates the bind-mount requirement (mode 750) and implies owner alone is the cause. [defects, defects #327325]
lowfixed-before-releaseheld review (review model)—
RSD-tempo-39ed7d1b63
API guide: Overgeneralised: ownership by another user alone does not break startup. [defects, defects #327326]
lowfixed-before-releaseheld review (review model)—
RSD-tempo-71c2c022e7
API guide: Points to a values endpoint the guide never documents. [defects, defects #327327]
lowfixed-before-releaseheld review (review model)—
RSD-tempo-4f589e0e38
API guide: Calls the live-store a cache. [defects, defects #327328]
lowfixed-before-releaseheld review (review model)—
RSD-tempo-bf488b6c0f
API guide: Describes live-store data as in-memory. [defects, defects #327329]
lowfixed-before-releaseheld review (review model)—
RSD-tempo-eb951d8ccc
API guide: Unsupported 'until new spans arrive'. [defects, defects #327330]
lowfixed-before-releaseheld review (review model)—
RSD-tempo-7669a554b5
Admin handbook: Unsupported explanation. [defects, defects #327331]
lowfixed-before-releaseheld review (review model)—
RSD-tempo-12c41fc6c0
Admin handbook: Container Troubleshooting backup helper runs as the image user tempo (uid 10001), not root, so it cannot write the archive into the host's current directory; every other backup in the handbooks uses… [defects, defects #328677]
criticalfixed-before-releaseheld review (review model)—
RSD-tempo-a92e0f7b4f
Admin handbook: Same section stops Tempo with the default 10 s timeout, which kills it (exit 137); the rest of the handbook (Backing Up Data, Manage the Container) says to use -t 90 because Tempo needs about 30 s… [defects, defects #328678]
lowfixed-before-releaseheld review (review model)—
RSD-tempo-882a0570d6
Admin handbook: Overstates the bind-mount requirement: neither owner 10001 nor mode 750 is required, only that uid 10001 can write (round-2 finding recurs). [defects, defects #328679]
lowfixed-before-releaseheld review (review model)—
RSD-tempo-c784503e2e
Admin handbook: '750 or more restrictive' is not a requirement and mode 500 (more restrictive) fails; a root-owned 777 directory works. [defects, defects #328680]
lowfixed-before-releaseheld review (review model)—
RSD-tempo-f987b7b4c5
Admin handbook: Overgeneralised: ownership by another user alone does not break startup (round-2 finding recurs). [defects, defects #328681]
lowfixed-before-releaseheld review (review model)—
RSD-tempo-09332a28c4
Admin handbook: Unconditional 'mode 600 does not [work]': a mode 600 file owned by uid 10001 is read normally. [defects, defects #328682]
lowfixed-before-releaseheld review (review model)—
RSD-tempo-07272b762b
Admin handbook: Same overgeneralisation: mode 600 alone does not break startup when uid 10001 owns the file. [defects, defects #328683]
lowfixed-before-releaseheld review (review model)—
RSD-tempo-bc792e991c
Admin handbook: 'Replacing the Container' starts tempo-new with the same -p 3200/4317/4318 and the same volume without stopping the container that holds them; Docker refuses the second container while the first… [defects, defects #328684]
lowfixed-before-releaseheld review (review model)—
RSD-tempo-9229c0b6ea
API guide: Overgeneralised: mode 600 owned by uid 10001 is readable and starts. [defects, defects #328685]
lowfixed-before-releaseheld review (review model)—
RSD-tempo-22340bec56
API guide: Same overgeneralisation about mode 600. [defects, defects #328686]
lowfixed-before-releaseheld review (review model)—
RSD-tempo-2b26fde78c
Database handbook: Self-contradicting: the previous sentence says a directory owned by 10001 works at mode 755, then this one says mode 755 owned by uid 10001 fails. [defects, defects #328687]
lowfixed-before-releaseheld review (review model)—
RSD-tempo-13c0b43aac
Admin handbook: Overstates the bind-mount requirement (the round-2/3 finding recurs here) and contradicts line 395 ('a directory owned by another user that uid 10001 can write to works'). [defects, defects #331234]
lowfixed-before-releaseheld review (review model)—
RSD-tempo-6a4a523920
Admin handbook: Same overgeneralisation: ownership by UID 10001 is not required, and a root-owned directory does not by itself cause the error. [defects, defects #331235]
lowfixed-before-releaseheld review (review model)—
RSD-tempo-ae78fbaafa
Admin handbook: Unconditional claim: a mode 640 file owned by uid 10001 is read by its owner and Tempo starts (same class as the round-3 mode-600 finding). [defects, defects #331236]
lowfixed-before-releaseheld review (review model)—
RSD-tempo-1095379271
API guide: Overstates the requirement and contradicts line 376 ('must be writable by UID 10001') in the same guide; ownership is not required. [defects, defects #331237]
lowfixed-before-releaseheld review (review model)—
RSD-tempo-9d4ad7e5ff
Database handbook: A mounted configuration file does not need to be writable by UID 10001; the sentence makes that a requirement (and the next sentence of the same paragraph only asks for readable). [defects, defects #331238]
lowfixed-before-releaseheld review (review model)—

Verification

1 item not recorded
  • Reproduced before publishingyes (rebuilt digest sha256:ce5698404a6423c554a94c2f99d6c538b60b5d32237380748bd5edee55b1402c · published digest sha256:ce5698404a6423c554a94c2f99d6c538b60b5d32237380748bd5edee55b1402c · digest match yes · builder moby/buildkit:v0.31.2 · build seconds 292) [docs/provenance/REPRO_VERIFICATION.json, verified]
  • Final contract gate (G8)PASS (checks artifact_coverage, assetchain_coverage, cosign, cpu_baseline, offline_rebuild, rebuild_manifest, scan_grade, scout_grade_a, script_copies, tag_base_os, thread_exit, trademark_shipped, unpack_files, upgrade_check, vex_shipped) [g8_result.json, result]
  • Grade at releaseA (percent 94 · tool docker scout policy 1.26.0 · config docker-default · org vex no · at 2026-11-17T20:41:27Z · failing Docker Scout counts 11 packages with copyleft licences (GPL, LGPL, MPL), all of them operating-system packages (it counts only packages whose licence it can read; the SBOM lists every component).) [SCOUT_EVIDENCE.json, docker_scout_policy]
  • Image signatureverified on the index and the linux/amd64 manifest (key fingerprint 04daa92344a52dbc · at 2026-11-17T20:41:14Z) [docs/provenance/IMAGE_EVIDENCE.json, signed]
  • Image signature transparency-log entries [deliverables/provenance/PROMOTION_RECORD.json, sign_stdout_tail]
  • rebuild.json signatureSigstore bundle, release key (key fingerprint 04daa92344a52dbc · log index 3953303536 · transparency-log entry · integrated 2026-11-17T20:45:45Z) [ReadyStack-tempo-v3.1.1-CE-ubuntu24.04-r6.rebuild.json.sigstore, verificationMaterial.tlogEntries[0]]
  • Signed attestations
    • kind provenance · digest sha256:84860e3304e5268942666a1bed081f5c415c351d20589cf14e0085a63f90adb1 · state attached · log index 3953306342 · transparency-log entry
    • kind sbom · digest sha256:84860e3304e5268942666a1bed081f5c415c351d20589cf14e0085a63f90adb1 · state attached · log index 3953308282 · transparency-log entry
    • kind vsa · digest sha256:84860e3304e5268942666a1bed081f5c415c351d20589cf14e0085a63f90adb1 · state attached · log index 3953310092 · transparency-log entry
    • kind provenance · digest sha256:ce5698404a6423c554a94c2f99d6c538b60b5d32237380748bd5edee55b1402c · state attached · log index 3953311115 · transparency-log entry
    • kind sbom · digest sha256:ce5698404a6423c554a94c2f99d6c538b60b5d32237380748bd5edee55b1402c · state attached · log index 3953312966 · transparency-log entry
    • kind vsa · digest sha256:ce5698404a6423c554a94c2f99d6c538b60b5d32237380748bd5edee55b1402c · state attached · log index 3953314981 · transparency-log entry
    (at 2026-11-17T20:45:46Z) [attestations.json, results]
  • Pins recorddocs/PINS.md and docs/provenance/PINS.json in the archive (https://readystack.dev/products/tempo/recipe) [docs/provenance/PINS.json]

Offline clean-room rebuilds

  • 2026-11-17T11:36:52Z on build host 5 (Docker-in-Docker daemon with --network none): bit for bit yes, digest match yes, customer verify yes
    rebuilt sha256:ce5698404a6423c554a94c2f99d6c538b60b5d32237380748bd5edee55b1402c [clean-room rebuild ledger, runs[883]]
  • Not recorded: the policy tool's --result-file itself (its per-policy results are copied into SCOUT_EVIDENCE.json and the archive's IMAGE_EVIDENCE.json; the file is not kept)

Publication

Fully recorded 1 pending at generation
  • Image pushed (internal tag), publish_image passed2026-11-12T22:58:58Z [stage_runs, stage_runs chain 1044 stage publish_image]
  • Archive manifests written2026-11-17T20:43:43Z [PUBLISH_MANIFEST.json, published_at]
  • Pending at generation: the archive cut-over on prodasset, the release tag's promotion and the site event (this trail was generated after G8 and before them; they are appended as a 'publication' event in History)

Packages and CPU level

Fully recorded
  • x86-64 level the image needsv1 (used v4 · baseline v2 · elf files 64 · probed 2026-11-12T22:52:24Z · source build_kit) [release_images, isa_level_hard]

History

2 events
  • 2026-11-17T20:47:24Z generated: by KitForge release/build_trail.py · generator commit f0e2adc6231b8559cf01ba12fb40e2d04673a8e4
  • 2026-11-17T20:49:06Z publication: promoted at 2026-11-17T20:48:06Z · promoted digest sha256:84860e3304e5268942666a1bed081f5c415c351d20589cf14e0085a63f90adb1 · promotion method imagetools_create_retag_by_digest_no_rebuild · site event 600 · checklist status complete · checklist at 2026-11-17T20:49:06Z · record workspace: deliverables/provenance/PROMOTION_RECORD.json, RELEASE_CHECKLIST.json

Records

25 records
RecordWhere it isRows
docs/defects/defects.jsoninside the archive (ReadyStack-tempo-v3.1.1-CE-ubuntu24.04-r6.tar.gz)—
docs/provenance/IMAGE_EVIDENCE.jsoninside the archive (ReadyStack-tempo-v3.1.1-CE-ubuntu24.04-r6.tar.gz)—
docs/provenance/LOCKED_DIGEST.txtinside the archive (ReadyStack-tempo-v3.1.1-CE-ubuntu24.04-r6.tar.gz)—
docs/provenance/PINS.jsoninside the archive (ReadyStack-tempo-v3.1.1-CE-ubuntu24.04-r6.tar.gz)—
docs/provenance/REPRO_VERIFICATION.jsoninside the archive (ReadyStack-tempo-v3.1.1-CE-ubuntu24.04-r6.tar.gz)—
docs/provenance/SOURCE_TREE_HASH.jsoninside the archive (ReadyStack-tempo-v3.1.1-CE-ubuntu24.04-r6.tar.gz)—
MANIFEST.jsonbeside the archive (prodasset /data/production/tempo/v3.1.1-CE-ubuntu24.04-r6/), as staged for publishing—
PUBLISH_MANIFEST.jsonbeside the archive (prodasset /data/production/tempo/v3.1.1-CE-ubuntu24.04-r6/), as staged for publishing—
ReadyStack-tempo-v3.1.1-CE-ubuntu24.04-r6.rebuild.jsonbeside the archive (prodasset /data/production/tempo/v3.1.1-CE-ubuntu24.04-r6/), as staged for publishing—
ReadyStack-tempo-v3.1.1-CE-ubuntu24.04-r6.rebuild.json.sigstorebeside the archive (prodasset /data/production/tempo/v3.1.1-CE-ubuntu24.04-r6/), as staged for publishing—
SCOUT_EVIDENCE.jsonbeside the archive (prodasset /data/production/tempo/v3.1.1-CE-ubuntu24.04-r6/), as staged for publishing—
clean-room rebuild ledgerthe clean-room rebuild ledger (runstate/audit-2026-09/bit4bit.json, not published)—
build_requestssadb, ReadyStack's engine database (not published)721
chainssadb, ReadyStack's engine database (not published)1044
defectssadb, ReadyStack's engine database (not published)tempo v3.1.1-CE-ubuntu24.04-r6
drive_runssadb, ReadyStack's engine database (not published)chain 1044
held_roundssadb, ReadyStack's engine database (not published)chain 1044
lesson_recallssadb, ReadyStack's engine database (not published)chain 1044
micro_step_runssadb, ReadyStack's engine database (not published)chain 1044
release_imagessadb, ReadyStack's engine database (not published)tempo v3.1.1-CE-ubuntu24.04-r6
stage_eventssadb, ReadyStack's engine database (not published)chain 1044
stage_runssadb, ReadyStack's engine database (not published)chain 1044
attestations.jsonthe chain's workspace on the controller (not published)—
deliverables/provenance/PROMOTION_RECORD.jsonthe chain's workspace on the controller (not published)—
g8_result.jsonthe chain's workspace on the controller (not published)—