Tempo v3.1.1-CE-ubuntu24.04-r4 build trail
How ReadyStack built readystack/tempo:v3.1.1-CE-ubuntu24.04-r4 and its build kit, copied record by record: why the release exists, every chain, drive and stage it went through, the model work, the review rounds, the defects, the checks that verified it and when it was published. Each line names the record it comes from in brackets; a record that does not exist for this release says so.
This trail
As JSON- Image
readystack/tempo:v3.1.1-CE-ubuntu24.04-r4 - Index digestsha256:55d97453f38e96ee669f3e1a3aa3cb1754d8d975bad9fac2b4cc4e4129487e8d
- linux/amd64 digestsha256:4d8fc461229903ccc9401a241a9f18b61715fa1ff6431b7e67324c49e23c8e9d
- Archive
ReadyStack-tempo-v3.1.1-CE-ubuntu24.04-r4.tar.gz - Archive SHA-256 now921158c5d57c475d4fe0a82eed07cb5c28bc60f1e910e423f3c580e0b255674b
- Pins record
docs/PINS.md,docs/provenance/PINS.jsonin the archive (since generated) - Generated2026-11-07T03:21:43Z by KitForge release/build_trail.py
- Sections9 sections, 8 fully recorded; 1 item not recorded
Signed with the release key The trail's signature is a Sigstore bundle beside it. Check it is ours before you rely on it:
cosign verify-blob --key https://readystack.dev/keys/cosign.pub \ --bundle ReadyStack-tempo-v3.1.1-CE-ubuntu24.04-r4.trail.json.sigstore ReadyStack-tempo-v3.1.1-CE-ubuntu24.04-r4.trail.json
IdentityWhy this release existsThe path through the harnessModel work per stageReviewDefectsVerificationPublicationPackages and CPU level
Identity
Fully recorded- ProductTempo (tempo) [MANIFEST.json]
- Release tagv3.1.1-CE-ubuntu24.04-r4 [MANIFEST.json]
- Imagereadystack/tempo:v3.1.1-CE-ubuntu24.04-r4 [MANIFEST.json]
- Image index digestsha256:55d97453f38e96ee669f3e1a3aa3cb1754d8d975bad9fac2b4cc4e4129487e8d [docs/provenance/LOCKED_DIGEST.txt]
- linux/amd64 image digestsha256:4d8fc461229903ccc9401a241a9f18b61715fa1ff6431b7e67324c49e23c8e9d [ReadyStack-tempo-v3.1.1-CE-ubuntu24.04-r4.rebuild.json, subject.image_manifest_digest]
- ArchiveReadyStack-tempo-v3.1.1-CE-ubuntu24.04-r4.tar.gz (bytes 516351480) [MANIFEST.json]
- Archive sha256 at publish921158c5d57c475d4fe0a82eed07cb5c28bc60f1e910e423f3c580e0b255674b [MANIFEST.json, tarball_sha256]
- Archive records agreeyes [MANIFEST.json, PUBLISH_MANIFEST.json and .cutover.json name the same sha256]
- Repack historynone: the archive is as first published [MANIFEST.json, repack_history]
- Upstream repositoryhttps://github.com/grafana/tempo [docs/provenance/SOURCE_TREE_HASH.json]
- Upstream refv3.1.1 [docs/provenance/SOURCE_TREE_HASH.json]
- Upstream commit9db7df79d2af105a90d96484e6403e1fda0d011e [docs/provenance/SOURCE_TREE_HASH.json]
- Source tree hashb564f0e22361849b102298712e20b1b23f7c5efe890d4c83d6b4c7f97b0ca113 (files 15740) [docs/provenance/SOURCE_TREE_HASH.json, tree_listing_sha256 (sha256 of the sorted file listing)]
- Kit tree hashsha256:4f0e62c07c04dd280413b57f4f06fcd97a3f36021603673deef0464f5cafe89f [ReadyStack-tempo-v3.1.1-CE-ubuntu24.04-r4.rebuild.json, inputs.tree_hash]
- SOURCE_DATE_EPOCH1792596276 (utc 2026-10-21T15:24:36Z) [ReadyStack-tempo-v3.1.1-CE-ubuntu24.04-r4.rebuild.json, inputs.source_date_epoch]
- Base images
- ref golang:1.27.3-bookworm@sha256:972b4110ba0f47539a975c31e52c64765e1ff19f2d74469ae4a595c6676e80a5 · platform digest sha256:fea12ba16096adec0f699ce1c4da2154d320450e56c1f63671f95d2a3551c77b
- ref ubuntu:24.04@sha256:fe81560990fae86dc4743202b2cb4d3df98d0bcf949173cecef15ce1127ef852 · platform digest sha256:78d4744ead1f5b19b04d0df558ab182a5300903900755e515b2ca4d10eb2044d
- BuildKitmoby/buildkit:v0.31.2 (image digest sha256:e0e67ea9c4bb07bdef683e29f70f3b623d1eb9c82274a9ec04e6bb0511449fb0) [ReadyStack-tempo-v3.1.1-CE-ubuntu24.04-r4.rebuild.json, engine]
- Engine commit(s)
- commit 90d1190e36d2953ca89c72198cc95ee12f35e803 · dirty yes · first drive 3540
- commit 07abd1e1c1197982ae81cf5d46861dd8f90c3cf6 · dirty yes · first drive 3550
Why this release exists
Fully recorded- Chain824 (created 2026-11-07T02:07:26Z · trigger customer_request · upstream version v3.1.1) [chains, chains #824]
- Requestbuild request #504 (rebuild) (requested at 2026-11-07T01:59:54Z · requested by kitforge-agent · version v3.1.1) [build_requests, build_requests #504]
- Reasonrerelease agenda REVISION -> v3.1.1-CE-ubuntu24.04-r4 (decay loop, IMP-08) [build_requests, build_requests #504 request_reason]
- Supersedesreadystack/tempo:v3.1.1-CE-ubuntu24.04-r3 (chain 754) [chains, chains #754]
The path through the harness
Fully recorded1 chain · 2 drives · 18 stages · 1 rewind
Chain 824 release · ready_to_ship
Created 2026-11-07T02:07:26Z, upstream v3.1.1, build request 504 [chains, chains #824]
| Drive | Started | Minutes | Build host | How it stopped |
|---|---|---|---|---|
| 3540 | 2026-11-07T02:07:55Z | 39.1 | build host 5 withhold-publish | ready_to_ship at package_archive; 19 ticks [drive_runs, drive_runs #3540] |
| 3550 | 2026-11-07T03:15:07Z | — | build host 5 publish-held | not recorded [drive_runs, drive_runs #3550] |
Stages, in order
| Stage | First start | Passed | Attempts | Gate checks passed | Artifacts (SHA-256) |
|---|---|---|---|---|---|
intake |
2026-11-07T02:08:05Z | 2026-11-07T02:08:06Z | 1 | 4
|
order_json e8224b5045d4… |
acquire |
2026-11-07T02:08:16Z | 2026-11-07T02:08:18Z | 1 | 12
|
source_tree bad9747f4984…license_file 0d96a4ff68ad…custody_inputs f1b2c2a9dd5f…source_tree_hash b9ffa483bfb9…source_file_manifest 05deabc29605… |
plan |
2026-11-07T02:08:46Z | 2026-11-07T02:08:46Z | 1 | 10
|
recon_report c85b4edb9ee7…input_pin_plan 810114a774c0…toolchain_lock a8fa65939436… |
assemble_kit |
2026-11-07T02:17:33Z | 2026-11-07T02:17:34Z | 1 | 27
|
dockerfile 5421322894df…build_recipe 64e4ea057e34…system_pinning fa091140511e…build_offline_sh 6633aa31b6b4…generate_sbom_sh ce0f1e6f1e70…first_boot_health 72f119d29b1c…verify_offline_sh 3e8184ea230c…base_image_digests 13eb87731026…dockerfile_offline 5421322894df…first_build_digest 1b380ef22080… |
remediate |
2026-11-07T02:18:01Z | 2026-11-07T02:18:02Z | 1 | 8
|
vendored_apt e3b0c44298fc…remediation_log 843485ca9bb9…security_report a0d597ba4308… |
build_kit |
2026-11-07T02:30:58Z | 2026-11-07T02:30:59Z | 1 | 9
|
cosign_stamp 8214086b48fd…locked_digest 5b9cbf683dda…freeze_manifest 959d77d78976…offline_rebuild_transcript e3015c16eb65… |
verdict |
2026-11-07T02:32:16Z | 2026-11-07T02:32:16Z | 1 | 8
|
scout_verdict 3a32e9bb7d5c… |
publish_image |
2026-11-07T02:33:07Z | 2026-11-07T02:33:08Z | 1 | 7
|
hub_readme 16107b81e0f2…promotion_record 6ceea1d57b6a… |
boot_instance |
2026-11-07T02:33:17Z | 2026-11-07T02:33:21Z | 2 | 3
|
instance_handle de0805e3c69b… |
sbom |
2026-11-07T02:33:39Z | 2026-11-07T02:33:40Z | 1 | 5
|
sbom_md a098da286d49…sbom_json 58a3cb814e2a… |
schema_discovery |
2026-11-07T02:33:43Z | 2026-11-07T02:33:44Z | 1 | 7
|
schema_hash ac4cb87c1e83…dependency_tree 811d02f25a95…table_classification ed78e2356a6b… |
admin_handbook |
2026-11-07T02:33:53Z | 2026-11-07T02:33:54Z | 1 | 7
|
api_map e79492036221…admin_handbook 9e998df2f6f6… |
db_handbook |
2026-11-07T02:34:06Z | 2026-11-07T02:34:07Z | 1 | 8
|
db_handbook b75f665d481f…seed_isolation be18e57db332… |
seed_data |
2026-11-07T02:34:18Z | 2026-11-07T02:34:18Z | 1 | 6
|
seed_data_sql 0298abb13516…seed_cases_json edfb666f4028… |
seed_validate |
2026-11-07T02:34:21Z | 2026-11-07T02:34:22Z | 1 | 3
|
seed_data_contract 916e0211ed77… |
usecase_validate |
2026-11-07T02:34:47Z | 2026-11-07T02:34:47Z | 1 | 10
|
failed_tests b2247b16f5f7…passed_tests 347a5caefad0…test_results 317ae5a2a987…usecase_contract 47d00024be97… |
finalize_docs |
2026-11-07T02:34:53Z | 2026-11-07T02:34:54Z | 1 | 9
|
defects_json bb6d469e2805…release_notes 59b8f12609b0…api_integration_guide ca76a93f424c… |
package_archive invalidated 2026-11-07T03:14:35Z |
2026-11-07T02:46:59Z | 2026-11-07T02:47:01Z | 1 | 34 (final gate PASS)
|
sale_tar 4792ef5e3882…checksums f05d5fe69a82…verify_md a21a12ab3a27…rebuild_md 417950895277…manifest_txt e94d1e106e28…actions_jsonl 64c81180183a…provenance_md dd13a693ff35…assetchain_log_md e9eccaec0c0f…assetchain_log_json 232d618be0fc… |
[stage_runs]
Rewinds
- 2026-11-07T03:14:35Z:
package_archivetopackage_archiveon docs_redo (scripts/redo-docs.py --stage package_archive) [stage_events, stage_events #23462]
Model work per stage
Fully recordedRole: writer model. Calls up to 2026-11-07T02:47:01Z.
5 calls over 3 stages
| Stage | Calls | Refused | Errors | Max attempt | Forced commits | Real tokens | Lesson rules shown |
|---|---|---|---|---|---|---|---|
plan | 2 | 0 | 0 | 1 | 0 | 7758 | L-A183, L-A15 |
remediate | 2 | 0 | 0 | 1 | 0 | 8339 | L-A183, L-A15 |
usecase_validate | 1 | 0 | 0 | 1 | 0 | 1949 | L-A59 |
[micro_step_runs] [lesson_recalls]
Review
Fully recordedRole: review model.
1 round, 1 counted, $0.28 recorded cost
| Round | Started | Critical | Major | Minor | Verdict | Cost | Cap in force | Archive reviewed |
|---|---|---|---|---|---|---|---|---|
| 1 | 2026-11-07T02:48:10Z | 0 | 0 | 0 | clean to publish [held_rounds, held_rounds #1418] | $0.28 | 3 rounds, $40.00 | 4792ef5e3882… |
Defects
Fully recorded- Ledger entries5 [defects, defects where product_slug=tempo and this tag or chain]
- Disclosed in the archive0 [docs/defects/defects.json, entries]
5 ledger entries: by severity critical 5; by status fixed-in-release 5.
| Defect | Severity | Status | Found by | Fixed in |
|---|---|---|---|---|
RSD-tempo-38696beb81Admin handbook: Runtime identity list still gives gid 999. [defects, defects #158027] | critical | fixed-in-release | held review (review model) | v3.1.1-CE-ubuntu24.04-r4 |
RSD-tempo-c586142fd7Database handbook: Runtime Identity gives UID 999. [defects, defects #158028] | critical | fixed-in-release | held review (review model) | v3.1.1-CE-ubuntu24.04-r4 |
RSD-tempo-ef7bfe637cAdmin handbook: Runtime identity list still gives uid 999. [defects, defects #158029] | critical | fixed-in-release | held review (review model) | v3.1.1-CE-ubuntu24.04-r4 |
RSD-tempo-4baf7f28e9Database handbook: Runtime Identity gives GID 999. [defects, defects #158030] | critical | fixed-in-release | held review (review model) | v3.1.1-CE-ubuntu24.04-r4 |
RSD-tempo-7fb4d8d86aCVE-2026-111497 in github.com/andybalholm/brotli v1.2.2 is on CISA's Known Exploited Vulnerabilities list [defects, defects #158031] | critical | fixed-in-release | image scan | v3.1.1-CE-ubuntu24.04-r4 |
Verification
1 item not recorded- Reproduced before publishingyes (rebuilt digest sha256:4d8fc461229903ccc9401a241a9f18b61715fa1ff6431b7e67324c49e23c8e9d · published digest sha256:4d8fc461229903ccc9401a241a9f18b61715fa1ff6431b7e67324c49e23c8e9d · digest match yes · builder moby/buildkit:v0.31.2 · build seconds 372) [docs/provenance/REPRO_VERIFICATION.json, verified]
- Final contract gate (G8)PASS (checks artifact_coverage, assetchain_coverage, cosign, cpu_baseline, offline_rebuild, rebuild_manifest, scan_grade, scout_grade_a, script_copies, tag_base_os, trademark_shipped, vex_shipped) [g8_result.json, result]
- Grade at releaseA (percent 94 · docker grade B · docker percent 83 · tool docker scout policy 1.26.0 · config docker-default · org vex no · at 2026-11-07T03:15:35Z · failing Docker Scout counts 96 packages with copyleft licences (GPL, LGPL, MPL), all of them operating-system packages (it counts only packages whose licence it can read; the SBOM lists every component). · corrections No outdated base images) [SCOUT_EVIDENCE.json, docker_scout_policy.corrected]
- Image signatureverified on the index and the linux/amd64 manifest (key fingerprint 04daa92344a52dbc · at 2026-11-07T03:15:19Z) [docs/provenance/IMAGE_EVIDENCE.json, signed]
- Image signature transparency-log entries
- log index 3727887402 · transparency-log entry
- log index 3727887600 · transparency-log entry
- rebuild.json signatureSigstore bundle, release key (key fingerprint 04daa92344a52dbc · log index 3728593740 · transparency-log entry · integrated 2026-11-07T03:20:22Z) [ReadyStack-tempo-v3.1.1-CE-ubuntu24.04-r4.rebuild.json.sigstore, verificationMaterial.tlogEntries[0]]
- Signed attestations
- kind provenance · digest sha256:55d97453f38e96ee669f3e1a3aa3cb1754d8d975bad9fac2b4cc4e4129487e8d · state attached · log index 3728596599 · transparency-log entry
- kind sbom · digest sha256:55d97453f38e96ee669f3e1a3aa3cb1754d8d975bad9fac2b4cc4e4129487e8d · state attached · log index 3728598387 · transparency-log entry
- kind vsa · digest sha256:55d97453f38e96ee669f3e1a3aa3cb1754d8d975bad9fac2b4cc4e4129487e8d · state attached · log index 3728600193 · transparency-log entry
- kind provenance · digest sha256:4d8fc461229903ccc9401a241a9f18b61715fa1ff6431b7e67324c49e23c8e9d · state attached · log index 3728601688 · transparency-log entry
- kind sbom · digest sha256:4d8fc461229903ccc9401a241a9f18b61715fa1ff6431b7e67324c49e23c8e9d · state attached · log index 3728603192 · transparency-log entry
- kind vsa · digest sha256:4d8fc461229903ccc9401a241a9f18b61715fa1ff6431b7e67324c49e23c8e9d · state attached · log index 3728605153 · transparency-log entry
- Pins recorddocs/PINS.md and docs/provenance/PINS.json in the archive (https://readystack.dev/products/tempo/recipe) [docs/provenance/PINS.json]
Offline clean-room rebuilds
- 2026-11-07T02:48:14Z on build host 5 (Docker-in-Docker daemon with --network none): bit for bit yes, digest match yes, customer verify yes
rebuilt sha256:4d8fc461229903ccc9401a241a9f18b61715fa1ff6431b7e67324c49e23c8e9d [clean-room rebuild ledger, runs[596]]
- Not recorded: the policy tool's --result-file itself (its per-policy results are copied into SCOUT_EVIDENCE.json and the archive's IMAGE_EVIDENCE.json; the file is not kept)
Publication
Fully recorded 1 pending at generation- Image pushed (internal tag), publish_image passed2026-11-07T02:33:08Z [stage_runs, stage_runs chain 824 stage publish_image]
- Archive manifests written2026-11-07T03:17:57Z [PUBLISH_MANIFEST.json, published_at]
- Pending at generation: the archive cut-over on prodasset, the release tag's promotion and the site event (this trail was generated after G8 and before them; they are appended as a 'publication' event in History)
Packages and CPU level
Fully recorded- x86-64 level the image needsv1 (used v4 · baseline v2 · elf files 744 · probed 2026-11-07T02:24:26Z · source build_kit) [release_images, isa_level_hard]
History
2 events- 2026-11-07T03:21:43Z generated: by KitForge release/build_trail.py · generator commit 07abd1e1c1197982ae81cf5d46861dd8f90c3cf6
- 2026-11-07T03:23:39Z publication: promoted at 2026-11-07T03:22:20Z · promoted digest sha256:55d97453f38e96ee669f3e1a3aa3cb1754d8d975bad9fac2b4cc4e4129487e8d · promotion method imagetools_create_retag_by_digest_no_rebuild · site event 325 · checklist status complete · checklist at 2026-11-07T03:23:39Z · record workspace: deliverables/provenance/PROMOTION_RECORD.json, RELEASE_CHECKLIST.json
Records
25 records| Record | Where it is | Rows |
|---|---|---|
docs/defects/defects.json | inside the archive (ReadyStack-tempo-v3.1.1-CE-ubuntu24.04-r4.tar.gz) | — |
docs/provenance/IMAGE_EVIDENCE.json | inside the archive (ReadyStack-tempo-v3.1.1-CE-ubuntu24.04-r4.tar.gz) | — |
docs/provenance/LOCKED_DIGEST.txt | inside the archive (ReadyStack-tempo-v3.1.1-CE-ubuntu24.04-r4.tar.gz) | — |
docs/provenance/PINS.json | inside the archive (ReadyStack-tempo-v3.1.1-CE-ubuntu24.04-r4.tar.gz) | — |
docs/provenance/REPRO_VERIFICATION.json | inside the archive (ReadyStack-tempo-v3.1.1-CE-ubuntu24.04-r4.tar.gz) | — |
docs/provenance/SOURCE_TREE_HASH.json | inside the archive (ReadyStack-tempo-v3.1.1-CE-ubuntu24.04-r4.tar.gz) | — |
MANIFEST.json | beside the archive (prodasset /data/production/tempo/v3.1.1-CE-ubuntu24.04-r4/), as staged for publishing | — |
PUBLISH_MANIFEST.json | beside the archive (prodasset /data/production/tempo/v3.1.1-CE-ubuntu24.04-r4/), as staged for publishing | — |
ReadyStack-tempo-v3.1.1-CE-ubuntu24.04-r4.rebuild.json | beside the archive (prodasset /data/production/tempo/v3.1.1-CE-ubuntu24.04-r4/), as staged for publishing | — |
ReadyStack-tempo-v3.1.1-CE-ubuntu24.04-r4.rebuild.json.sigstore | beside the archive (prodasset /data/production/tempo/v3.1.1-CE-ubuntu24.04-r4/), as staged for publishing | — |
SCOUT_EVIDENCE.json | beside the archive (prodasset /data/production/tempo/v3.1.1-CE-ubuntu24.04-r4/), as staged for publishing | — |
clean-room rebuild ledger | the clean-room rebuild ledger (runstate/audit-2026-09/bit4bit.json, not published) | — |
build_requests | sadb, ReadyStack's engine database (not published) | 504 |
chains | sadb, ReadyStack's engine database (not published) | 824 |
defects | sadb, ReadyStack's engine database (not published) | tempo v3.1.1-CE-ubuntu24.04-r4 |
drive_runs | sadb, ReadyStack's engine database (not published) | chain 824 |
held_rounds | sadb, ReadyStack's engine database (not published) | chain 824 |
lesson_recalls | sadb, ReadyStack's engine database (not published) | chain 824 |
micro_step_runs | sadb, ReadyStack's engine database (not published) | chain 824 |
release_images | sadb, ReadyStack's engine database (not published) | tempo v3.1.1-CE-ubuntu24.04-r4 |
stage_events | sadb, ReadyStack's engine database (not published) | chain 824 |
stage_runs | sadb, ReadyStack's engine database (not published) | chain 824 |
attestations.json | the chain's workspace on the controller (not published) | — |
deliverables/provenance/PROMOTION_RECORD.json | the chain's workspace on the controller (not published) | — |
g8_result.json | the chain's workspace on the controller (not published) | — |