Loki v3.7.9-CE-ubuntu24.04-r5 build trail
How ReadyStack built readystack/loki:v3.7.9-CE-ubuntu24.04-r5 and its build kit, copied record by record: why the release exists, every chain, drive and stage it went through, the model work, the review rounds, the defects, the checks that verified it and when it was published. Each line names the record it comes from in brackets; a record that does not exist for this release says so.
This trail
As JSON- Image
readystack/loki:v3.7.9-CE-ubuntu24.04-r5 - Index digestsha256:ce79be999ffd245c43b3cbc8b9f8dc91dfc67794041e8d1a2409dc4b50b23fbe
- linux/amd64 digestsha256:5d35dcc33210a1d9d6e091513235f6766d554efd7368277250029c4da6e09cec
- Archive
ReadyStack-loki-v3.7.9-CE-ubuntu24.04-r5.tar.gz - Archive SHA-256 nowe7d163e6492db7fb060afc573da74cdc739e2c567ef1da0b42742d42b91f3f61
- Pins record
docs/PINS.md,docs/provenance/PINS.jsonin the archive (since generated) - Generated2026-11-11T06:11:39Z by KitForge release/build_trail.py
- Sections9 sections, 8 fully recorded; 1 item not recorded
Signed with the release key The trail's signature is a Sigstore bundle beside it. Check it is ours before you rely on it:
cosign verify-blob --key https://readystack.dev/keys/cosign.pub \ --bundle ReadyStack-loki-v3.7.9-CE-ubuntu24.04-r5.trail.json.sigstore ReadyStack-loki-v3.7.9-CE-ubuntu24.04-r5.trail.json
IdentityWhy this release existsThe path through the harnessModel work per stageReviewDefectsVerificationPublicationPackages and CPU level
Identity
Fully recorded- ProductLoki (loki) [MANIFEST.json]
- Release tagv3.7.9-CE-ubuntu24.04-r5 [MANIFEST.json]
- Imagereadystack/loki:v3.7.9-CE-ubuntu24.04-r5 [MANIFEST.json]
- Image index digestsha256:ce79be999ffd245c43b3cbc8b9f8dc91dfc67794041e8d1a2409dc4b50b23fbe [docs/provenance/LOCKED_DIGEST.txt]
- linux/amd64 image digestsha256:5d35dcc33210a1d9d6e091513235f6766d554efd7368277250029c4da6e09cec [ReadyStack-loki-v3.7.9-CE-ubuntu24.04-r5.rebuild.json, subject.image_manifest_digest]
- ArchiveReadyStack-loki-v3.7.9-CE-ubuntu24.04-r5.tar.gz (bytes 671976697) [MANIFEST.json]
- Archive sha256 at publishe7d163e6492db7fb060afc573da74cdc739e2c567ef1da0b42742d42b91f3f61 [MANIFEST.json, tarball_sha256]
- Archive records agreeyes [MANIFEST.json, PUBLISH_MANIFEST.json and .cutover.json name the same sha256]
- Repack historynone: the archive is as first published [MANIFEST.json, repack_history]
- Upstream repositoryhttps://github.com/grafana/loki [docs/provenance/SOURCE_TREE_HASH.json]
- Upstream refv3.7.9 [docs/provenance/SOURCE_TREE_HASH.json]
- Upstream commitd3b4a2f76bfc5625abee7ceb00b8896fa3c31549 [docs/provenance/SOURCE_TREE_HASH.json]
- Source tree hash7ea06a80ecfdb282b58518c1afb525b50b11736d48680cdda893e9bd49efbf9d (files 22500) [docs/provenance/SOURCE_TREE_HASH.json, tree_listing_sha256 (sha256 of the sorted file listing)]
- Kit tree hashsha256:cf5f4f8c141b86f86b9b10da0090912eae8c99422f274fce9843eb23b01a4841 [ReadyStack-loki-v3.7.9-CE-ubuntu24.04-r5.rebuild.json, inputs.tree_hash]
- SOURCE_DATE_EPOCH1794295407 (utc 2026-11-10T07:23:27Z) [ReadyStack-loki-v3.7.9-CE-ubuntu24.04-r5.rebuild.json, inputs.source_date_epoch]
- Base images
- ref golang:1.26.10-bookworm@sha256:632dff7351799a5a9954a48dc06670ade72ee44e8c351cdc0e5a57af2fea21af · platform digest sha256:88750ccdd0f2a77fcc00a14b1a48d6409bd8ddb5d7c2dd6ec0b4a2e916daf9d9
- ref ubuntu:24.04@sha256:fe81560990fae86dc4743202b2cb4d3df98d0bcf949173cecef15ce1127ef852 · platform digest sha256:78d4744ead1f5b19b04d0df558ab182a5300903900755e515b2ca4d10eb2044d
- BuildKitmoby/buildkit:v0.31.2 (image digest sha256:e0e67ea9c4bb07bdef683e29f70f3b623d1eb9c82274a9ec04e6bb0511449fb0) [ReadyStack-loki-v3.7.9-CE-ubuntu24.04-r5.rebuild.json, engine]
- Engine commit(s)
- commit 7dfd29d7f5001fb8fadf7d3fa0d9223cd56a6365 · dirty yes · first drive 4162
- commit 7f9440173909c696b80316b684e74f8071be97cf · dirty yes · first drive 4190
- commit e05220953a8a35bb19afca75bce1637a21d4c290 · dirty yes · first drive 4212
- commit 012c3daa353c9980746c2c19594c14de64d28de4 · dirty yes · first drive 4223
- commit 8c06307911557c927272aed1342f4fd649c279f0 · dirty yes · first drive 4227
- commit e06c8c0d4f40771692abda70ebb80df73b0cbb40 · dirty yes · first drive 4238
- commit 467eb57e7940ba12684129fd11ece63592f7796d · dirty yes · first drive 4245
- commit a4836e07f81f6892f34edb7d7205df35fc7ac7b0 · dirty yes · first drive 4259
- commit bccb9b96b7ab0eaa162fc6d62e6bf1c56b1840a1 · dirty yes · first drive 4262
- commit e32f755506839e1e8665016830ccd4c597d4312b · dirty yes · first drive 4265
Why this release exists
Fully recorded- Chain953 (created 2026-11-10T07:29:22Z · trigger customer_request · upstream version v3.7.9) [chains, chains #953]
- Requestbuild request #635 (rebuild) (requested at 2026-11-10T07:23:29Z · requested by kitforge-agent · version v3.7.9) [build_requests, build_requests #635]
- Reasonrerelease agenda REVISION -> v3.7.9-CE-ubuntu24.04-r5 (decay loop, IMP-08) [build_requests, build_requests #635 request_reason]
- Supersedesreadystack/loki:v3.7.9-CE-ubuntu24.04-r4 (chain 740) [chains, chains #740]
The path through the harness
Fully recorded1 chain · 10 drives · 18 stages · 5 rewinds
Chain 953 release · ready_to_ship
Created 2026-11-10T07:29:22Z, upstream v3.7.9, build request 635 [chains, chains #953]
| Drive | Started | Minutes | Build host | How it stopped |
|---|---|---|---|---|
| 4162 | 2026-11-10T07:29:55Z | 105.1 | build host 4 withhold-publish | stage_failed at package_archive; first failed check exists:checksums; 18 ticks [drive_runs, drive_runs #4162] |
| 4190 | 2026-11-10T21:36:08Z | 11.9 | build host 4 withhold-publish | ready_to_ship at package_archive; 2 ticks [drive_runs, drive_runs #4190] |
| 4212 | 2026-11-10T23:05:48Z | 6.7 | build host 4 withhold-publish | ready_to_ship at package_archive; 2 ticks [drive_runs, drive_runs #4212] |
| 4223 | 2026-11-10T23:57:44Z | 1.5 | build host 4 withhold-publish | stage_failed at package_archive; first failed check g8; 1 tick [drive_runs, drive_runs #4223] |
| 4227 | 2026-11-11T00:22:01Z | 1.8 | build host 4 withhold-publish | stage_failed at package_archive; first failed check g8; 1 tick [drive_runs, drive_runs #4227] |
| 4238 | 2026-11-11T01:25:56Z | 1.4 | build host 4 withhold-publish | stage_failed at package_archive; first failed check g8; 1 tick [drive_runs, drive_runs #4238] |
| 4245 | 2026-11-11T03:12:27Z | 5.8 | build host 4 withhold-publish | ready_to_ship at package_archive; 2 ticks [drive_runs, drive_runs #4245] |
| 4259 | 2026-11-11T04:56:37Z | 7.4 | build host 4 withhold-publish | ready_to_ship at package_archive; 2 ticks [drive_runs, drive_runs #4259] |
| 4262 | 2026-11-11T05:33:17Z | 6.2 | build host 4 withhold-publish | ready_to_ship at package_archive; 2 ticks [drive_runs, drive_runs #4262] |
| 4265 | 2026-11-11T06:04:20Z | — | build host 4 publish-held | not recorded [drive_runs, drive_runs #4265] |
Stages, in order
| Stage | First start | Passed | Attempts | Gate checks passed | Artifacts (SHA-256) |
|---|---|---|---|---|---|
intake |
2026-11-10T07:30:06Z | 2026-11-10T07:30:06Z | 1 | 4
|
order_json 6633471d1e38… |
acquire |
2026-11-10T07:30:21Z | 2026-11-10T07:30:24Z | 1 | 12
|
source_tree c19413e9dcf7…license_file 0d96a4ff68ad…custody_inputs d0a64d122325…source_tree_hash 2d82c9aba52a…source_file_manifest 3bd408631b43… |
plan |
2026-11-10T07:31:03Z | 2026-11-10T07:31:03Z | 1 | 10
|
recon_report 12891ff5f96f…input_pin_plan 477c8906630b…toolchain_lock 765a358dfe33… |
assemble_kit |
2026-11-10T07:37:58Z | 2026-11-10T07:37:59Z | 1 | 27
|
dockerfile bd3869f02a6a…build_recipe 211b346254e9…system_pinning aa8db05a9a8a…build_offline_sh 6633aa31b6b4…generate_sbom_sh ce0f1e6f1e70…first_boot_health 1858f3deb181…verify_offline_sh 3e8184ea230c…base_image_digests 1d7477733bd2…dockerfile_offline bd3869f02a6a…first_build_digest 84c46d13ef01… |
remediate |
2026-11-10T07:38:41Z | 2026-11-10T07:38:41Z | 1 | 8
|
vendored_apt e3b0c44298fc…remediation_log f268f45d93c5…security_report 91636167623b… |
build_kit |
2026-11-10T07:46:31Z | 2026-11-10T07:46:32Z | 1 | 9
|
cosign_stamp 5d37a4c54a11…locked_digest 7823e0678462…freeze_manifest 8a0894a70ffa…offline_rebuild_transcript 11ec0de779ca… |
verdict |
2026-11-10T07:47:12Z | 2026-11-10T07:47:12Z | 1 | 8
|
scout_verdict 4b4e63428f44… |
publish_image |
2026-11-10T07:47:47Z | 2026-11-10T07:47:48Z | 1 | 7
|
hub_readme 67a927de1218…promotion_record 43386b1b3b75… |
boot_instance |
2026-11-10T07:48:11Z | 2026-11-10T07:48:16Z | 2 | 3
|
instance_handle 183cc55523c4… |
sbom |
2026-11-10T07:48:27Z | 2026-11-10T07:48:28Z | 1 | 5
|
sbom_md b172eaa2442e…sbom_json 0a56725474b8… |
schema_discovery |
2026-11-10T07:48:30Z | 2026-11-10T07:48:31Z | 1 | 7
|
schema_hash 4ef43d41b9c2…dependency_tree 4b7d13fc5e9e…table_classification 0cad5c32db3c… |
admin_handbook |
2026-11-10T08:16:20Z | 2026-11-10T08:16:21Z | 1 | 7
|
api_map e2c63eda268e…admin_handbook e7b31f59e1ac… |
db_handbook |
2026-11-10T08:39:28Z | 2026-11-10T08:39:29Z | 1 | 8
|
db_handbook c0397b82c275…seed_isolation 44b7b90b89d9… |
seed_data |
2026-11-10T08:39:40Z | 2026-11-10T08:39:41Z | 1 | 6
|
seed_data_sql aa188c5a5836…seed_cases_json d5555572a3eb… |
seed_validate |
2026-11-10T08:39:43Z | 2026-11-10T08:39:44Z | 1 | 3
|
seed_data_contract e3926d51e7ca… |
usecase_validate |
2026-11-10T08:40:04Z | 2026-11-10T08:40:05Z | 1 | 10
|
failed_tests b2247b16f5f7…passed_tests 57268f155cd8…test_results 7a689cd7665a…usecase_contract 9472cb000fd4… |
finalize_docs |
2026-11-10T09:03:02Z | 2026-11-10T09:03:03Z | 1 | 9
|
defects_json 2bf52d0001ad…release_notes e9a1228ce30f…api_integration_guide dffd70bfa262… |
package_archive invalidated 2026-11-11T06:03:55Z |
2026-11-10T09:14:58Z | 2026-11-11T05:39:26Z | 9 | 35 (final gate PASS)
|
sale_tar b1dbf20e4008…checksums 9827400ad9eb…verify_md 060bfcf14798…rebuild_md cbc86ef184f9…manifest_txt 53240aec4306…actions_jsonl bca02ec4e9c0…provenance_md 924bb46264d0…assetchain_log_md e9eccaec0c0f…assetchain_log_json 6d400909bca3… |
[stage_runs]
Rewinds
- 2026-11-10T22:27:30Z:
package_archivetopackage_archiveon docs_redo (scripts/redo-docs.py --stage package_archive) [stage_events, stage_events #30815] - 2026-11-10T23:56:19Z:
package_archivetopackage_archiveon docs_redo (scripts/redo-docs.py --stage package_archive) [stage_events, stage_events #30946] - 2026-11-11T03:46:09Z:
package_archivetopackage_archiveon docs_redo (scripts/redo-docs.py --stage package_archive) [stage_events, stage_events #31111] - 2026-11-11T05:32:25Z:
package_archivetopackage_archiveon docs_redo (scripts/redo-docs.py --stage package_archive) [stage_events, stage_events #31252] - 2026-11-11T06:03:55Z:
package_archivetopackage_archiveon docs_redo (scripts/redo-docs.py --stage package_archive) [stage_events, stage_events #31262]
Model work per stage
Fully recordedRole: writer model. Calls up to 2026-11-11T05:39:26Z.
356 calls over 6 stages
| Stage | Calls | Refused | Errors | Max attempt | Forced commits | Real tokens | Lesson rules shown |
|---|---|---|---|---|---|---|---|
plan | 2 | 0 | 0 | 1 | 0 | 9905 | — |
remediate | 2 | 0 | 0 | 1 | 0 | 13751 | L-A08, L-038, L-036, L-034, L-032 |
admin_handbook | 117 | 50 | 0 | 3 | 11 | 1465882 | — |
db_handbook | 126 | 54 | 0 | 3 | 17 | 1640398 | — |
usecase_validate | 1 | 0 | 0 | 1 | 0 | 1778 | — |
finalize_docs | 108 | 43 | 0 | 3 | 11 | 1331881 | — |
[micro_step_runs] [lesson_recalls]
Review
Fully recordedRole: review model.
5 rounds, 5 counted, $15.68 recorded cost
| Round | Started | Critical | Major | Minor | Verdict | Cost | Cap in force | Archive reviewed |
|---|---|---|---|---|---|---|---|---|
| 1 | 2026-11-10T21:48:38Z | 0 | 4 | 44 | findings to repackage [held_rounds, held_rounds #1701] | $4.21 | 3 rounds, $40.00 | e53acdda5e65… |
| 2 | 2026-11-10T23:13:06Z | 0 | 0 | 24 | clean to repackage [held_rounds, held_rounds #1714] | $4.19 | 3 rounds, $40.00 | 99557f67df86… |
| 3 | 2026-11-11T03:18:54Z | 0 | 1 | 7 | findings to repackage [held_rounds, held_rounds #1727] | $2.54 | 3 rounds, $40.00 | 7ab15a711ad8… |
| 4 | 2026-11-11T05:04:14Z | 0 | 1 | 24 | findings to repackage [held_rounds, held_rounds #1736] | $3.57 | 3 rounds, $40.00 | aa327a96c5f5… |
| 5 | 2026-11-11T05:40:12Z | 0 | 0 | 4 | clean to publish [held_rounds, held_rounds #1738] | $1.16 | 3 rounds, $40.00 | b1dbf20e4008… |
Defects
Fully recorded- Ledger entries108 [defects, defects where product_slug=loki and this tag or chain]
- Disclosed in the archive108 [docs/defects/defects.json, entries]
108 ledger entries: by severity high 6, low 102; by status fixed-before-release 108.
| Defect | Severity | Status | Found by | Fixed in |
|---|---|---|---|---|
RSD-loki-94259bddcdAdmin handbook: The Product Overview push example does not work: the backslash-escaped quotes around $(date +%s%N) end up inside the JSON timestamp and Loki answers HTTP 400 instead of 204. [defects, defects #159076] | high | fixed-before-release | held review (review model) | — |
RSD-loki-eed3811ed7Database handbook: The "Verifying the restore" query fails with a LogQL parse error (HTTP 400), so a correct restore looks like a failed one. [defects, defects #232568] | high | fixed-before-release | held review (review model) | — |
RSD-loki-a1a10b0c46Database handbook: The "correct form" in the parse-error troubleshooting entry still contains backslash-escaped quotes inside single quotes and returns the same HTTP 400 parse error. [defects, defects #232569] | high | fixed-before-release | held review (review model) | — |
RSD-loki-c63b7e3547Database handbook: Says no delete API exists with retention enabled; it does (POST 204 / GET 200) and it is unauthenticated, so the reader is told an exposure does not exist while the other sections warn about it. [defects, defects #232570] | high | fixed-before-release | held review (review model) | — |
RSD-loki-47693c3042Admin handbook: Names uid 10001 as the old release's uid, then tells the reader to chown to 10001: self-contradictory; the old uid was 999. [defects, defects #232571] | low | fixed-before-release | held review (review model) | — |
RSD-loki-7d2016098bDatabase handbook: Gives 10001 as the uid of the earlier release whose volume needs a chown to 10001. [defects, defects #232572] | low | fixed-before-release | held review (review model) | — |
RSD-loki-6ae563d01dDatabase handbook: Same wrong example uid: the earlier release ran as 999, not 10001. [defects, defects #232573] | low | fixed-before-release | held review (review model) | — |
RSD-loki-c860349889Database handbook: States the pre-r3 user was uid 10001 (it was 999) and that the restored volume then fails to start without a chown; the documented restore extracts as uid 10001 so the files come out owned by 10001. [defects, defects #232574] | low | fixed-before-release | held review (review model) | — |
RSD-loki-3a61fc97faDatabase handbook: Reads as if r5 changed the user relative to the previous revision; the previous revision (r4) already ran as 10001. [defects, defects #232575] | low | fixed-before-release | held review (review model) | — |
RSD-loki-9f8d87e25aDatabase handbook: Heading names a change from uid 10001 to uid 10001. [defects, defects #232576] | low | fixed-before-release | held review (review model) | — |
RSD-loki-d2c4c892a5Database handbook: Names r3 as the previous release; this release supersedes r4. [defects, defects #232577] | low | fixed-before-release | held review (review model) | — |
RSD-loki-1c2c960a9aDatabase handbook: Two different thresholds for the same guidance (ReadyStack revisions r2/r3 here, Loki version 3.7.0 at line 1929); r4 is left out. [defects, defects #232578] | low | fixed-before-release | held review (review model) | — |
RSD-loki-08d0c3503bAPI guide: Wrong predecessor: r5 supersedes r4. [defects, defects #232579] | low | fixed-before-release | held review (review model) | — |
RSD-loki-0c93db8367API guide: Wrong predecessor: r5 supersedes r4. [defects, defects #232580] | low | fixed-before-release | held review (review model) | — |
RSD-loki-56dc7e05f9API guide: "r5 and later" reads as if r5 introduced uid 10001; r3 and r4 already ran as 10001. [defects, defects #232581] | low | fixed-before-release | held review (review model) | — |
RSD-loki-8964f58903API guide: Two different thresholds (3.7.9 here, 3.7.0 at line 2544) for the same guidance. [defects, defects #232582] | low | fixed-before-release | held review (review model) | — |
RSD-loki-4b329cd1f8Admin handbook: The "reverse" chown goes to uid 999, not 10001; as written a rollback to r2 would still fail with permission denied. [defects, defects #232583] | low | fixed-before-release | held review (review model) | — |
RSD-loki-2a01f60a7bAdmin handbook: Implies the configuration cannot be copied from a stopped container; it can, and the next sections do exactly that. [defects, defects #232584] | low | fixed-before-release | held review (review model) | — |
RSD-loki-8db9710b43Admin handbook: The cat-from-image command shows the shipped file, not the current/effective configuration. [defects, defects #232585] | low | fixed-before-release | held review (review model) | — |
RSD-loki-9cddd1ab81Admin handbook: The first command offered prints just the file, not the running configuration with defaults. [defects, defects #232586] | low | fixed-before-release | held review (review model) | — |
RSD-loki-7cecdc4b54Admin handbook: The cat-from-image command cannot show whether the customer's mounted file is readable or valid. [defects, defects #232587] | low | fixed-before-release | held review (review model) | — |
RSD-loki-5b053a282eDatabase handbook: Same family: the cat-from-image command shows the shipped file, not the file that failed. [defects, defects #232588] | low | fixed-before-release | held review (review model) | — |
RSD-loki-91dda60d14Admin handbook: Says Loki will not start without all three keys and that a missing store gives a 404; a missing store makes Loki exit, and a missing retention_period starts normally. [defects, defects #232589] | low | fixed-before-release | held review (review model) | — |
RSD-loki-14d92cfcc7Database handbook: Same overstatement: omitting retention_period does not stop Loki starting. [defects, defects #232590] | low | fixed-before-release | held review (review model) | — |
RSD-loki-29fcfa9f9cDatabase handbook: Tells the reader to locate a section the shipped file does not contain. [defects, defects #232591] | low | fixed-before-release | held review (review model) | — |
RSD-loki-1d570ede96Admin handbook: Implies /services shows Pending states during startup and reflects readiness. [defects, defects #232592] | low | fixed-before-release | held review (review model) | — |
RSD-loki-bd7307fc92API guide: A Running module is not necessarily ready; /services is Running while /ready is still 503. [defects, defects #232593] | low | fixed-before-release | held review (review model) | — |
RSD-loki-96047f0798API guide: Implies /services shows which modules are still initializing during the 14-17 s before /ready; measured all Running long before. [defects, defects #232594] | low | fixed-before-release | held review (review model) | — |
RSD-loki-5d1c9727bdAPI guide: Contradicts the measured behaviour: modules are Running long before /ready. [defects, defects #232595] | low | fixed-before-release | held review (review model) | — |
RSD-loki-7ba6a668b3Database handbook: Contradicts the neighbouring paragraph (and the measurement): the modules are Running after ~2 s, not 12-17 s. [defects, defects #232596] | low | fixed-before-release | held review (review model) | — |
RSD-loki-7e78f5a632API guide: Describes the start period as a delay before checks begin; checks run from the start and only their failures are ignored. [defects, defects #232597] | low | fixed-before-release | held review (review model) | — |
RSD-loki-c2f961f173Database handbook: Same start-period misdescription. [defects, defects #232598] | low | fixed-before-release | held review (review model) | — |
RSD-loki-006c60cdb1Admin handbook: States the opposite of the measured behaviour and of the rest of the handbook. [defects, defects #232599] | low | fixed-before-release | held review (review model) | — |
RSD-loki-d1cf96d76aAdmin handbook: Tells the reader to delete files inside /loki, contradicting every other section (free space outside /loki, or enlarge). [defects, defects #232600] | low | fixed-before-release | held review (review model) | — |
RSD-loki-3aeac2fb31Database handbook: The grep level=error shown above it will not list these messages; they are logged at level=warn. [defects, defects #232601] | low | fixed-before-release | held review (review model) | — |
RSD-loki-e3d4ff1685Database handbook: docker volume inspect does not report disk usage. [defects, defects #232602] | low | fixed-before-release | held review (review model) | — |
RSD-loki-46b484545cDatabase handbook: Absolute claim contradicts the retention sections: retention and the delete API remove logs. [defects, defects #232603] | low | fixed-before-release | held review (review model) | — |
RSD-loki-bdbf105389Admin handbook: Says a removed container's name is preserved; removal frees the name (that is why the next `docker run --name loki` works). [defects, defects #232604] | low | fixed-before-release | held review (review model) | — |
RSD-loki-109376cd87Database handbook: False isolation claim: the host can also reach the unpublished container ports on the bridge network. [defects, defects #232605] | low | fixed-before-release | held review (review model) | — |
RSD-loki-26188393d9API guide: A peer container cannot reach Loki's 9095 at localhost:9095. [defects, defects #232606] | low | fixed-before-release | held review (review model) | — |
RSD-loki-cc11a1b5a5Database handbook: Wrong response shape for an empty query_range window (it is the labels endpoint that omits data). [defects, defects #232607] | low | fixed-before-release | held review (review model) | — |
RSD-loki-d32ed53de6Database handbook: The log lines are logfmt key=value text, not JSON. [defects, defects #232608] | low | fixed-before-release | held review (review model) | — |
RSD-loki-01c6457967Admin handbook: Wrong default for a lone `start`: the end is now, not one hour after the start. [defects, defects #232609] | low | fixed-before-release | held review (review model) | — |
RSD-loki-b8b725f109API guide: Wrong default for a lone `start`. [defects, defects #232610] | low | fixed-before-release | held review (review model) | — |
RSD-loki-5c7dce43b5API guide: Wrong default for a lone `start`. [defects, defects #232611] | low | fixed-before-release | held review (review model) | — |
RSD-loki-9bacec749bAPI guide: The labels endpoint does accept `since`. [defects, defects #232612] | low | fixed-before-release | held review (review model) | — |
RSD-loki-a51daa7980Admin handbook: Without -i/-t the command opens no interactive shell. [defects, defects #232613] | low | fixed-before-release | held review (review model) | — |
RSD-loki-192e31b8ecDatabase handbook: The command as written is not found; it must be run as ./VERIFY_OFFLINE.sh. [defects, defects #232614] | low | fixed-before-release | held review (review model) | — |
RSD-loki-ac50a3cb1aAdmin handbook: Says healthy is reached only after the start period; the container turned healthy at ~21 s, inside the 25 s start period. [defects, defects #236994] | low | fixed-before-release | held review (review model) | — |
RSD-loki-934401773dAdmin handbook: Under "In a new container:" the command is offered as the way to get a shell but without -it it opens none and exits at once. [defects, defects #236995] | low | fixed-before-release | held review (review model) | — |
RSD-loki-e289a1866aAdmin handbook: Tells the reader a restore needs the sudo chown; the documented restore needs none, contradicting the other sections. [defects, defects #236996] | low | fixed-before-release | held review (review model) | — |
RSD-loki-6838b3ab92Database handbook: The command offered to check disk usage does not report disk usage. [defects, defects #236997] | low | fixed-before-release | held review (review model) | — |
RSD-loki-63c0c40b59Database handbook: The name http://loki:3100 does not resolve from a peer container on the default bridge network. [defects, defects #236998] | low | fixed-before-release | held review (review model) | — |
RSD-loki-dcaf834c77Database handbook: Quoted error text is not what Loki prints and differs from the rest of the handbooks. [defects, defects #236999] | low | fixed-before-release | held review (review model) | — |
RSD-loki-70bccf298fDatabase handbook: Step says to copy the current configuration from the running container but gives a command that reads the image's shipped file. [defects, defects #237000] | low | fixed-before-release | held review (review model) | — |
RSD-loki-e8129857e7API guide: States /metrics has no disk-usage figure; it exports loki_ingester_wal_disk_usage_percent, and the guide contradicts itself at line 1081. [defects, defects #237001] | low | fixed-before-release | held review (review model) | — |
RSD-loki-d5869781f3API guide: Names a Pending state that /services does not show and suggests /services tracks startup progress. [defects, defects #237002] | low | fixed-before-release | held review (review model) | — |
RSD-loki-6ae586a485API guide: Implies the labels endpoint lacks since and the reader must go to query_range; labels accepts since. [defects, defects #237003] | low | fixed-before-release | held review (review model) | — |
RSD-loki-84a5f6f1b8Database handbook: Claims retention resumes ingestion at 90% used; it is age-based with a 2 h delete delay and was never shown to clear the guard. [defects, defects #237004] | low | fixed-before-release | held review (review model) | — |
RSD-loki-d49900ec51API guide: Says chunk deletion is triggered by disk usage reaching the threshold. [defects, defects #237005] | low | fixed-before-release | held review (review model) | — |
RSD-loki-430d520c8dAdmin handbook: Says the docs/ copies of both scripts print SOURCE_DATE_EPOCH.txt missing; the VERIFY copies print a different error. [defects, defects #237006] | low | fixed-before-release | held review (review model) | — |
RSD-loki-e6a8ac38efDatabase handbook: Says the docs/ copies are not executable (mode 755) and both fail with SOURCE_DATE_EPOCH.txt missing. [defects, defects #237007] | low | fixed-before-release | held review (review model) | — |
RSD-loki-89bf06c6d8Admin handbook: Describes the boot check against the 25 s start period and a "Running" state; the script uses a 180 s window and an HTTP 2xx only. [defects, defects #237008] | low | fixed-before-release | held review (review model) | — |
RSD-loki-0ca6b37213Database handbook: Says Loki has no built-in TLS; Loki serves HTTPS natively when configured. [defects, defects #237009] | low | fixed-before-release | held review (review model) | — |
RSD-loki-c82f0a90deDatabase handbook: Says Loki has no TLS termination; it can terminate TLS itself when configured. [defects, defects #237010] | low | fixed-before-release | held review (review model) | — |
RSD-loki-68979ac286Admin handbook: States gRPC TLS cannot be configured; the server exposes grpc_tls_config. [defects, defects #237011] | low | fixed-before-release | held review (review model) | — |
RSD-loki-a692f5cc0eAdmin handbook: Asserts upgrade and downgrade works between revisions, which the records do not show and db-handbook:1867 denies. [defects, defects #237012] | low | fixed-before-release | held review (review model) | — |
RSD-loki-991e99576cAPI guide: Implies enlarging the volume or removing external files removes stored logs; it contradicts the sentence before it. [defects, defects #237013] | low | fixed-before-release | held review (review model) | — |
RSD-loki-ee4bc9e428Database handbook: Lists a non-existent route "GET /config:" and omits the delete endpoint that exists with retention on (the next sections of the same handbook document it). [defects, defects #237014] | low | fixed-before-release | held review (review model) | — |
RSD-loki-9ec525fbf4Database handbook: Says the extraction preserves ownership; a non-root extraction assigns uid 10001, which is why no chown is needed. [defects, defects #237015] | low | fixed-before-release | held review (review model) | — |
RSD-loki-37b613cb6dDatabase handbook: Identifies the affected releases by a date that no record supports instead of by revision. [defects, defects #237016] | low | fixed-before-release | held review (review model) | — |
RSD-loki-f039bb9d75Admin handbook: In the Restore procedure the `docker cp loki:/etc/loki/config.yaml ./config.yaml` step comes after `docker rm loki` and after the new container has been started on new-loki-data without a config… [defects, defects #242810] | high | fixed-before-release | held review (review model) | — |
RSD-loki-d006fa2d16Admin handbook: VERIFY_OFFLINE.sh never checks the container's state. [defects, defects #242811] | low | fixed-before-release | held review (review model) | — |
RSD-loki-b676e1cc7bAdmin handbook: Says the image has no way to pass additional flags without modifying the ENTRYPOINT. [defects, defects #242812] | low | fixed-before-release | held review (review model) | — |
RSD-loki-281231e470Database handbook: Paraphrase of the round-2 finding 'Says the extraction preserves ownership; a non-root extraction assigns uid 10001'. [defects, defects #242813] | low | fixed-before-release | held review (review model) | — |
RSD-loki-c1d0419ef1Database handbook: Offered as the list of endpoints available on this release, it omits /loki/api/v1/delete, which the retention sections of this handbook (2256-2290) say becomes available once retention is on, and it… [defects, defects #242814] | low | fixed-before-release | held review (review model) | — |
RSD-loki-0c90b569b1API guide: Claims the uid cannot be changed at runtime. [defects, defects #242815] | low | fixed-before-release | held review (review model) | — |
RSD-loki-47d380c163Admin handbook: Asserts that the r3/r4 -> r5 upgrade works and the data format is unchanged, which the records do not show. [defects, defects #242816] | low | fixed-before-release | held review (review model) | — |
RSD-loki-19585a9fe4Admin handbook: Implies the upgrade from the previous 3.7.x release was tested; line 2209 of the same handbook and DB_HANDBOOK.md:1867 say no upgrade or rollback was run. [defects, defects #242817] | low | fixed-before-release | held review (review model) | — |
RSD-loki-9ea744d7f8Admin handbook: In 'Keeping configuration changes across a restore' the restore block already ends with `docker run -d --name loki` (no config mount); step 2 says 'After the restore's docker run, mount the file… [defects, defects #246981] | high | fixed-before-release | held review (review model) | — |
RSD-loki-dcbca30a05Admin handbook: Round-3 minor not fixed: the script never checks that the container is in a running state; it tests only the /ready HTTP status. [defects, defects #246982] | low | fixed-before-release | held review (review model) | — |
RSD-loki-9cf60b644cAdmin handbook: 'boots without errors' is not something the script checks. [defects, defects #246983] | low | fixed-before-release | held review (review model) | — |
RSD-loki-63d726c4acAdmin handbook: Round-3 minor still present: 'The data format is unchanged' asserts r3/r4 -> r5 data compatibility that no record shows. [defects, defects #246984] | low | fixed-before-release | held review (review model) | — |
RSD-loki-0221174363Admin handbook: 'other than 3.7.x are untested' implies 3.7.x upgrades were tested; the same handbook says none was run. [defects, defects #246985] | low | fixed-before-release | held review (review model) | — |
RSD-loki-b425cd6b85API guide: Same implication as ADMIN:1519: 'Upgrades from releases other than 3.7.x are untested' suggests 3.7.x upgrades were tested. [defects, defects #246986] | low | fixed-before-release | held review (review model) | — |
RSD-loki-c64c48d0d7Database handbook: Round-3 minor still present: states as fact that data created by r3/r2 is readable by r5, then says three lines later nothing was tested. [defects, defects #246987] | low | fixed-before-release | held review (review model) | — |
RSD-loki-b368e4d7bbDatabase handbook: The r3/r4 -> r5 upgrade section gives the procedure and says no additional step is needed without the 'not tested' caveat carried by the neighbouring section. [defects, defects #246988] | low | fixed-before-release | held review (review model) | — |
RSD-loki-434b62eef5Database handbook: Rewritten section: the closing sentence lists the endpoints 'this guide documents on this release' without /loki/api/v1/delete, which the preceding paragraph of the same section documents; same… [defects, defects #246989] | low | fixed-before-release | held review (review model) | — |
RSD-loki-62dd396315Admin handbook: 'image ID of the rebuilt binary' and 'you see only the BuildKit's digest in docker images output' misdescribe the printed value (a manifest digest of the image) and the docker images listing. [defects, defects #246990] | low | fixed-before-release | held review (review model) | — |
RSD-loki-cdd6dc0b93Database handbook: The digest compared is that of rebuilt.oci.tar, not 'the loaded image'; the readiness test is any HTTP 2xx within 180 s, not 'HTTP 200 within the expected startup window'. [defects, defects #246991] | low | fixed-before-release | held review (review model) | — |
RSD-loki-6b4e00e590Database handbook: 'the ReadyStack registry' is not where the image is pulled from. [defects, defects #246992] | low | fixed-before-release | held review (review model) | — |
RSD-loki-c73ff7a796Database handbook: Cold-start range contradicts the 14–17 s measured and stated elsewhere (also DB_HANDBOOK.md:2376 and API guide line 443). [defects, defects #246993] | low | fixed-before-release | held review (review model) | — |
RSD-loki-0168b739c4Database handbook: 'Loki will not serve the HTTP API without a working 9095 listener ... [defects, defects #246994] | low | fixed-before-release | held review (review model) | — |
RSD-loki-326663abfaDatabase handbook: The check is described as run 'in the container' but starts a separate busybox container (an extra image pull, not part of this release; absent from air-gapped hosts). [defects, defects #246995] | low | fixed-before-release | held review (review model) | — |
RSD-loki-c40cac29cfAPI guide: Claims every label name is returned 'regardless of how old the logs are'; upstream defines a 6-hour default window. [defects, defects #246996] | low | fixed-before-release | held review (review model) | — |
RSD-loki-553e8a246eAPI guide: Says labels are returned 'across all time'; the default start is 6 hours ago. [defects, defects #246997] | low | fixed-before-release | held review (review model) | — |
RSD-loki-c3529e15c4API guide: 'regardless of how old they are' contradicts upstream's 6-hour default. [defects, defects #246998] | low | fixed-before-release | held review (review model) | — |
RSD-loki-931c9ac0c3API guide: Listed among the metrics the shipped image exposes, but the series is absent unless runtime_config is set. [defects, defects #246999] | low | fixed-before-release | held review (review model) | — |
RSD-loki-82e48dc3ffAPI guide: 'the resulting tar or copy will own the files as uid 10001, requiring you to adjust ownership on restore' is wrong for both a root tar (records 10001) and a root cp (root-owned). [defects, defects #247000] | low | fixed-before-release | held review (review model) | — |
RSD-loki-22f97c8b26API guide: 'is read-only' is false (the file is writable in the container) and contradicts the handbook sections that describe in-container edits. [defects, defects #247001] | low | fixed-before-release | held review (review model) | — |
RSD-loki-aa1a87ddf1API guide: 'read-only within the image' is false and contradicts ADMIN_HANDBOOK.md:2255. [defects, defects #247002] | low | fixed-before-release | held review (review model) | — |
RSD-loki-470f7a0314Admin handbook: 'the containerized tar handles the file ownership' repeats the ownership-preservation paraphrase: the restore does not preserve or set ownership, it creates files as the extracting uid. [defects, defects #247003] | low | fixed-before-release | held review (review model) | — |
RSD-loki-30e6cbf901Admin handbook: 'The containerized tar preserves the uid 10001 file ownership' is the paraphrase family of the round-2/round-3 'extraction preserves ownership' finding. [defects, defects #247004] | low | fixed-before-release | held review (review model) | — |
RSD-loki-fb95741993Admin handbook: 'keeps the correct ownership for a later restore' attributes to the backup an ownership guarantee that comes from the extracting uid. [defects, defects #247005] | low | fixed-before-release | held review (review model) | — |
RSD-loki-3b391e86feAPI guide: The message text names equality but the check rejects only end < start; the sentence says equal values are refused. [defects, defects #247930] | low | fixed-before-release | held review (review model) | — |
RSD-loki-ada3d6a2d8Admin handbook: Paraphrase of the 'tar preserves file ownership' claim that earlier rounds corrected elsewhere; it also says 'extract' for the backup command, which creates the archive. [defects, defects #247931] | low | fixed-before-release | held review (review model) | — |
RSD-loki-80b00857ccAdmin handbook: Same paraphrase family as the round-2 to round-4 ownership findings, still present in the closing summary. [defects, defects #247932] | low | fixed-before-release | held review (review model) | — |
RSD-loki-c40610fbabDatabase handbook: Exhaustive route list introduced by the rewrite of 'Enabling Retention (continued)'; other routes answer 200. [defects, defects #247933] | low | fixed-before-release | held review (review model) | — |
Verification
1 item not recorded- Reproduced before publishingyes (rebuilt digest sha256:5d35dcc33210a1d9d6e091513235f6766d554efd7368277250029c4da6e09cec · published digest sha256:5d35dcc33210a1d9d6e091513235f6766d554efd7368277250029c4da6e09cec · digest match yes · builder moby/buildkit:v0.31.2 · build seconds 218) [docs/provenance/REPRO_VERIFICATION.json, verified]
- Final contract gate (G8)PASS (checks artifact_coverage, assetchain_coverage, cosign, cpu_baseline, offline_rebuild, rebuild_manifest, scan_grade, scout_grade_a, script_copies, tag_base_os, thread_exit, trademark_shipped, vex_shipped) [g8_result.json, result]
- Grade at releaseA (percent 94 · tool docker scout policy 1.26.0 · config docker-default · org vex no · at 2026-11-11T06:04:45Z · failing Docker Scout counts 10 packages with copyleft licences (GPL, LGPL, MPL), all of them operating-system packages (it counts only packages whose licence it can read; the SBOM lists every component).) [SCOUT_EVIDENCE.json, docker_scout_policy]
- Image signatureverified on the index and the linux/amd64 manifest (key fingerprint 04daa92344a52dbc · at 2026-11-11T06:04:34Z) [docs/provenance/IMAGE_EVIDENCE.json, signed]
- Image signature transparency-log entries
- log index 3781355144 · transparency-log entry
- log index 3781356595 · transparency-log entry
- rebuild.json signatureSigstore bundle, release key (key fingerprint 04daa92344a52dbc · log index 3804114140 · transparency-log entry · integrated 2026-11-11T06:10:08Z) [ReadyStack-loki-v3.7.9-CE-ubuntu24.04-r5.rebuild.json.sigstore, verificationMaterial.tlogEntries[0]]
- Signed attestations
- kind provenance · digest sha256:ce79be999ffd245c43b3cbc8b9f8dc91dfc67794041e8d1a2409dc4b50b23fbe · state attached · log index 3804118801 · transparency-log entry
- kind sbom · digest sha256:ce79be999ffd245c43b3cbc8b9f8dc91dfc67794041e8d1a2409dc4b50b23fbe · state attached · log index 3804120194 · transparency-log entry
- kind vsa · digest sha256:ce79be999ffd245c43b3cbc8b9f8dc91dfc67794041e8d1a2409dc4b50b23fbe · state attached · log index 3804122114 · transparency-log entry
- kind provenance · digest sha256:5d35dcc33210a1d9d6e091513235f6766d554efd7368277250029c4da6e09cec · state attached · log index 3804124288 · transparency-log entry
- kind sbom · digest sha256:5d35dcc33210a1d9d6e091513235f6766d554efd7368277250029c4da6e09cec · state attached · log index 3804126159 · transparency-log entry
- kind vsa · digest sha256:5d35dcc33210a1d9d6e091513235f6766d554efd7368277250029c4da6e09cec · state attached · log index 3804128434 · transparency-log entry
- Pins recorddocs/PINS.md and docs/provenance/PINS.json in the archive (https://readystack.dev/products/loki/recipe) [docs/provenance/PINS.json]
Offline clean-room rebuilds
- 2026-11-10T21:48:44Z on build host 4 (Docker-in-Docker daemon with --network none): bit for bit yes, digest match yes, customer verify yes
rebuilt sha256:5d35dcc33210a1d9d6e091513235f6766d554efd7368277250029c4da6e09cec [clean-room rebuild ledger, runs[728]]
- Not recorded: the policy tool's --result-file itself (its per-policy results are copied into SCOUT_EVIDENCE.json and the archive's IMAGE_EVIDENCE.json; the file is not kept)
Publication
Fully recorded 1 pending at generation- Image pushed (internal tag), publish_image passed2026-11-10T07:47:48Z [stage_runs, stage_runs chain 953 stage publish_image]
- Archive manifests written2026-11-11T06:08:05Z [PUBLISH_MANIFEST.json, published_at]
- Pending at generation: the archive cut-over on prodasset, the release tag's promotion and the site event (this trail was generated after G8 and before them; they are appended as a 'publication' event in History)
Packages and CPU level
Fully recorded- x86-64 level the image needsv1 (used v4 · baseline v2 · elf files 61 · probed 2026-11-10T07:42:37Z · source build_kit) [release_images, isa_level_hard]
History
2 events- 2026-11-11T06:11:39Z generated: by KitForge release/build_trail.py · generator commit e32f755506839e1e8665016830ccd4c597d4312b
- 2026-11-11T06:13:08Z publication: promoted at 2026-11-11T06:12:12Z · promoted digest sha256:ce79be999ffd245c43b3cbc8b9f8dc91dfc67794041e8d1a2409dc4b50b23fbe · promotion method imagetools_create_retag_by_digest_no_rebuild · site event 466 · checklist status complete · checklist at 2026-11-11T06:13:08Z · record workspace: deliverables/provenance/PROMOTION_RECORD.json, RELEASE_CHECKLIST.json
Records
25 records| Record | Where it is | Rows |
|---|---|---|
docs/defects/defects.json | inside the archive (ReadyStack-loki-v3.7.9-CE-ubuntu24.04-r5.tar.gz) | — |
docs/provenance/IMAGE_EVIDENCE.json | inside the archive (ReadyStack-loki-v3.7.9-CE-ubuntu24.04-r5.tar.gz) | — |
docs/provenance/LOCKED_DIGEST.txt | inside the archive (ReadyStack-loki-v3.7.9-CE-ubuntu24.04-r5.tar.gz) | — |
docs/provenance/PINS.json | inside the archive (ReadyStack-loki-v3.7.9-CE-ubuntu24.04-r5.tar.gz) | — |
docs/provenance/REPRO_VERIFICATION.json | inside the archive (ReadyStack-loki-v3.7.9-CE-ubuntu24.04-r5.tar.gz) | — |
docs/provenance/SOURCE_TREE_HASH.json | inside the archive (ReadyStack-loki-v3.7.9-CE-ubuntu24.04-r5.tar.gz) | — |
MANIFEST.json | beside the archive (prodasset /data/production/loki/v3.7.9-CE-ubuntu24.04-r5/), as staged for publishing | — |
PUBLISH_MANIFEST.json | beside the archive (prodasset /data/production/loki/v3.7.9-CE-ubuntu24.04-r5/), as staged for publishing | — |
ReadyStack-loki-v3.7.9-CE-ubuntu24.04-r5.rebuild.json | beside the archive (prodasset /data/production/loki/v3.7.9-CE-ubuntu24.04-r5/), as staged for publishing | — |
ReadyStack-loki-v3.7.9-CE-ubuntu24.04-r5.rebuild.json.sigstore | beside the archive (prodasset /data/production/loki/v3.7.9-CE-ubuntu24.04-r5/), as staged for publishing | — |
SCOUT_EVIDENCE.json | beside the archive (prodasset /data/production/loki/v3.7.9-CE-ubuntu24.04-r5/), as staged for publishing | — |
clean-room rebuild ledger | the clean-room rebuild ledger (runstate/audit-2026-09/bit4bit.json, not published) | — |
build_requests | sadb, ReadyStack's engine database (not published) | 635 |
chains | sadb, ReadyStack's engine database (not published) | 953 |
defects | sadb, ReadyStack's engine database (not published) | loki v3.7.9-CE-ubuntu24.04-r5 |
drive_runs | sadb, ReadyStack's engine database (not published) | chain 953 |
held_rounds | sadb, ReadyStack's engine database (not published) | chain 953 |
lesson_recalls | sadb, ReadyStack's engine database (not published) | chain 953 |
micro_step_runs | sadb, ReadyStack's engine database (not published) | chain 953 |
release_images | sadb, ReadyStack's engine database (not published) | loki v3.7.9-CE-ubuntu24.04-r5 |
stage_events | sadb, ReadyStack's engine database (not published) | chain 953 |
stage_runs | sadb, ReadyStack's engine database (not published) | chain 953 |
attestations.json | the chain's workspace on the controller (not published) | — |
deliverables/provenance/PROMOTION_RECORD.json | the chain's workspace on the controller (not published) | — |
g8_result.json | the chain's workspace on the controller (not published) | — |