Apache Airflow 3.3.2-CE-ubuntu24.04-r5 build trail
How ReadyStack built readystack/airflow:3.3.2-CE-ubuntu24.04-r5 and its build kit, copied record by record: why the release exists, every chain, drive and stage it went through, the model work, the review rounds, the defects, the checks that verified it and when it was published. Each line names the record it comes from in brackets; a record that does not exist for this release says so.
This trail
As JSON- Image
readystack/airflow:3.3.2-CE-ubuntu24.04-r5 - Index digestsha256:abe81f278d0992a3b1968e8440e2a3a368da9e464621a712fc74fae261c0586b
- linux/amd64 digestsha256:b411b52e4e7e0ecb4e5912aa466778e923c79257ad31af1b641d90b9a81b59e2
- Archive
ReadyStack-airflow-3.3.2-CE-ubuntu24.04-r5.tar.gz - Archive SHA-256 now2b1c040e60da742d5d1ace37259d7e62ed80708e9af72a57d1e237b081c89b38
- Generated2026-11-02T23:33:35Z by KitForge release/build_trail.py
- Sections9 sections, 3 fully recorded; 13 items not recorded
Signed with the release key The trail's signature is a Sigstore bundle beside it. Check it is ours before you rely on it:
cosign verify-blob --key https://readystack.dev/keys/cosign.pub \ --bundle ReadyStack-airflow-3.3.2-CE-ubuntu24.04-r5.trail.json.sigstore ReadyStack-airflow-3.3.2-CE-ubuntu24.04-r5.trail.json
IdentityWhy this release existsThe path through the harnessModel work per stageReviewDefectsVerificationPublicationPackages and CPU level
Identity
1 item not recorded- ProductApache Airflow (airflow) [MANIFEST.json]
- Release tag3.3.2-CE-ubuntu24.04-r5 [MANIFEST.json]
- Imagereadystack/airflow:3.3.2-CE-ubuntu24.04-r5 [MANIFEST.json]
- Image index digestsha256:abe81f278d0992a3b1968e8440e2a3a368da9e464621a712fc74fae261c0586b [docs/provenance/LOCKED_DIGEST.txt]
- linux/amd64 image digestsha256:b411b52e4e7e0ecb4e5912aa466778e923c79257ad31af1b641d90b9a81b59e2 [ReadyStack-airflow-3.3.2-CE-ubuntu24.04-r5.rebuild.json, subject.image_manifest_digest]
- ArchiveReadyStack-airflow-3.3.2-CE-ubuntu24.04-r5.tar.gz (bytes 492569649) [MANIFEST.json]
- Archive sha256 at publishb9fbf5f414577866b701c0a10ffc77a298db2880a51c46458b049d53e5bfd372 [MANIFEST.json, repack_history[0].previous_tarball_sha256]
- Archive sha256 now2b1c040e60da742d5d1ace37259d7e62ed80708e9af72a57d1e237b081c89b38 [MANIFEST.json, tarball_sha256]
- Archive records agreeyes [MANIFEST.json, PUBLISH_MANIFEST.json and .cutover.json name the same sha256]
- Repack history
- at 2026-11-01 · label kitfix · reason customer kit files brought up to the current engine: BUILD_OFFLINE.sh (kit root, docs/offline, docs/docker); the header of BUILD_OFFLINE.sh no longer says a --provenance rebuild meets a SLSA build level, comment lines only; not image inputs; image and every build input unchanged · previous sha256 b9fbf5f414577866b701c0a10ffc77a298db2880a51c46458b049d53e5bfd372 · sha256 2b1c040e60da742d5d1ace37259d7e62ed80708e9af72a57d1e237b081c89b38 · replaced BUILD_OFFLINE.sh, docs/docker/BUILD_OFFLINE.sh, docs/offline/BUILD_OFFLINE.sh, rebuild.json
- Upstream repositoryhttps://github.com/apache/airflow [docs/provenance/SOURCE_TREE_HASH.json]
- Upstream ref3.3.2 [docs/provenance/SOURCE_TREE_HASH.json]
- Upstream commitaa19d2dbb9ed187ec01957a92848d9b005e9ba9d [docs/provenance/SOURCE_TREE_HASH.json]
- Source tree hash0c2bedc616cb31218619d06cfbcf76165852c90952c130e097f5b92ef6924e6c (files 13190) [docs/provenance/SOURCE_TREE_HASH.json, tree_listing_sha256 (sha256 of the sorted file listing)]
- Kit tree hashsha256:6d205132e39db8601b1a4b369afe00fabed541a131108ffb44ce15cc7913d69b [ReadyStack-airflow-3.3.2-CE-ubuntu24.04-r5.rebuild.json, inputs.tree_hash]
- SOURCE_DATE_EPOCH1789292163 (utc 2026-09-13T09:36:03Z) [ReadyStack-airflow-3.3.2-CE-ubuntu24.04-r5.rebuild.json, inputs.source_date_epoch]
- Base images
- ref ubuntu:24.04@sha256:24737cef17f4e22b1977df7d9a05e77c4e28b7da5b8911f8d8ccda136bf3573c · platform digest sha256:78d4744ead1f5b19b04d0df558ab182a5300903900755e515b2ca4d10eb2044d
- BuildKitmoby/buildkit:v0.31.2 (image digest sha256:e0e67ea9c4bb07bdef683e29f70f3b623d1eb9c82274a9ec04e6bb0511449fb0) [ReadyStack-airflow-3.3.2-CE-ubuntu24.04-r5.rebuild.json, engine]
- Not recorded: the engine commit(s) that built it (drive_runs records them for drives from 2026-11-02; this release's drives were rebuilt from line logs, which do not name it)
Why this release exists
Fully recorded- Chain722 (created 2026-10-27T20:25:03Z · trigger customer_request · upstream version 3.3.2) [chains, chains #722]
- Requestbuild request #422 (rebuild) (requested at 2026-10-27T20:16:23Z · requested by kitforge-agent · version 3.3.2) [build_requests, build_requests #422]
- Reasonrevision 3.3.2-CE-ubuntu24.04-r5: same upstream version rebuilt (retarget.py --rev-bump) [build_requests, build_requests #422 request_reason]
- Supersedesreadystack/airflow:3.3.2-CE-ubuntu24.04-r4 (chain 649) [chains, chains #649]
The path through the harness
2 items not recorded1 chain · 4 drives · 18 stages · 3 rewinds
Chain 722 release · shipped
Created 2026-10-27T20:25:03Z, upstream 3.3.2, build request 422 [chains, chains #722]
| Drive | Started | Minutes | Build host | How it stopped |
|---|---|---|---|---|
| 232 | 2026-10-27T20:25:29Z | 21.1 | build host 1 withhold-publish | stage_failed at verdict [drive_runs, drive_runs #232] rebuilt from a build line's log |
| 266 | 2026-10-28T10:54:56Z | 31.2 | build host 1 withhold-publish | ready_to_ship [drive_runs, drive_runs #266] rebuilt from a build line's log |
| 269 | 2026-10-28T12:07:57Z | 5.2 | build host 1 withhold-publish | ready_to_ship [drive_runs, drive_runs #269] rebuilt from a build line's log |
| 271 | 2026-10-28T12:26:29Z | 8.1 | build host 1 publish-held | shipped [drive_runs, drive_runs #271] rebuilt from a build line's log |
Stages, in order
| Stage | First start | Passed | Attempts | Gate checks passed | Artifacts (SHA-256) |
|---|---|---|---|---|---|
intake |
2026-10-27T20:25:35Z | 2026-10-27T20:25:36Z | 1 | 4
|
— |
acquire |
2026-10-27T20:25:47Z | 2026-10-27T20:25:48Z | 1 | 12
|
— |
plan |
2026-10-27T20:26:43Z | 2026-10-27T20:26:44Z | 1 | 10
|
— |
assemble_kit |
2026-10-27T20:35:26Z | 2026-10-28T11:03:22Z | 2 | 27
|
— |
remediate |
2026-10-27T20:36:26Z | 2026-10-28T11:03:24Z | 2 | 8
|
— |
build_kit |
2026-10-27T20:44:21Z | 2026-10-28T11:11:19Z | 2 | 9
|
— |
verdict |
2026-10-27T20:46:31Z | 2026-10-28T11:12:52Z | 2 | 8
|
— |
publish_image |
2026-10-28T11:13:49Z | 2026-10-28T11:13:50Z | 1 | 7
|
— |
boot_instance |
2026-10-28T11:14:23Z | 2026-10-28T11:14:25Z | 2 | 3
|
— |
sbom |
2026-10-28T11:14:45Z | 2026-10-28T11:14:45Z | 1 | 5
|
— |
schema_discovery |
2026-10-28T11:14:51Z | 2026-10-28T11:14:51Z | 1 | 7
|
— |
admin_handbook |
2026-10-28T11:15:05Z | 2026-10-28T11:15:06Z | 1 | 7
|
— |
db_handbook |
2026-10-28T11:15:21Z | 2026-10-28T11:15:22Z | 1 | 8
|
— |
seed_data |
2026-10-28T11:15:28Z | 2026-10-28T11:15:29Z | 1 | 6
|
— |
seed_validate |
2026-10-28T11:15:32Z | 2026-10-28T11:15:33Z | 1 | 3
|
— |
usecase_validate |
2026-10-28T11:16:43Z | 2026-10-28T11:16:44Z | 1 | 10
|
— |
finalize_docs |
2026-10-28T11:16:48Z | 2026-10-28T11:16:49Z | 1 | 9
|
— |
package_archive |
2026-10-28T11:26:04Z | 2026-10-28T12:34:31Z | 3 | 33 (final gate PASS)
|
— |
[stage_runs]
Rewinds
- 2026-10-28T10:55:02Z:
verdicttoassemble_kiton strategy_changed (chain 722: strategy changed — rewound from 'verdict' to assemble_kit and dropped the vendored tree so the change actually reaches the build.) [stage_events, stage_events #2342] - 2026-10-28T11:48:23Z:
package_archivetopackage_archiveon docs_redo (scripts/redo-docs.py) [stage_events, stage_events #1985] - 2026-10-28T12:26:00Z:
package_archivetopackage_archiveon docs_redo (scripts/redo-docs.py) [stage_events, stage_events #309]
- Not recorded: each drive's ticks and first failed check (drive_runs records them for drives from 2026-11-02; these drives were rebuilt from line logs)
- Not recorded: the sha256 of each stage's artifacts (stage_events records them for stages passed from 2026-11-02; this chain's events were rebuilt from stage_runs and logs) — the archive's CHECKSUMS.sha256 lists the sha256 of every file it ships
Model work per stage
3 items not recordedRole: writer model. Calls up to 2026-10-28T12:34:31Z.
8 calls over 3 stages
| Stage | Calls | Refused | Errors | Max attempt | Forced commits | Real tokens | Lesson rules shown |
|---|---|---|---|---|---|---|---|
plan | 2 | 0 | 0 | 1 | not recorded | not recorded | — |
remediate | 2 | 0 | 0 | 1 | not recorded | not recorded | — |
usecase_validate | 4 | 0 | 0 | 1 | not recorded | not recorded | — |
[micro_step_runs]
- Not recorded: forced commits (micro_step_runs records them for calls from 2026-11-02)
- Not recorded: real token counts (recorded per call from 2026-11-02; earlier rows hold only an estimate, which is not shown)
- Not recorded: the lesson rules shown to the writer model (lesson_recalls holds no rows for this chain: its recorder was silent from 2026-06-06 to 2026-11-02)
Review
2 items not recordedRole: review model.
2 rounds, 2 counted, $0.87 recorded cost
| Round | Started | Critical | Major | Minor | Verdict | Cost | Cap in force | Archive reviewed |
|---|---|---|---|---|---|---|---|---|
| 1 | 2026-10-28T11:26:42Z | 0 | 4 | 0 | findings to repackage [held_rounds, held_rounds #1] rebuilt from a held-review state file | $0.54 | not recorded | not recorded |
| 2 | 2026-10-28T12:14:24Z | 0 | 0 | 0 | clean to publish [held_rounds, held_rounds #2] rebuilt from a held-review state file | $0.33 | not recorded | not recorded |
- Not recorded: the sha256 of the archive each round reviewed (held_rounds records it for rounds from 2026-11-02; these rounds were rebuilt from state files)
- Not recorded: the round cap in force at each round (the state files did not keep it)
Defects
Fully recorded- Ledger entries5 [defects, defects where product_slug=airflow and this tag or chain]
- Disclosed in the archive5 [docs/defects/defects.json, entries]
5 ledger entries: by severity medium 1, high 4; by status open 1, fixed-before-release 4.
| Defect | Severity | Status | Found by | Fixed in |
|---|---|---|---|---|
RSD-airflow-5e91c4a592Secret written in plain text or to the log by default [defects, defects #131881] | medium | open | build strategy record | — |
RSD-airflow-87fbd6e288Admin handbook: The uid changed to 50000 in this release; the sentence still says 999 and contradicts the one before it. [defects, defects #132145] | high | fixed-before-release | held review (review model) | — |
RSD-airflow-37a088b17dAdmin handbook: The group is gid 50000, not 999. [defects, defects #132146] | high | fixed-before-release | held review (review model) | — |
RSD-airflow-35e164f665Admin handbook: The group is gid 50000, not 999. [defects, defects #132147] | high | fixed-before-release | held review (review model) | — |
RSD-airflow-d43a13e782Database handbook: `id` shows groups=50000(airflow); there is no group 999. [defects, defects #132148] | high | fixed-before-release | held review (review model) | — |
Verification
3 items not recorded- Reproduced before publishingyes (rebuilt digest sha256:b411b52e4e7e0ecb4e5912aa466778e923c79257ad31af1b641d90b9a81b59e2 · published digest sha256:b411b52e4e7e0ecb4e5912aa466778e923c79257ad31af1b641d90b9a81b59e2 · digest match yes · builder moby/buildkit:v0.31.2 · build seconds 212) [docs/provenance/REPRO_VERIFICATION.json, verified]
- Final contract gate (G8)PASS (checks cosign, scan_grade, tag_base_os, vex_shipped, scout_grade_a, script_copies, three_way_sha, offline_rebuild, rebuild_manifest, artifact_coverage, assetchain_coverage) [stage_runs, stage_runs chain 722 package_archive gate_result.g8.result]
- Grade at releaseA (percent 94 · tool docker scout policy 1.26.0 · config docker-default · org vex no · at 2026-10-28T12:26:58Z · failing Docker Scout counts 104 packages with copyleft licences (GPL, LGPL, MPL), 101 of them operating-system packages (it counts only packages whose licence it can read; the SBOM lists every component).) [SCOUT_EVIDENCE.json, docker_scout_policy]
- First own scan of the releaseA (at 2026-10-28T12:34:40Z · score 100 · rubric cerodeo-v1 · fixable critical 0 · fixable high 0 · syft 1.54.1 · grype 0.120.1 · grype db v6.1.10@2026-10-28T06:23:30Z) [image_scans, image_scans #1456]
- Image signatureverified on the index and the linux/amd64 manifest (key fingerprint 04daa92344a52dbc · at 2026-10-28T12:26:35Z) [docs/provenance/IMAGE_EVIDENCE.json, signed]
- Image signature transparency-log entries
- log index 3536921538 · transparency-log entry
- log index 3536924370 · transparency-log entry
- rebuild.json signatureSigstore bundle, release key (key fingerprint 04daa92344a52dbc · log index 3620338505 · transparency-log entry · integrated 2026-11-01T04:51:47Z) [ReadyStack-airflow-3.3.2-CE-ubuntu24.04-r5.rebuild.json.sigstore, verificationMaterial.tlogEntries[0]]
Offline clean-room rebuilds
- 2026-10-28T11:26:45Z on build host 1 (Docker-in-Docker daemon with --network none): bit for bit yes, digest match yes, customer verify yes
rebuilt sha256:b411b52e4e7e0ecb4e5912aa466778e923c79257ad31af1b641d90b9a81b59e2 [clean-room rebuild ledger, runs[521]] - 2026-11-01T04:56:07Z on build host 1 (Docker-in-Docker daemon with --network none): bit for bit yes, digest match yes, customer verify yes
rebuilt sha256:b411b52e4e7e0ecb4e5912aa466778e923c79257ad31af1b641d90b9a81b59e2 [clean-room rebuild ledger, runs[570]]
- Not recorded: the policy tool's --result-file itself (its per-policy results are copied into SCOUT_EVIDENCE.json and the archive's IMAGE_EVIDENCE.json; the file is not kept)
- Not recorded: the attestations' transparency-log entries (no attestation record in the release's workspace)
- Not recorded: the pins record (docs/PINS.md is not in this archive as generated; a repack that adds it is appended to this trail's history)
Publication
2 items not recorded- Image pushed (internal tag), publish_image passed2026-10-28T11:13:50Z [stage_runs, stage_runs chain 722 stage publish_image]
- Archive manifests written2026-10-28T12:29:18Z [PUBLISH_MANIFEST.json, published_at]
- Archive cut over on prodasset, package_archive passed2026-10-28T12:34:31Z [stage_runs, stage_runs chain 722 stage package_archive]
- Cut-over markerpresent (chain 722) [.cutover.json]
- Not recorded: when the release tag was promoted (the promotion record in the archive was written before the promotion, and the release's workspace no longer holds this chain)
- Not recorded: the site event's time (the release checklist is in the chain's workspace, which no longer holds this chain)
Packages and CPU level
Fully recorded- Packages in the image249 (scanned 2026-11-02T06:30:04Z · source backfill:daily-scan) [release_images, package_count]
- x86-64 level the image needsv1 (used v4 · baseline v2 · elf files 882 · probed 2026-11-02T17:00:43Z · source backfill) [release_images, isa_level_hard]
History
1 event- 2026-11-02T23:33:35Z generated: by KitForge release/build_trail.py · generator commit 916780cc218cf013bd623a8c085aaf73d3b053d0 · note backfill: built after the release from its records
Records
23 records| Record | Where it is | Rows |
|---|---|---|
docs/defects/defects.json | inside the archive (ReadyStack-airflow-3.3.2-CE-ubuntu24.04-r5.tar.gz) | — |
docs/provenance/IMAGE_EVIDENCE.json | inside the archive (ReadyStack-airflow-3.3.2-CE-ubuntu24.04-r5.tar.gz) | — |
docs/provenance/LOCKED_DIGEST.txt | inside the archive (ReadyStack-airflow-3.3.2-CE-ubuntu24.04-r5.tar.gz) | — |
docs/provenance/PROMOTION_RECORD.json | inside the archive (ReadyStack-airflow-3.3.2-CE-ubuntu24.04-r5.tar.gz) | — |
docs/provenance/REPRO_VERIFICATION.json | inside the archive (ReadyStack-airflow-3.3.2-CE-ubuntu24.04-r5.tar.gz) | — |
docs/provenance/SOURCE_TREE_HASH.json | inside the archive (ReadyStack-airflow-3.3.2-CE-ubuntu24.04-r5.tar.gz) | — |
.cutover.json | beside the archive (prodasset /data/production/airflow/3.3.2-CE-ubuntu24.04-r5/) | — |
MANIFEST.json | beside the archive (prodasset /data/production/airflow/3.3.2-CE-ubuntu24.04-r5/) | — |
PUBLISH_MANIFEST.json | beside the archive (prodasset /data/production/airflow/3.3.2-CE-ubuntu24.04-r5/) | — |
ReadyStack-airflow-3.3.2-CE-ubuntu24.04-r5.rebuild.json | beside the archive (prodasset /data/production/airflow/3.3.2-CE-ubuntu24.04-r5/) | — |
ReadyStack-airflow-3.3.2-CE-ubuntu24.04-r5.rebuild.json.sigstore | beside the archive (prodasset /data/production/airflow/3.3.2-CE-ubuntu24.04-r5/) | — |
SCOUT_EVIDENCE.json | beside the archive (prodasset /data/production/airflow/3.3.2-CE-ubuntu24.04-r5/) | — |
clean-room rebuild ledger | the clean-room rebuild ledger (runstate/audit-2026-09/bit4bit.json, not published) | — |
build_requests | sadb, ReadyStack's engine database (not published) | 422 |
chains | sadb, ReadyStack's engine database (not published) | 722 |
defects | sadb, ReadyStack's engine database (not published) | airflow 3.3.2-CE-ubuntu24.04-r5 |
drive_runs | sadb, ReadyStack's engine database (not published) | chain 722 |
held_rounds | sadb, ReadyStack's engine database (not published) | chain 722 |
image_scans | sadb, ReadyStack's engine database (not published) | 1456 |
micro_step_runs | sadb, ReadyStack's engine database (not published) | chain 722 |
release_images | sadb, ReadyStack's engine database (not published) | airflow 3.3.2-CE-ubuntu24.04-r5 |
stage_events | sadb, ReadyStack's engine database (not published) | chain 722 |
stage_runs | sadb, ReadyStack's engine database (not published) | chain 722 |