feat(ci): state-dependent pulumi-preview + backup-verify pipelines (T14)
All checks were successful
CI / preflight (push) Successful in 4s
CI / typecheck (push) Successful in 15s
pulumi-preview / preview (push) Successful in 19s

Completes T14: the two CI pipelines that need Pulumi stack state, which
bootstrap/state/ is gitignored from. Solves the blocker by publishing a
fresh `pulumi stack export` to RustFS after every `up`, then having CI
pull + import it.

- state-publish.sh: ships the stack export to rfs/foundation-ci-state/
  foundation-stack.json via a throwaway mc container on foundation-net
  (ADR-007), exactly like backup.sh. Secrets inside the export stay
  passphrase-encrypted; config travels in the committed (encrypted)
  Pulumi.foundation.yaml. run.sh invokes it best-effort after `up`.
- rustfs.ts + Pulumi.foundation.yaml: declare the foundation-ci-state
  bucket (created belt-and-suspenders by state-publish on first run).
- pulumi-preview.yml (push/PR): read-only drift/PR check. Pulls + imports
  state, materializes the operator key from the SSH_PRIVATE_KEY secret
  (the provider + index.ts read it), `pulumi preview` — never `up`. A diff
  is informational so the job fails only on a program/preview error.
- backup-verify.yml (weekly + dispatch): reuses backup.sh/restore.sh
  unchanged to produce a bundle and restore-verify it from offsite
  (CONTRACT_004 §4.6). Imports real state so the bundle's pulumi-state.json
  is real, not an empty deployment.

Repo-scoped Actions secrets set via the admin API: PULUMI_CONFIG_PASSPHRASE,
SSH_PRIVATE_KEY, RUSTFS_ACCESS_KEY, RUSTFS_SECRET_KEY. Both pipelines
validated end-to-end in a foundation-ci container on the VM (preview exit 0;
backup-verify RESTORE VERIFY PASS from offsite).

Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
This commit is contained in:
Andreas Niemann 2026-07-01 00:50:16 +02:00
parent 929c1270e0
commit 8603177096
6 changed files with 183 additions and 1 deletions

View file

@ -0,0 +1,62 @@
# backup-verify — weekly "a backup is not trusted until restored" (CONTRACT_004
# §4.6, T14 state-dependent half). Produces a fresh bundle and asserts it restores
# from the OFFSITE copy into scratch resources (NON-DESTRUCTIVE — restore.sh never
# touches the live platform). Runs on the foundation's own runner in foundation-ci.
#
# It reuses the operator scripts UNCHANGED (backup/backup.sh + restore.sh), which
# read everything from `pulumi config get` (vm coords, vault root token, offsite +
# age creds — all in the committed, passphrase-encrypted Pulumi.foundation.yaml) and
# orchestrate the heavy lifting on the VM over SSH (ADR-007). Two CI-specific needs:
# 1. the operator SSH key (SSH_PRIVATE_KEY secret → /tmp/op_key) to reach the VM;
# 2. real Pulumi STATE imported into a file backend, because backup.sh embeds a
# `pulumi stack export` (pulumi-state.json, CONTRACT_004 §4.2) in the bundle —
# a bare `stack init` would ship an EMPTY deployment. State is pulled from the
# object run.sh publishes (state-publish.sh), same as pulumi-preview.
#
# Schedule only (+ manual dispatch): never on push — it creates real backup bundles.
name: backup-verify
on:
schedule:
- cron: "17 3 * * 0" # weekly, Sunday 03:17 UTC
workflow_dispatch:
jobs:
backup-verify:
runs-on: docker
container:
image: foundation-ci:latest
env:
PULUMI_CONFIG_PASSPHRASE: ${{ secrets.PULUMI_CONFIG_PASSPHRASE }}
SSH_PRIVATE_KEY_PATH: /tmp/op_key
PULUMI_SKIP_UPDATE_CHECK: "true"
steps:
- uses: actions/checkout@v4
- name: Materialize operator SSH key (reaches the VM over SSH)
env:
SSH_PRIVATE_KEY: ${{ secrets.SSH_PRIVATE_KEY }}
run: |
install -m 600 /dev/null /tmp/op_key
printf '%s' "$SSH_PRIVATE_KEY" > /tmp/op_key
[ -z "$(tail -c1 /tmp/op_key)" ] || printf '\n' >> /tmp/op_key
- name: Import Pulumi state (so the bundle's pulumi-state.json is real)
env:
RUSTFS_ACCESS_KEY: ${{ secrets.RUSTFS_ACCESS_KEY }}
RUSTFS_SECRET_KEY: ${{ secrets.RUSTFS_SECRET_KEY }}
working-directory: bootstrap
run: |
mc alias set rfs http://foundation-rustfs:9000 "$RUSTFS_ACCESS_KEY" "$RUSTFS_SECRET_KEY" >/dev/null
mc cp rfs/foundation-ci-state/foundation-stack.json /tmp/foundation-stack.json
mkdir -p state
export PULUMI_BACKEND_URL="file://$(pwd)/state"
pulumi stack select foundation 2>/dev/null || pulumi stack init foundation
pulumi stack import --file /tmp/foundation-stack.json
- name: Backup, then restore-verify from offsite (CONTRACT_004 §4.6)
run: |
TS=$(date -u +%Y%m%dT%H%M%SZ)
echo "backup-verify: bundle timestamp $TS"
./backup/backup.sh "$TS"
./backup/restore.sh "$TS" off
echo "backup-verify: OK ($TS restored from offsite)"