Commit graph

3 commits

Author SHA1 Message Date
Emi Griffith
33157766cb Survive Contabo PUT throttling in the lake extractor
All checks were successful
PR build (required check) / build-frontend (pull_request) Has been skipped
PR build (required check) / gate (pull_request) Successful in 3s
PR build (required check) / validate-observability (pull_request) Has been skipped
secrets-guard / encrypted (pull_request) Successful in 6s
PR build (required check) / changes (pull_request) Successful in 8s
PR build (required check) / build-backend (pull_request) Successful in 1m3s
Contabo answers 429 to PUT bursts; at 16 concurrent uploads botocore's
default 4 retries ran out and the run died at tile 54/390. Adaptive retry
mode (client-side rate limiting, 10 attempts), a halved upload pool, and
per-tile failure isolation (a failed tile logs and is retried next run —
it never reached the manifest) keep the run alive through throttling.
2026-07-23 15:45:31 -07:00
emi
21eea3a4c2 Parallelize lake tile uploads (#17)
All checks were successful
secrets-guard / encrypted (push) Successful in 7s
Build + push backend image (Forgejo registry) / build-push (push) Successful in 1m2s
Deploy backend to LAN dev server / build (push) Successful in 1m12s
Deploy backend to LAN dev server / deploy (push) Successful in 21s
2026-07-23 21:32:58 +00:00
emi
370a4ffdc1 ERA5 lake: bucket-hosted history primary + SQL indexer service (#15)
All checks were successful
secrets-guard / encrypted (push) Successful in 10s
Deploy backend to LAN dev server / build (push) Successful in 1m13s
Build + push backend image (Forgejo registry) / build-push (push) Successful in 1m39s
Deploy backend to LAN dev server / deploy (push) Successful in 34s
2026-07-23 21:20:35 +00:00