Survive Contabo PUT throttling in the lake extractor #22

Merged

admin_emi merged 1 commit from fix/lake-put-throttle into dev

2026-07-23 22:47:27 +00:00

Author	SHA1	Message	Date
Emi Griffith	33157766cb	Survive Contabo PUT throttling in the lake extractor All checks were successful PR build (required check) / build-frontend (pull_request) Has been skipped Details PR build (required check) / gate (pull_request) Successful in 3s Details PR build (required check) / validate-observability (pull_request) Has been skipped Details secrets-guard / encrypted (pull_request) Successful in 6s Details PR build (required check) / changes (pull_request) Successful in 8s Details PR build (required check) / build-backend (pull_request) Successful in 1m3s Details Contabo answers 429 to PUT bursts; at 16 concurrent uploads botocore's default 4 retries ran out and the run died at tile 54/390. Adaptive retry mode (client-side rate limiting, 10 attempts), a halved upload pool, and per-tile failure isolation (a failed tile logs and is retried next run — it never reached the manifest) keep the run alive through throttling.	2026-07-23 15:45:31 -07:00