feat: concurrent upload pipeline for legacy script (WP-05) (#92) #26

Closed
Claude wants to merge 1 commits from ai/paper-dynasty-database#92 into main

1 Commits

Author SHA1 Message Date
Cal Corum
0d603ccd48 feat: concurrent upload pipeline for legacy script (WP-05) (#92)
Refactor check_cards_and_upload.py sequential loop to use asyncio.gather
+ Semaphore (CONCURRENCY=8), offload boto3 S3 calls to thread pool via
loop.run_in_executor, increase fetch timeout to 10s, and add progress
reporting every 20 completions.

Closes #92

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
2026-03-13 08:05:22 -05:00