WP-00: Baseline Benchmarks #87

New Issue

cal · 2026-03-13T04:36:33Z

cal commented

2026-03-13 04:36:33 +00:00

Description

Capture before-metrics for per-card render time and batch upload time so we can measure Phase 0 improvement.

Repos: database + card-creation
Phase: 0 (Render Pipeline Optimization)
Dependencies: None
Complexity: XS

Tasks

Time 10 sequential card renders via the API (curl with timing)
Time a small batch S3 upload (e.g., 20 cards) via pd-cards upload
Record results in a benchmark log

Tests

Benchmark script or documented curl commands exist and are repeatable

Acceptance Criteria

Baseline numbers recorded for per-card render time
Baseline numbers recorded for batch upload time
Methodology is repeatable for post-optimization comparison

Plan reference: docs/prd-evolution/PHASE0_PROJECT_PLAN.md WP-00

## Description Capture before-metrics for per-card render time and batch upload time so we can measure Phase 0 improvement. **Repos:** `database` + `card-creation` **Phase:** 0 (Render Pipeline Optimization) **Dependencies:** None **Complexity:** XS ## Tasks 1. Time 10 sequential card renders via the API (curl with timing) 2. Time a small batch S3 upload (e.g., 20 cards) via `pd-cards upload` 3. Record results in a benchmark log ## Tests - [ ] Benchmark script or documented curl commands exist and are repeatable ## Acceptance Criteria 1. Baseline numbers recorded for per-card render time 2. Baseline numbers recorded for batch upload time 3. Methodology is repeatable for post-optimization comparison **Plan reference:** `docs/prd-evolution/PHASE0_PROJECT_PLAN.md` WP-00

cal added this to the Card Evolution Phase 0 — Render Pipeline Optimization milestone 2026-03-13 04:37:35 +00:00

cal added the

evolution

phase-0

labels 2026-03-13 04:37:39 +00:00

cal referenced this issue

2026-03-13 04:38:00 +00:00

Card Evolution Phase 0 — Render Pipeline Optimization Master Tracker #93

Claude added the

ai-working

label 2026-03-13 05:01:49 +00:00

cal referenced this issue from a commit

2026-03-13 05:04:39 +00:00

feat: add Phase 0 baseline benchmark script and log (WP-00) (#87)

Claude referenced a pull request that will close this issue

2026-03-13 05:04:49 +00:00

feat: Phase 0 baseline benchmark script and log (WP-00) (#87) #95

Claude commented

2026-03-13 05:05:00 +00:00

PR opened: #95

Created two files:

benchmarks/benchmark_renders.sh — shell script using curl to time 10 sequential card renders against any API environment (API_BASE env var). Auto-fetches player IDs or accepts explicit IDs as args.
benchmarks/BASELINE.md — methodology docs and result tables for render timing and S3 batch upload, with pre/post WP comparison tracking.

Note: The S3 upload benchmark is documented with instructions but requires running pd-cards upload in the card-creation repo. Actual baseline numbers in the tables are _TBD_ — run the script against pddev.manticorum.com:816 before WP-01/02 land to populate them.

PR opened: https://git.manticorum.com/cal/paper-dynasty-database/pulls/95 Created two files: - `benchmarks/benchmark_renders.sh` — shell script using `curl` to time 10 sequential card renders against any API environment (`API_BASE` env var). Auto-fetches player IDs or accepts explicit IDs as args. - `benchmarks/BASELINE.md` — methodology docs and result tables for render timing and S3 batch upload, with pre/post WP comparison tracking. **Note:** The S3 upload benchmark is documented with instructions but requires running `pd-cards upload` in the `card-creation` repo. Actual baseline numbers in the tables are `_TBD_` — run the script against `pddev.manticorum.com:816` before WP-01/02 land to populate them.

Claude added

ai-pr-opened

and removed

ai-working

labels 2026-03-13 05:05:12 +00:00

cal referenced this issue

2026-03-16 16:03:53 +00:00

Card Evolution Phase 0 — Render Pipeline Optimization Master Tracker #93

cal commented

2026-03-16 19:48:20 +00:00

Completed. Benchmarks recorded in docs/prd-evolution/PHASE0_PROJECT_PLAN.md — 7 fresh renders averaging 0.98s (range 0.63-1.44s), 51% reduction from ~2.0s baseline. PR #95 merged via next-release.

**Completed.** Benchmarks recorded in `docs/prd-evolution/PHASE0_PROJECT_PLAN.md` — 7 fresh renders averaging 0.98s (range 0.63-1.44s), 51% reduction from ~2.0s baseline. PR #95 merged via next-release.

cal closed this issue

2026-03-16 19:48:27 +00:00

Claude referenced this issue from a commit

2026-03-23 04:00:04 +00:00

Merge pull request 'feat: Phase 0 baseline benchmark script and log (WP-00) (#87)' (#95) from ai/paper-dynasty-database#87 into next-release

cal referenced this issue

2026-03-23 18:32:14 +00:00

refactor: rename Evolution system to Refractor #131

Sign in to join this conversation.