Skip to content

perf: use native Puppeteer in example course graders - #30

Merged
exKAZUu merged 8 commits into
mainfrom
perf/native-puppeteer-course-graders
Sep 12, 2026
Merged

exKAZUu merged 8 commits into
mainfrom
perf/native-puppeteer-course-graders

Conversation

@exKAZUu

@exKAZUu exKAZUu commented Sep 12, 2026 •

Copy link
Copy Markdown
Member

Requirements

  • required: Standardize browser grading on the faster native library measured for the Judge workload.
  • required: Keep shared browser and LLM code in separate exercode-problem-utils packages, without adding those dependencies to ordinary problems.
  • required: Migrate existing course consumers while preserving their grading behavior.
  • required: Complete review-booster, complete-pr and release for each PR.

Use @exercode/problem-utils-browser2.0.0 native Puppeteer in the HTML example while preserving its checks and the JavaScript example’s shared preset. Fresh-process Cloud Run measurements with the same Chromium build favored Puppeteer: 997.311ms versus1578.969ms median for selector/form/screenshot work, including startup/imports in a warm container.

The reusable CI workflow runs both browser model answers with read-only repository contents permission. Existing authoring runtimes are pinned in mise.toml. Dependency lifecycle scripts are disabled; the explicit browser CLI installs the required Chrome headless shell. The core utility dependency is aligned to4.2.1.

Both model answers passed all five grading cases using the public browser2.0.0 artifact. A fresh install with lifecycle scripts disabled downloaded no browser; explicit shell installation and both models passed. Final CI34683431332 succeeded, review-booster57730ed1 completed with7/7 reviewers, and PR readiness passed on1c4175b.

Temporary migration downtime is explicitly accepted. Refresh the two stored examples in each Exercode environment from this commit while preserving problem IDs and submission history.

@exKAZUu exKAZUu self-assigned this Sep 12, 2026
@exKAZUu
exKAZUu merged commit 2502e2a into main Sep 12, 2026
3 checks passed
@exKAZUu
exKAZUu deleted the perf/native-puppeteer-course-graders branch September 12, 2026 08:53
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant