Skip to content

Add TOML config regression tests#6940

Open
ryancbahan wants to merge 1 commit into02-27-add_cleanupfrom
03-05-rcb_e2e-toml-testing
Open

Add TOML config regression tests#6940
ryancbahan wants to merge 1 commit into02-27-add_cleanupfrom
03-05-rcb_e2e-toml-testing

Conversation

@ryancbahan
Copy link
Contributor

@ryancbahan ryancbahan commented Mar 5, 2026

WHY are these changes introduced?

We want to catch regressions in shopify.app.toml parsing and validation. The CLI should accept all documented config options and reject invalid configurations with clear errors.

WHAT is this pull request doing?

Static test data in data/:

  • data/valid-app/shopify.app.toml — comprehensive toml with all documented sections (access_scopes, webhooks, app_proxy, pos, build, auth, app_preferences, access.admin)
  • data/valid-app/package.json — minimal package.json
  • data/invalid-tomls/ — 5 invalid toml files (bad syntax, wrong types, unknown section, missing webhook uri, invalid app_proxy prefix)

New fixture:

  • setup/toml-app.ts — copies data/valid-app/ to a temp dir, injects client_id from env

Tests:

  • toml-config.spec.ts:
    • Deploy succeeds with fully populated toml
    • Dev starts with fully populated toml (waits for ready, presses q to quit)
  • toml-config-invalid.spec.ts:
    • Auto-discovers all .toml files in data/invalid-tomls/
    • Asserts app deploy --force fails for each with non-zero exit code
    • Logs full CLI output for diagnostics
cd packages/e2e && npx playwright test tests/toml-config.spec.ts tests/toml-config-invalid.spec.ts

How to test your changes?

cd packages/e2e && npx playwright test tests/toml-config.spec.ts

Measuring impact

n/a - test infrastructure

@ryancbahan ryancbahan changed the title add toml regression tests Add toml file regression tests Mar 5, 2026
Copy link
Contributor Author

Warning

This pull request is not mergeable via GitHub because a downstack PR is open. Once all requirements are satisfied, merge this PR as a stack on Graphite.
Learn more

This stack of pull requests is managed by Graphite. Learn more about stacking.

@ryancbahan ryancbahan marked this pull request as ready for review March 5, 2026 17:52
@ryancbahan ryancbahan requested a review from a team as a code owner March 5, 2026 17:52
@binks-code-reviewer
Copy link

binks-code-reviewer bot commented Mar 5, 2026

🤖 Code Review · #projects-dev-ai for questions
React with 👍/👎 or reply — all feedback helps improve the agent.

Complete - No issues

📋 History

✅ No issues → ✅ No issues

@github-actions
Copy link
Contributor

github-actions bot commented Mar 5, 2026

Coverage report

St.
Category Percentage Covered / Total
🟡 Statements 78.82% 14473/18363
🟡 Branches 73.13% 7199/9844
🟡 Functions 79.04% 3692/4671
🟡 Lines 79.16% 13674/17274

Test suite run success

3791 tests passing in 1448 suites.

Report generated by 🧪jest coverage report action from bec1a97

@ryancbahan ryancbahan force-pushed the 03-05-rcb_e2e-toml-testing branch from f84e801 to 9cac1cf Compare March 5, 2026 18:16
@ryancbahan ryancbahan force-pushed the 03-05-rcb_e2e-toml-testing branch 3 times, most recently from fdbbe21 to eaa13bc Compare March 5, 2026 18:40
@ryancbahan ryancbahan changed the title Add toml file regression tests Add TOML config regression tests Mar 5, 2026
@ryancbahan ryancbahan force-pushed the 03-05-rcb_e2e-toml-testing branch from eaa13bc to bec1a97 Compare March 5, 2026 19:11
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant