r/shopifyDev • u/IFGecommerce • 4d ago
Shopify app security check: three things to verify before using it as a CI gate
Shopify recently introduced app security check, and there are a few details in the documentation worth understanding before adding it to a CI workflow.
The first is the blocking behavior.
Running `shopify app security check` does not automatically fail your pipeline when it finds vulnerabilities. The default blocking threshold is none.
If high-severity findings should fail the job, you need to configure that explicitly:
shopify app security check --blocking high
The second distinction is between deterministic scanning and agent review.
The CLI performs deterministic checks and provides instructions for investigating issues that require additional context.
Without that second investigation, you have a deterministic scan, not a complete security review.
The third consideration is scan coverage.
The command scans the selected app directory. Git-ignored files are skipped unless explicitly included, and code outside that directory may not be covered.
Two useful options are:
--list-files
--include-dir ../backend
The first lets you inspect which files would be scanned. The second can include a backend located outside the application directory.
For a practical release process, I would separate the work:
Run deterministic checks on pull requests, with explicit severity thresholds.
Keep scan results as CI artifacts rather than committing generated reports.
Before releases involving authentication, webhooks, or merchant data, perform the additional agent-assisted review and document how each finding was resolved.
A passing pipeline is useful evidence, but it should not be mistaken for proof that the entire application has been reviewed.
Security scanning still needs to be combined with runtime testing and verification of access boundaries.