Skip to main content

Overview

Test Plans are the recommended way to run tests at scale. Unlike manual runs, which require you to select environments, browsers, and scenarios each time, a Test Plan saves those selections so every run uses the same settings automatically. This makes Test Plans ideal for scheduled runs, CI/CD pipelines, and any workflow where consistency matters.
Test plans already contain run configurations. Running them does not require manual setup.

Test Plans vs. manual runs

Manual runs

Each run requires you to manually select environments, browsers, viewports, and scenarios before starting.

Test Plans

Saves the full run configuration so every future run uses the same settings without manual setup.
Use manual runs for one-off runs and debugging. Use Test Plans for recurring, automated, or team-wide testing workflows.

How to run a Test Plan

1

Navigate to Test Plans

Open your Spur dashboard and click Test Plans in the left navigation.
Navigate to Test Plans

Navigate to Test Plans from the left navigation

2

Run a Test Plan

Find the Test Plan you want to run and click Run Plan to trigger an immediate run using the saved configuration.
Run a Test Plan

Click Run Plan to start an immediate run

3

View results

Results appear in the Test Plan’s run history as they complete, with a breakdown by suite, environment, and test. Use the Test Plan Review flow to triage failures and warnings systematically.
Test Plans can also be triggered automatically via the Scheduler or your CI/CD pipeline without any manual action.

Alert notifications

Keep your team informed without manually checking the dashboard. Test Plans support alerts over both Slack and email.

Slack alerts

Connect your Slack workspace and choose when to be notified:
  • On finish: one summary when the plan run finishes.
  • Every run: a message after each test run, including retries, whether it passes or fails.
  • Final fail: a message for each test still failing on its final retry.
  • Every fail: a message each time a test fails, including retries.

Email alerts

Add one or more recipients to receive a summary email about the Test Plan run. The email shows the total runs, the classification breakdown from the review, and highlights the tests classified as bugs, with links back to each run. If the run has been reviewed, the email also names the reviewer. Under Send after each run, each recipient chooses when Spur emails them after a run finishes:
  • Always: Spur sends a summary email each time the plan runs. New recipients start on this option.
  • Failures only: Spur sends an email only when tests fail. Warnings do not trigger an email. The email lists only the failed tests.
  • Failures and warnings: Spur sends an email when tests fail or have a warning. The email lists only those tests.
  • Never: Spur sends no email when the run finishes.
Select Send after review for a recipient to also send them the reviewed results from the Test Plan Review flow once a reviewer has classified the run. To send only reviewed results, also select Never under Send after each run. Configure recipients in the Test Plan’s Additional Settings tab or the Email notifications dialog on the Integrations page. To change them on an existing plan, edit your Test Plan. See Test Plan email recipients for details.
  • If no recipients are configured, no automatic email is sent.
  • Email alerts are independent from Slack alerts; you can enable either, both, or neither.
  • When sending reviewed results, you can also add a one-off recipient who is not in the configured list.
Spur does not email each individual test result. For a daily summary, see the Email integration.

Auto retry

Auto Retry helps you distinguish genuine bugs from flaky test results. When enabled, Spur automatically re-runs any failed test up to a set number of attempts before marking it as failed. Retries continue until the test passes or the maximum is reached.
  • Choose from 1, 2, or 3 retry attempts
  • Maximum is 3 retry attempts (auto retry is off by default)
Auto Retry settings

Auto Retry configuration in Additional Settings

If a test fails once out of three attempts, it is more likely an environmental blip than a real bug. Auto Retry surfaces only the consistent failures worth investigating.

Retries with dependencies

If a test that has dependencies fails, Spur re-runs the entire dependency chain, not just the failed test. This ensures the retry starts from a clean state. For example, if your tests are chained as Test A > Test B > Test C and Test B fails:
  • Spur re-runs Test A > Test B, then continues to Test C
  • Test A may appear with a retry badge in the results even though it originally passed, because it was re-run as part of the dependency chain
  • In some cases, a test that originally passed can fail on the retry
This means you may see retry badges on tests that were not the original point of failure. This is expected behavior when retrying tests with dependencies.
To enable this on an existing Test Plan, edit your Test Plan and go to the Additional Settings tab. To inspect a retry round, open the dependency chain from one of its run results.

Editing a Test Plan

1

Open the Test Plan menu

Navigate to Test Plans, find the plan you want to edit, click the three-dot menu, and select Edit Plan.
Open edit menu

Click the three-dot menu and select Edit Plan

2

Go to additional settings

Inside the Test Plan modal, navigate to the Additional Settings tab to configure alert notifications and auto retry.
Additional Settings

Additional Settings tab in the Test Plan modal

Create a Test Plan

Alert notifications and auto retry can also be configured when creating a new Test Plan.