TestOrchestrator

Creating Configurations

Configurations are created through a three-step wizard that selects platforms, generates every possible combination automatically, and lets you choose which ones to create and how to assign them to projects.

Before you start

You need at least one platform group and at least one enabled platform before you can run the wizard. If you have not set these up yet, do that first.

Opening the wizard

  1. Go to Admin → Configurations.
  2. Click Add Configuration in the Configurations panel.

Step 1 — Select Platforms

Choose the platforms you want to combine. Platforms are displayed grouped by their platform group. You can:

  • Check individual platforms to select them.
  • Check a group header to select all platforms in that group at once.

You can select platforms from multiple groups in a single wizard run. For example, selecting iOS and Android from Mobile OS, and macOS from Desktop OS.

Only enabled platforms appear in the wizard. Platforms that have been disabled are hidden. If a platform you need is missing, check that it is enabled on the Platforms page.

Step 2 — Review Combinations

After selecting platforms, the wizard generates every possible combination — every non-empty subset of your selected platforms, respecting the rule that each configuration can contain at most one platform per group.

Example

If you select iOS and Android (Mobile OS) plus macOS (Desktop OS), the wizard generates these combinations:

  • iOS
  • Android
  • macOS
  • iOS, macOS
  • Android, macOS

Note that iOS, Android is not generated — you cannot combine two platforms from the same group in a single configuration.

Removing combinations you don't need

All generated combinations are selected by default. Uncheck any combination you do not want to create. You can deselect individual rows or use the select-all checkbox to clear the whole list and start checking only what you need.

Configurations that already exist are automatically excluded. If a combination matches an existing configuration in your workspace, it is filtered out before the review step. The wizard will never create duplicates.

Step 3 — Configure Settings

Set the initial settings that apply to all configurations created in this wizard run:

Enabled

Determines whether the newly created configurations are immediately active. You can toggle this individually later from the Configurations list.

Project assignment

Choose how the configurations are assigned to projects:

  • Apply to all projects — configurations are linked to every existing project in your workspace and will automatically apply to any new projects created in the future.
  • Apply to specific projects only — a searchable project list appears. Select the projects that should have access to these configurations. At least one project must be selected.

Configuration names

Names are auto-generated and permanent. Each configuration's name is derived from its platform combination (e.g., "iOS, macOS") and is set at creation. It cannot be changed afterwards. This ensures that test run reports always accurately reflect the environment that was tested — even if the platform names themselves are later edited.

After the wizard

All selected combinations are created in a single batch. If any fail (for example, due to a duplicate that was created by another admin simultaneously), a summary shows which succeeded and which failed, with reasons. Successfully created configurations appear immediately in the Configurations list.