Orchestrator user guide

DELIVERY:

Last updated Jul 1, 2025

Test Cases

Overview

In this topic, you can learn how to manage your test cases across all the projects and application versions. The test cases are part of test sets that are up for execution.

Conditions

The test cases are created automatically when you publish a test package through Studio. For more information, see Introduction.
If an existing package is revised followed by an updated version being published, the test cases for the new version are automatically created. The new test cases show up alongside existing ones for the previous version. However, if the changes to the package only apply to the patch version, then the existing test cases are updated to reflect these changes, instead of creating new ones.
When you publish a new test case version, the correspondent package is automatically updated to the latest version.
If an existing project is cloned to represent a new application version (e.g. from v1.1.1 to v.1.2.0), you must manually publish this package and create a new process.
Important:
- To create and run test automation jobs, you must have the following roles assigned: Automation User and Robot.
- You must first deploy a process from the published test case package before you can create and execute a test set.

Create Test Set

You can group together multiple test cases into a test set.

Log in to Orchestrator.
Open your folder.
Navigate to Testing > Test Cases.
Use the checkboxes to select individual test cases. Alternatively, you can choose Select all in the column header. You can modify the test case selection later in the test set configuration step.
Click Add test set.
Enter a Name and an optional Description for your test set and then click Create to continue.

Note: For the Classic Folder, you need to select your Environment.
Configure the execution target:
- For the Classic Folder, you can select the Robot from the dropdown menu.
- For Modern Folders, you can select the user that is assigned to that specific folder. The default is set to Any User.
Select your Studio projects.
(Optional) You can edit the project version and toggle to Include Prerelease versions.
Define custom Arguments for your test cases to override default values at the test set level.

Through the arguments, you can parameterize the test cases at runtime.

Note: To define arguments, you need to have published a package with arguments.
Click Next to continue.
Modify test case selection if needed.
Click Save. Your test set is created and available on the Test Sets page.
Tip:

Execute Test Case

You can execute individual test cases on the Test Cases page.

Log in to Orchestrator.
Open your folder.
Navigate to Testing > Test Cases.
Select a test case and click Execute.
Configure the execution target:
- User: Select the user from the dropdown list that is assigned to that specific folder. The default is set to Any User.
- Machine: Select the machine resource from the dropdown list.
  
  Note: For the Classic Folder, you need to select your Environment and then choose whether you want to allocate the execution dynamically or to specific robots.
Click Execute to confirm.