- Getting started
- Best practices
- Tenant
- About the Tenant Context
- Searching for Resources in a Tenant
- Managing Robots
- Connecting Robots to Orchestrator
- Storing Robot Credentials in CyberArk
- Storing Unattended Robot Passwords in Azure Key Vault (read only)
- Storing Unattended Robot Credentials in HashiCorp Vault (read only)
- Storing Unattended Robot Credentials in AWS Secrets Manager (read only)
- Deleting Disconnected and Unresponsive Unattended Sessions
- Robot Authentication
- Robot Authentication With Client Credentials
- Configuring automation capabilities
- Audit
- Settings
- Cloud robots
- Folders Context
- Automations
- Processes
- Jobs
- Apps
- Triggers
- Logs
- Monitoring
- Queues
- Assets
- Storage Buckets
- Orchestrator testing
- Resource Catalog Service
- Authentication
- Integrations
- Classic Robots
- Troubleshooting

Orchestrator user guide
Test Executions
linkOverview
linkPrerequisites: To perform test executions, you need to have the Robot role assigned.
Executing test cases that contain Integration Service connections
For test cases and projects that contain test cases created using a specific Integration Service connection, you cannot assign a specific connection at runtime, other than the one used during the design phase in Studio,
For example, if you create a test case containing an Integration Service connection, then publish it to Orchestrator and execute it independently, there will be no option available to assign a specific connection at runtime.
Re-execute Test Set
linkYou can re-execute test sets after a previous run. The new test case result will override the previous one shown on the Test Executions page.
Be aware that you cannot re-execute test cases from a Test Set with enabled coverage calculation.
- Log in to Orchestrator.
- Open your folder.
- Navigate to Testing > Test Executions.
- Select a test run and go to More actions > Details.
- Select a test case and go to More actions > Re-execute.
- Configure the execution target:
- User: Select the user from the dropdown list that is assigned to that specific folder. The default is set to Any User.
-
Machine: Select the machine resource from the dropdown list.
- (Optional) Define custom Arguments for your test cases to override default values at the test set level. To define arguments, you need to have published a package with arguments.
- Click Execute to confirm.
Known limitation
The results from re-executing a test set in Orchestrator are not synced to Test Manager. We recommend you to execute and re-execute tests directly from Test Manager.Test Execution Coverage
linkYou can view information on the activities that have been covered during a test execution. This option is also available in Studio, as Activity Coverage.
- Open your folder in Orchestrator.
- Navigate to Testing > Test Executions.
- Select a test run and go to More actions > Details.
- Go to the Coverage tab to view coverage details.
The coverage files are uploaded to the Attachments tab.
Analyze Test Executions
linkYou can analyze test executions to understand what happened in instances where the execution failed or got stuck.
You can choose from the following actions to examine your test runs.
Actions |
Description |
Procedure |
---|---|---|
Execution details |
View Robot details, including execution attachments, data variation and screenshots. Make sure that you have Execution Media Permissions. |
|
View assertions |
View failed or passed assertions. |
|
View logs |
View and export a detailed log of execution events. |
|
Test Executions API
linkTo query for item related activities, you can use the Background Tasks, internally available through API. For more information on Orchestrator Permissions, see . For more information on test automation API, see Test Automation API Permissions.