- Getting started
- Project management
- Working with Change Impact Analysis
- Create test cases
- Assigning test cases to requirements
- Cloning test cases
- Exporting test cases
- Linking test cases in Studio to Test Manager
- Delete test cases
- Enabling governance at project level
- Disabling governance at project level
- Enabling governance at test-case level
- Disabling governance at test-case level
- Enabling or disabling governance in bulk for test cases
- Enforcing signing order for governed test cases
- Managing approvers for governed test cases
- Managing governed test cases in the In Work state
- Managing governed test cases in the In Review state
- Managing governed objects in the Signed state
- Managing comments for governed test cases
- Viewing governance information for test case logs
- Managing approvers for governed test case logs
- Managing governed test case logs in the In Work state
- Managing governed test case logs in the In Review state
- Managing governed test case logs in the Signed state
- Managing comments for governed test case logs
- Enabling governance at test case log level
- Disabling governance at test case log level
- Viewing and searching test cases
- Project operations and utilities
- Test Manager settings
- Tenant level settings
- General project settings
- Events
- Subscribing to events
- Subscribing to all events
- Unsubscribing from events
- Unsubscribing from all events
- Unsubscribing from the Notifications settings page
- Viewing notifications
- Filtering notifications
- Viewing email notifications
- Enabling email notifications for SMTP servers
- Viewing only unread notifications
- Marking all notifications as read
- Clearing all notifications
- Deleting notifications
- Customer managed keys encryption
- Audit logs
- ALM tool integration
- ALM tool integration
- Test Manager Connect
- Test Manager - Integration Service connector
- Outbound IP ranges for connectors
- Working with SAP Cloud ALM and Test Manager
- Step 1: Integrating SAP Cloud ALM with Test Manager
- Step 2: Creating automated test cases in SAP Cloud ALM
- Step 3: Creating automated test cases in Test Manager
- Step 4: Synchronizing test cases from Test Manager to SAP Cloud ALM
- Step 5: Assigning test automations to test cases
- Step 6: Executing test cases
- SAP test automation best practices
- Troubleshooting the Jira integration
- API integration
- Coding Agents for Testing
- Troubleshooting
Execution logs
Overview of the assertions, logs, affected requirements, and attachments collected in a test case execution log.
As part of test reporting, execution logs hold information such as execution details (for example, data variation and screenshots), failed and passed assertions, and a detailed log of execution events. Robot and Assertion logs are available in real-time as soon as the test case starts executing. You can also view the machine on which the test runs and the robot used to run the execution.
A test case log opens when you select a test case Key, or result, in a test execution.
Figure 1. Overview of the execution details of a test case log
The following sections describe the type of information that is collected during test case execution.
Assertions
Failed or passed assertions, for example the Verify expression activity, and associated screenshots if any were taken during test case execution appear in the Assertions tab. For more information on making sure Orchestrator takes screenshots during executions, see the following resources:
- Default roles in Orchestrator - to check if the default roles have the Test Case Execution Artifacts permission assigned. In case the default roles don't have this permission, then you can create a custom role with this permission.
- Managing roles in Orchestrator - to learn how to create, edit, or import a role in Orchestrator.
Logs
The RobotLogs include INFO level logs, with information about processes, execution robot, and event logs, including failures.
The
icon opens the Logs tab of the selected test case, with a detailed description of the failure.
Affected requirements
The requirements that are assigned to the test case that has been executed appear in the Affected requirements tab. You can use this tab to go directly to the affected requirement.
Attachments
You can view the following:
- Attachments uploaded using the Attach Document activity.
- Attachments of a test case result, that is linked from Orchestrator.