- Getting started
- Best practices
- Data privacy
- Autopilot chat
- Generating automations
- Generating tests
- Generating tests
- Best practices and limitations
- Supported models and limits
- Quality-check requirements
- Generate tests for requirement
- Import manual test cases
- Find obsolete tests
- Generate tests for SAP transactions
- Generate coded automations
- Generate coded API automation
- Refactor coded automations
- Generate low-code automations
- Generate synthetic test data
- Generate test reports
- Search Test Manager project
- Troubleshooting Autopilot for Testers
- Autopilot for Everyone
- About Autopilot for Everyone
- Licensing
- User types
- Data sources
- Toolset automations
- Localization
- Prerequisites
- Autopilot widget
- The Autopilot for Everyone tenant card
- Prerequisites for installation
- Enabling Anthropic models
- Installing Autopilot for Everyone
- Updating Autopilot for Everyone
- Uninstalling Autopilot for Everyone
- Configuring Autopilot for Everyone
- Disabling the Autopilot welcome screen in Assistant
- Configuring an LLM for Autopilot for Everyone
- Deploying toolset automations
- Prompt-to-response flow
- Launching Autopilot for Everyone
- Autopilot settings for business users
- Using a specialized Autopilot
- Using a starting prompt
- Uploading and analyzing files
- Running automations
- Interacting with Autopilot answers
- Using suggested prompts
- Starting a new chat
- Chat history
- Providing general feedback
- Clipboard AI Enterprise version
- Troubleshooting
Generate and download Autopilot test reports in Test Manager to identify failure patterns and get recommendations.
Autopilot analyzes your test execution results in Test Manager and generates a report that explains why test cases are failing. The report groups similar errors, highlights recurring failure patterns, and provides recommendations to improve test execution stability.
Feature availability depends on the cloud platform you use. For details, refer to the Test Manager feature availability page.
The report can include up to five sections, each with one or more insights. For each insight, select the icon that displays the number of test cases, or select Show, to view the affected test cases or test case logs, and search through them.
The following table describes each report section:
| Name | Description |
|---|---|
| Overview | An overview of the test results you selected for the report, showing the average failure rate, the test set failure rate, and the percentage of errors by severity. |
| Top Failing Tests | Shows the most frequently failed test cases and lets you access them directly. |
| Common Errors | Highlights the most common errors encountered during test executions. |
| Error Patterns | Categorizes errors and helps you identify failure patterns based on them, for easier troubleshooting and resolution. |
| Recommendations | Offers recommendations to prevent the errors encountered in the chosen test executions, to guide your next steps in optimizing test execution stability. |
Generating a test report
Generate an AI-powered insights report with Autopilot to identify recurring failure patterns and get recommendations for improving test execution stability.
Prerequisites:
- Your Test Manager role has the Test Execution - Read permission.
Steps:
- Open a project in Test Manager.
- Go to Execution and select Generate Report.
- In the Results table, select the test results to include in the report.
- Optional: Filter the test results by:
- Keywords - use the Search bar.
- Execution Type - the type of execution.
- Execution Finished - the execution completion time.
- Status - the execution status.
- Select Generate Report.
- Check the report status via the in-app notification or email.
- If the report is ready, select the Execution Insights Report is ready notification, or Open report in the email notification, to access the report.
- If the report failed, select Generate Report again to retry.
- Select Show for each report section to view the test cases affected by that error or recommendation.
Figure 1. The result of the test report
Downloading a test report
Download a previously generated test insights report as a DOCX file for offline review or sharing with stakeholders.
- Go to the Reports tab inside Execution.
- Optional: To rename the report, select More Options, then Rename.
- Select the Download
button.
Result
The test insights report is generated and accessible from the Execution Insights Report is ready notification. The report is available for download as a DOCX file from the Reports tab inside Execution.
Best practices
For guidance on interpreting test insights reports and improving test suite stability, refer to Best practices and limitations.