- Overview
- UI Automation
- Applications and technologies automated with UI Automation
- Project compatibility
- UI-ANA-016 - Pull Open Browser URL
- UI-ANA-017 - ContinueOnError True
- UI-ANA-018 - List OCR/Image Activities
- UI-DBP-006 - Container Usage
- UI-DBP-013 - Excel Automation Misuse
- UI-DBP-030 - Forbidden Variables Usage In Selectors
- UI-DBP-031 - Activity verification
- UI-PRR-001 - Simulate Click
- UI-PRR-002 - Simulate Type
- UI-PRR-003 - Open Application Misuse
- UI-PRR-004 - Hardcoded Delays
- UI-REL-001 - Large Idx in Selectors
- UI-SEC-004 - Selector Email Data
- UI-SEC-010 - App/Url Restrictions
- UI-USG-011 - Non Allowed Attributes
- UX-SEC-010 - App/Url Restrictions
- UX-DBP-029 - Insecure Password Use
- UI-PST-001 - Audit Log Level in Project Settings
- UiPath Browser Migration Tool
- Clipping region
- Computer Vision Recorder
- About SAP GUI for Java Automation
- Configuration Steps
- Supported SAP GUI for Java Elements
- Activities index
- Activate
- Anchor Base
- Attach Browser
- Block User Input
- Callout
- Check
- Click
- Click Image
- Click Image Trigger
- Click OCR Text
- Click Text
- Click Trigger
- Close Application
- Close Tab
- Close Window
- Context Aware Anchor
- Copy Selected Text
- Element Attribute Change Trigger
- Element Exists
- Element Scope
- Element State Change Trigger
- Export UI Tree
- Extract Structured Data
- Find Children
- Find Element
- Find Image
- Find Image Matches
- Find OCR Text Position
- Find Relative Element
- Find Text Position
- Get Active Window
- Get Ancestor
- Get Attribute
- Get Event Info
- Get From Clipboard
- Get Full Text
- Get OCR Text
- Get Password
- Get Position
- Get Source Element
- Get Text
- Get Visible Text
- Go Back
- Go Forward
- Go Home
- Google Cloud Vision OCR
- Hide Window
- Highlight
- Hotkey Trigger
- Hover
- Hover Image
- Hover OCR Text
- Hover Text
- Image Exists
- Indicate On Screen
- Inject .NET Code
- Inject Js Script
- Invoke ActiveX Method
- Key Press Trigger
- Load Image
- Maximize Window
- Microsoft Azure Computer Vision OCR
- Microsoft OCR
- Microsoft Project Oxford Online OCR
- Minimize Window
- Monitor Events
- Mouse Trigger
- Move Window
- Navigate To
- OCR Text Exists
- On Element Appear
- On Element Vanish
- On Image Appear
- On Image Vanish
- Open Application
- Open Browser
- Refresh Browser
- Replay User Event
- Restore Window
- Save Image
- Select Item
- Select Multiple Items
- Send Hotkey
- Set Clipping Region
- Set Focus
- Set Text
- Set To Clipboard
- Set Web Attribute
- Show Window
- Start Process
- System Trigger
- Take Screenshot
- Tesseract OCR
- Text Exists
- Tooltip
- Type Into
- Type Secure Text
- Use Foreground
- Wait Attribute
- Wait Element Vanish
- Wait Image Vanish
- Application Event Trigger
- Block User Input
- Check/Uncheck
- Check App State
- Check Element
- Click
- Click Event Trigger
- Drag and Drop
- Extract Table Data
- For Each UI Element
- Get Browser Data
- Get Clipboard
- Get Text
- Get URL
- Go to URL
- Highlight
- Hover
- Inject Js Script
- Keyboard Shortcuts
- Keypress Event Trigger
- Mouse Scroll
- Navigate Browser
- Select Item
- Set Browser Data
- Set Clipboard
- Set Runtime Browser
- Set Focus
- Set Text
- Take Screenshot
- Type Into
- Unblock User Input
- Use Application/Browser
- Window Operation
- Perform browser search and retrieve results using UI Automation APIs
- Web Browsing
- Find Images
- Click Images
- Trigger and Monitor Events
- Create and Override Files
- HTML Pages: Extract and Manipulate Information
- Window Manipulation
- Automated List Selection
- Find and Manipulate Window Elements
- Manage Text Automation
- Load and Process Images
- Manage Mouse Activated Actions
- Automate Application Runtime
- Automated Run of a Local Application
- Browser Navigation
- Web Automation
- Trigger Scope Example
- Enable UI Automation support in DevExpress
- Computer Vision Local Server
- Mobile Automation
- Release notes
- About the mobile device automation architecture
- Project compatibility
- Get Log Types
- Get Logs
- Get Page Source
- Get Device Orientation
- Get Session Identifier
- Install App
- Manage Current App
- Manage Other App
- Open DeepLink
- Open URL
- Mobile Device Connection
- Directional Swipe
- Draw Pattern
- Positional Swipe
- Press Hardware Button
- Set Device Orientation
- Take Screenshot
- Take Screenshot Part
- Element Exists
- Execute Command
- Get Attribute
- Get Selected Item
- Get Text
- Set Selected Item
- Set Text
- Swipe
- Tap
- Type Text
- Terminal
UI Automation Activities
The SAP interfaces contain a variety of specific controls with which you can interact as exemplified in this page.
Represents any button found in the SAP GUI for Java windows. There are several types, each defined by a particular element:
Icons
Icons are interactive buttons which do not display text labels.
Push Buttons
A push button is a simple UI element which gives you direct access to a command in the application.
Radio Buttons
Radio buttons present a set of options. A list contains at least two radio buttons, and you can only select one.
You can use the Click activity to interact with buttons.
Checkbox elements represent a list of multiple choices. You can select one, more, or no options.
You can use the Click activity to interact with checkboxes.
Represents a list of items inside a context menu. Note that multiple child context menus can be available in a parent context menu.
You can use Java selectors and the Click activity to interact with the SAP Context Menu.
Represents an external window which can hold different types of other SAP controls such as buttons, text messages, or pop-up windows.
Selectors inside a dialog box are generated according to the element they represent.
If you want to close a dialog box using the Close button, you need to use the AA element detection framework.
Dropdown lists allow you to select items from predefined lists.
You can use the Select Item activity to interact with list items.
Represents a specialized field which accepts user input.
You can use the Type Into activity to interact with input fields.
SAP Logon is a locally installed program that you use to directly log on to an SAP system.
You can use the Click activity to open SAP.
Represents a section at the bottom of the SAP GUI for Java window which displays messages. It does not show system and login information.
You can use the Get Attribute activity to read the status properties from the SAP Statusbar.
SAP Session Information
Displays detailed information about the current SAP session, such as System, Client, logged User or current opened program and transaction.
The following optional selector attributes are available in UIExplorer, and can be used with other activities such as the Get Attribute activity when you build your SAP automation:
sapClient, sapLanguage, sapProgram, sapScreen, sapSession, sapSysName, sapSysNumber, sapSysSessionId, sapTransaction, sapUserSAP Tab represents a set of buttons which let you access specific information and controls.
You can use the Click activity to select a single tab at a time, or you can use the Select Item activity to choose the tab of interest from a list.
Special automation case
/ in their names, which may lead to identification issues, while using a wildcard in the selector.
/COCKPIT/1, the selector for one of SAP Tab inside the transaction can be:
<sap id='usr/subSUB_MAIN:/COCKPIT/SAPLDISPLAY46:0389/subSUB_HDR:/COCKPIT/SAPLDISPLAY46:04051/tabsG_STRIP_HDR/tabpTAB4' />
The dynamic part of the selector is: SAPLDISPLAY46:0389, where the number 0389 is dynamically changing and does not allow a stable identification.
The structure of the selector is:
?<sap id='usr/subSUB_MAIN:/COCKPIT/SAPLDISPLAY46:0389/subSUB_HDR:/COCKPIT/SAPLDISPLAY46:04051/tabsG_STRIP_HDR/tabpTAB4' /><sap id='usr/subSUB_MAIN:?COCKPIT?SAPLDISPLAY46:038*/subSUB_HDR:/COCKPIT/SAPLDISPLAY46:04051/tabsG_STRIP_HDR/tabpTAB4' />The SAP Table represents a standard set of controls for elements displayed in a tabular structure.
Common Operations
In SAP, there are multiple types of tables available. The most commonly used are Standard (default) tables, Grid Tables and ALV Tables. All kind of SAP Tables can be automated with Studio.
You can use the following activities to interact with SAP Tables and their content:
The SAP Grid Table supports Select/Deselect operations, Data Scraping, and the following common operations:
Data Scraping
Data scraping enables you to extract structured data from SAP Tables.
column1, column2, column3, etc.).
columns_name_source parameter to define the way you want to get the table information:
- Longest - The full name of column is extracted and used.
- Shortest - The short name of column is extracted and used.
- Displayed - The visible/displayed name in SAP GUI for Java is used.
- Technical - The technical header name of the column is extracted and used.
- Tooltip - The tooltip name which appears after hovering the mouse over a column name.
The SAP ALV Table supports all common operations that are available, as mentioned above, as well as Data Scraping for simple header tables and Screen Scraping. You can extract a single ALV table on the SAP screen.
Data Scraping
This works similarly to mentioned Data Scraping for SAP Grid Tables, with the following exceptions:
-
Horizontal scrolling is not supported. The table must fit horizontally on the screen and be in full view. Any columns out of view will not be scraped.
-
Multiple lines in a cell are not supported.
-
In some cases, the column tooltip name can be different from the display name in SAP ALV Tables.
Screen Scraping
In case you decide to use Screen Scraping, the recommended scraping method is FullText, and the Ignore Hidden check box should be selected. Please note that only visible text on the SAP screen is extracted by using this method.
To learn more about Screen scraping, please visit this page.
The SAP Textedit control represents an editable text field/editor.
You can use the following activities to interact with this control:
- The Type Into activity for text fields.
- The Send Hotkey activity for buttons which support hotkeys or the Click Image activity for buttons.
The SAP Toolbar represents a set of buttons, which you can interact with. In SAP, there are multiple types of toolbars, depending on the SAP Transaction or SAP Program.
- SAP System Toolbar
- SAP Application Toolbar
- SAP Special Toolbar
- SAP GridTable Toolbar
- SAP Generic Object Services
You can use the Click activity to interact with buttons inside the toolbars.
The SAP Tree represents a list of elements organized in a tree structure. Several types of SAP Tree controls are available:
-
Simple Tree
-
List Tree
-
Column Tree
You can use the Click or the Get Text activity to interact with a node or an item in any of the SAP Tree control types.
- SAP Buttons
- Icons
- Push Buttons
- Radio Buttons
- SAP Checkbox
- SAP Context Menu
- SAP Dialog Box
- SAP Dropdown Lists
- SAP Input Field
- SAP Logon
- SAP Statusbar
- SAP Session Information
- SAP Tab
- Special automation case
- SAP Tables
- Common Operations
- SAP Standard Table
- SAP Grid Table
- Select/Deselect
- Data Scraping
- SAP ALV Table
- Data Scraping
- Screen Scraping
- SAP Textedit
- SAP Toolbar
- SAP Tree
