Device Interaction

Device Interaction Conditions

When an action is executed, device interaction is locked until its completion.

Starting an Application

To interact with your device you must first start an application. You have three options to choose from in MDM, as listed in the following table.

Method	Procedure
Start an application from a device	Go to the Devices tab and select a device. Click Start an application on this device. Choose an application from the dropdown and click Connect.
Start an application from a configured app	Go to the Applications tab and select an application. Click Start application. Choose a device from the dropdown and click Connect.
Start an application using Quick Actions within the Welcome tab	Go to the Welcome tab and select Start an application. Choose a device and an application from the dropdown. Click Connect. For more information about Quick Actions, refer to Quick Actions.

Interacting With The Device

You can interact with your device in MDM as you would with an actual physical device, using your mouse or the action bar. The screen and the actions are locked when you perform an action.

On-Screen Interaction

The following table lists the on-screen actions that you can take to interact with your device.

Action	Description	Procedure
Tap	Access an on-screen element.	Click an element on the device screen.
Double Tap	Perform double tap action on-screen.	Double-click an element on the device screen.
Long Tap	Long press.	Click and hold on an element.
Pinch (Zoom In/Out)	Zoom in and out. This action is not recorded.	Right-click and hold, and then drag to the bottom of the screen to zoom in, or towards the upper part to zoom out.
Swipe	Swipe on-screen.	Click and drag towards any part of the screen.
Keyboard Input	Type in your text and send it to the mobile. For example, you can use the search bar to quickly access a website.	Double-click on a text area to open the input window. Type in your text. Select Press Enter key after sending text to type in and enter your input directly. Click Send Text.

Action Bar

The following table lists the actions that you can take to interact with your device. The action bar is right next to the device.

Action	Description	Procedure
iOS Home	Return to the home screen.	Click the iOS Home button.
Android Back	Get back to the previous screen/page.	Click the Android Back button.
Android Home	Return to the home screen.	Click the Android Home button.
Android Switch Apps	Switch between apps.	Click the Android Switch Apps button, and choose your next action.
Change orientation to landscape/portrait	Toggle between portrait (vertical) and landscape (horizontal) mode for your device. Screen orientation is not supported by all applications.	Click the Change Orientation toggle to switch between modes.
Refresh	Refresh the device connection.	Click the Refresh button. Alternatively, click the Reconnect button when the connection has been lost.
Save Screenshot	Save the current screen.	Click Save Screenshot and choose a location to save the file.
Send Text	Type in your text and send it to the mobile. For example, you can use the search bar to quickly access a website.	Select a focusable element and then click Send Text. Type in your text. Select Press Enter key after sending to type in and enter your input directly. Click Send Text to confirm.
Selection by identified elements/absolute position	Toggle between element coordinates used for selection.	Click the Selection by identified elements/absolute position toggle to choose the default element selection coordinates.
Install App	Install an application on your device.	Click the horizontal ellipsis to open Advanced Settings. Click the Install App button and enter your app full location. Click Install to confirm.
Manage App	Manage the current application.	Click the horizontal ellipsis to open Advanced Settings. Click the Manage App and select one of the following actions from the dropdown: Launch: Launch the default app page. Reset: Restart the app. Click Execute to confirm.
Manage Other App	Manage other applications on your device. You can use this when you test integrations between apps.	Click the horizontal ellipsis to open Advanced Settings. Click the Manage Other Apps and enter your app's name. Choose on of the following commands from the dropdown: Remove: Uninstall the app. Activate: Open the app. Terminate: Close the app. Click Execute to confirm.
Open URL	Open URL in browser.	Open a browser on your device. Click the horizontal ellipsis to open Advanced Settings. Click the Open URL and enter a full URL. For example: `https://www.google.com/`. Click Open to confirm.
Open Deep Link	Launch an app that opens a specific page.	Click the horizontal ellipsis to open Advanced Settings. Click the Open Deep Link and configure the following: App: App path Deep Link: Specify the page that you want to open. Click Open to confirm.
Save Source	Save the XML source file of the device.	Click the horizontal ellipsis to open Advanced Settings. Click the Save Source and select a location to save the file.
Set Geo Location	Set geographic coordinates.	Click the horizontal ellipsis to open Advanced Settings. Click the Set Geo Location and use the Latitude, Longitude, Altitude finder on map to get coordinates. Alternatively, you can search for your location. Click Set to confirm.

Recorded Actions

You can interact with your device through the action bar or by indicating your actions on-screen to record the steps. For example, you can record and manage your actions to prepare mobile automation workflows in MDM. For more information, see Create Workflow Using Recorded Actions.

The following table lists the actions that you can take using Recorded Actions.

Action	Description	Procedure
Execute	Execute the action.	Click the Play button on an action to execute it.
Copy	Copy the action to your clipboard. You can use the Import Recorded Actions in Studio to paste it to your workflow.	Click the Copy button to copy the action to your clipboard.
Delete	Delete the action.	Click Delete to remove the action from the list. Alternatively, you can click Clear All to remove all actions.
Reorder	Reorder the list of actions in alternate order.	Drag and drop an action to different position within the list.
Wait for page update	Wait for the page source to retrieve a screenshot of each action.	Toggle the Wait for new screenshot after each action.

On this page

Device Interaction Conditions
Starting an Application
Interacting With The Device
On-Screen Interaction
Action Bar
Recorded Actions

Was this page helpful?

PREVIOUSManaging Applications

NEXTCreating Mobile Automation Workflows

Support and Services

Get The Help You Need

UiPath Academy

Learning RPA - Automation Courses

UiPath Forum

UiPath Community Forum

Trust and Security

Cookies Policy