Search Object Types
Search objects fall into three main categories based on recognition method:
- Recognized UI elements – detected directly by the AI model from the screen image.
- Special objects – define working areas, masks, or relative coordinates.
- Positional search – locate elements relative to another reference object.
Each type plays a critical role in reliable UI automation.
Positional Search
These elements locate a target based on its position relative to another element. Two fields must be set:
Recognized UI Elements
The detection model processes a screenshot and returns elements suitable for interaction.
Special Objects
These do not represent interactive elements; they define areas or masks.