Skip to main content

Select & Copy

Locates an image on the screen, clicks it, selects all text in the area, and copies it to the clipboard.

Common Properties​

  • Name - The custom name of the node.
  • Color - The custom color of the node.
  • Delay Before (sec) - Waits in seconds before executing the node.
  • Delay After (sec) - Waits in seconds after executing node.
  • Continue On Error - Automation will continue regardless of any error. The default value is false.

Inputs​

This node does not have direct inputs. It uses a reference image for matching.

Options​

  • Confidence - Confidence level for image recognition (default: 0.95).

Outputs​

This node does not have outputs.

How It Works​

The Select & Copy node finds a specified image on the screen, clicks it, and copies text. When executed, the node:

  1. Downloads and prepares the reference image if needed
  2. Takes a screenshot of the current screen
  3. Uses image recognition to locate a defined region on screen
  4. Calculates the target click position based on anchor and target regions
  5. Moves the mouse cursor to the calculated position
  6. Clicks the left mouse button
  7. Selects all text (Ctrl+A)
  8. Copies the selected text to clipboard (Ctrl+C)

Requirements​

  • Valid reference image with defined regions
  • Confidence value between 0 and 1

Error Handling​

The node will return specific errors in the following cases:

  • Empty image - "Empty Image"
  • Could not read image - "Could not read image"
  • Missing confidence - "Confidence can not be empty"
  • Invalid confidence format - "Confidence is not valid"
  • Confidence out of range - "Confidence must be between 0 and 1"
  • Image not found - "Could not find image. Decreasing confidence may help"

Usage Notes​

  • This node is useful for automating text extraction from UI elements
  • Requires properly defined regions in the workflow designer:
    • An anchor region to locate on screen
    • A target region to determine click position
  • The confidence level affects the accuracy of image matching
  • Higher confidence values require more precise image matching
  • Lower confidence values may result in false positives but can handle variations better
  • The click position is calculated to be within the target region
  • Uses standard keyboard shortcuts (Ctrl+A, Ctrl+C) for text selection and copying
  • The copied text can be accessed from the system clipboard in subsequent nodes
  • Works best with UI elements that contain selectable text