Skip to main content

Mouse

Simulate mouse input for desktop automation - click, drag, scroll, and hover at screen coordinates.

Overview​

The Mouse package enables mouse simulation for desktop automation. Use it when you need to click at specific screen positions, drag items, scroll content, or hover over elements in any application.

Key Features​

  • Click Actions - Left, right, and double clicks
  • Drag Operations - Drag from one position to another
  • Scroll Actions - Scroll up, down, left, or right
  • Hover Actions - Move mouse to specific position

Available Nodes​

  • Mouse Click - Perform mouse click at coordinates (left, right, middle, double-click)
  • Mouse Drag - Drag from one position to another
  • Mouse Scroll - Scroll the mouse wheel in any direction
  • Mouse Hover - Move mouse cursor to specific coordinates

When to Use This Package​

  • Desktop Automation: Click on any screen element
  • Drag and Drop: Move items between positions
  • Scrolling: Navigate long pages or lists
  • Combined with Image Automation: Click at found image locations

Click Types​

  • Left Click - Standard click
  • Right Click - Context menu
  • Double Click - Open items or select words
  • Middle Click - Scroll or open in new tab

Typical Workflow​

  1. Find target element (using Image Automation or known coordinates)
  2. Mouse Hover to move to position
  3. Mouse Click to interact
  4. Mouse Scroll if needed to reveal content
  5. Mouse Drag for drag-and-drop operations

Tips​

  • Use Image Automation to find element coordinates dynamically
  • Add small delays between mouse actions for reliability
  • Consider using keyboard shortcuts when possible (more reliable)
  • Test on the same screen resolution as production