Watch Me Do or other method for exact pixel coordinate of mouse click (Automator)

automator

Is it possible to specify how a mouse click point is recorded or processed in Watch Me Do?

had thought it was exact pixel position recorded but it seems that in a safari browser it is relative to the page scroll…

Is there another way to simulate actions clicking in exact locations (irrespectivec of browser scrollbar)?

Specifically, I would prefer a non-third party tool solution – using Automator if possible.

Best Answer

Automator can ‘Run AppleScript’, and you can click at a coordinate using AppleScript:

tell application "System Events"
  click at {123,456}
end tell

How do I make the mouse click at current location using AppleScript?

Related Solutions

Use Automator or some other method to extract EXIF GPS data from batches of photos on the Mac

With Commandline tools this is easy:

Install Homebrew
brew install exiftools in the Terminal
find ~/Pictures/ -iname '*.jpg' -print -exec exiftool -DateTimeOriginal -GPSLatitude -GPSLongitude {} \; in the Terminal

MacOS – Easiest way to repeat MANY mouse clicks

I know you already rejected CliClick, but what if the script was provided for you? It’s actually quite simple. In Script Editor enter the following:

tell application "Google Chrome"
    activate
    repeat 500 times
        do shell script "/Users/<you>/Desktop/cliclick c:" & "1694,18"
        delay 1.5
    end repeat
end tell

Replace 1694,18 with the actual coordinates of the button you want to click. Those can be obtained by pressing ⇧ shift ⌘ cmd 4 and hovering your cursor over the button.

Also replace <you> with your account name, and adjust the delay as appropriate, to account for any animation or form postback.

Obviously this is all assuming the click occurs in the same spot each time. Your question doesn’t specify, although I get the sense that that is the case. Otherwise it would be very hard to script as a repeating click.