1) Open your interface
2) Open Automator, Choose Create Quick Action.
3) Click RED button (it is RECORD function of Automator, otherwise, its Follow Me function). It will record your clicks
4) perform in your inteface your actions  a. b. c. d. manually
5) Stop Automator Recording

Now the Automator has recorded your manual actions. In Automator window see what script wrote Automator for you If UI element you need exist, it should be included in the recorded Automator's script.

If it doesn't exist, then you should use mouse tools, as suggested by Fredrik71

NOTE: to see Automator's script, you should drag recorded actions to Automator's code area, one by one

Last edited by KniazidisR (2021-01-18 11:04:03 pm)

There are way to get x,y screen coordinates from a window.

1. Properties of UI element
2. Return the attributes
3. Properties of application  window

ex1.

Applescript:

tell application "Terminal" to tell front window
   set theFrame to its frame
end tell

ex2.

Applescript:

tell application "System Events" to tell process "Terminal"
   set frontmost to true
   tell front window
       set thePosition to position
   end tell
end tell

ex3.

Applescript:

tell application "System Events" to tell process "Terminal"
   set frontmost to true
   tell front window
       its value of attribute "AXFrame"
   end tell
end tell

So how did I know 'frame, position and AXFrame'... its very simple we ask for properties.

ex1.
We ask for properties in tell block of front window

Applescript:

tell application "Terminal" to tell front window
   its properties
end tell

ex2.
We ask for properties in tell block of front window

Applescript:

tell application "System Events" to tell process "Terminal"
   set frontmost to true
   tell front window
       its properties
   end tell
end tell

ex3.
We ask for:

Applescript:

its properties of attributes

When we know its AXFrame attribute, we could do.

Applescript:

its properties of attribute "AXFrame"
--> {value:{0, 511, 710, 900}, class:attribute, settable:false, name:"AXFrame"}

Now we could ask for values.

Applescript:

its value of attribute "AXFrame"

Last edited by Fredrik71 (2021-01-20 10:37:59 am)

Wait, just to be clear, those terminal scripts will identify the GUI control point in the red box, numbered 2, not the entire window?:

https://drive.google.com/file/d/12Pbbfb … sp=sharing

Thanks!

Last edited by whitebalance (2021-01-20 09:06:29 pm)

Thank you Fredrik 71...

Shell click makes it work!  I did some testing, and just want to confirm that it's the API that's stopping me from using Applescript to click?  I can get Applescript to click on other elements in the UI:

https://macscripter.net/viewtopic.php?p … 32#p205332

Thanks again!!!

Last edited by whitebalance (2021-01-22 11:45:23 pm)