A screenshot can show me what is on a Mac screen. It cannot tell me, by itself, what a control means, whether an action succeeded, or how much authority an assistant should have. That is why I think a screen-aware assistant needs more than vision.
Source: [Dev.to](https://dev.to/sarthakagrawal927/a-screenshot-is-not-enough-for-a-screen-aware-mac-assistant-38bm)