AURA
← Back to the site

44 tools. Real outputs.

Everything the AURA MCP server gives an AI agent: what each tool takes, what it actually sent back, and a recording of the phone while it ran. One unedited session on a real Android phone. Nothing on this page is mocked.

Recorded on AURA's development build. The tools tagged next app release (set_value, run_steps, clipboard) are not in the current download yet; they arrive with the next release.

Nothing personal is shown. The run stayed in Settings, the Clock timer, two demo files made for this page and a public test website. The status bar is in Android's demo mode. resolve_contact can only answer with real people, so its names and numbers are swapped for placeholders.

Every call in the recording. Click one to jump there.

How an agent works the phone

It looks with read_screen, which numbers everything on screen. It acts on a number: tap som_id 12. Then it decides from what the action reports back. The numbers are only good for the screen they came from.

Reading a read_screen result

  • SEEN: the app and the biggest labels.
  • SCREEN size, app, IDLE or BUSY.
  • The grid: a text picture of the screen.
  • The table: som, in (its parent box), flags, label.
  • OFFSCREEN: text scrolled out of view.

Flags in the table

  • * tap · e text field · S scrolls
  • c/o switch on/off · l long-press
  • d disabled · - nothing declared
  • x under 5 covered by 5: tap refused

Reading the pictures

Each action shows the screen before and after, and the clip of that moment.

where the finger landedfinger pathwhat changed