Interactions

User interactions are a key part of our MATRIX solution. They allow you to interact with your app in a way that simulates real-world usage, which can help identify security issues that might not be caught by automated security checks alone.

After creating a test, you can interact with your app using our various SDKs, or GitHub Action. This generates valuable data and traffic from the app, which can be used to identify vulnerabilities.

Usage

If you're using the Corellium UI, simply interact with your app as you normally would in our device preview. If you're automating this process, you can use our SDKs to interact with your app.

Automated interaction works by sending events to the virtual device, such as tapping on the screen, entering text, or pressing buttons. Corellium supports a wide range of interactions. Read more about them in our API documentation.

Examples

For example, here's the payload you can use to press a button at [300,600] for 100ms:

[
  {
    "buttons": ["finger"],
    "position": [
      [300, 600]
    ],
    "wait": 0
  },
  {
    "buttons": [],
    "wait": 100
  }
]

Or, you could try a one-finger swipe:

[
  {
    "startButtons": ["finger"],
    "start": [
      [300, 600]
    ],
    "bezierPoints": [
      [ [350, 700] ],
      [ [375, 750] ]
    ],
    "end": [
      [400, 650]
    ],
    "endButtons": [],
    "duration": 200
  }
]

X/Y Coordinates

To find out the X/Y coordinates of a button or other UI element, you can use the X/Y Coordinates feature in the Corellium UI.