Reviewing test results

mabl provides a wealth of information related to test results to help you triage and diagnose issues.

Viewing results for a particular test run

  1. Click the "Results" option in the left-hand navigation menu.
  2. Filter the list of test runs to locate the relevant test.
  3. Click "View Results" in the right-hand column

The test run results screen includes relevant information on the status, runtime, browser, screenshots, and other observations collected during the test run.

📘

You can click the Clock icon in the test run log to toggle between earth time and test time.

Click on a step in the list along the left side of the page, then click the "Logs" tab. You'll see a button there where you can toggle the time display.

Page header

The output page header displays and organizes the information about this specific test run. A maximum of 6 items are shown in the header, and any additional information can be found by clicking the "View all" button.

Failed tests have a "Failed" badge in the header that quickly points you towards the failed step in the test.

The failed step itself will also give a brief description of the failure it encountered at that step. Use these descriptions to quickly identify the failure before diving deep into the underlying causes such as a regression, an environment that wasn't accessible, or a timing issue. These step failure descriptions include:

  • Assertion failed
  • Could not click element
  • Could not enter text
  • Element not found
  • Tab not found
  • And more...

For tests that have been run multiple times and/or across multiple browsers, you can quickly switch between those run versions with the Browser and Time of Run dropdowns.

Filtering test run results

When viewing the run results, you can filter by various identifiers such as "Warning," "JS Exception," and "Error" to help get a better understanding of your test. It's simple to do this, as shown below:

  1. Navigate to the results page for your run, as shown above.
  2. Examine the bar at the top of the output feed, you should see the word "Filter."
  3. Click the bar to examine the various filters or, alternatively, type your own custom filter such as "loader," "fire," or anything you'd like. The filter uses word stemming to be able to filter additional words that may be relevant, such as "load" from a "loader" filter.

📘

If you toggle Warning, JS Exception, and Error on (leaving info deselected), you'll see all issues that mabl detected, including broken links, failed assertions, JavaScript errors.

Viewing Network Activity (HAR File) details

mabl supports the viewing of HTTP Archive (HAR) data for any given step in your test in JSON format. This data provide all the network requests made by the application under test during the current step and can be useful when trying to debug network errors that occur during test runs.

📘

Growth Feature

This feature is enabled during trials and requires a Growth or Enterprise plan.

Collapsing run logs & viewing thumbnails

Click the icon to the right of the filter bar to toggle between the detailed card view, and the page thumbnail view. The page thumbnail screenshots will be shown as smaller thumbnails while the main screenshot on the right, showing visual changes and the elements interacted with by mabl in that step, will expand to a much larger size for easier viewing.

Above each thumbnail is the step that the image is attached to, while hovering over any thumbnail will reveal the full step performed by mabl.

Live playback

While a test is running, you can watch it playback live on the output page. If a step fails during playback, it will be selected automatically and details about that step will load in the panel on the right.

If your test passes, you'll see a message on the right tell you that the test passed, and the status in the header will update.


Did this page help you?