Reviewing test output

Mabl provides a wealth of information related to test results to help you triage and diagnose issues.

Viewing results for a particular test run

1. Click the "Results" option in the left-hand navigation menu.
2. Filter the list of test runs to locate the relevant test.
3. Click on the test status or the "Results" link to open the in the right-hand column to view the results in the Test Output page.

The Test Output page includes relevant information on the status, runtime, browser, screenshots, and other observations collected during the test run.

📘

Time display

You can click the "Time display" icon in the mabl Activity logs for a given step to toggle between earth time and test time.

Page header

The output page header displays and organizes the information about this specific test run. A maximum of 6 items are shown in the header, and any additional information can be found by clicking the "View all" button.

Failed tests include the option to add a failure reason. The failed step itself will also give a brief description of the failure it encountered at that step. Use these descriptions to quickly identify the failure before diving deep into the underlying causes such as a regression, an environment that wasn't accessible, or a timing issue. These step failure descriptions include:

• Assertion failed
• Could not click element
• Could not enter text
• Element not found
• Tab not found
• And more...

For tests that have been run multiple times and/or across multiple browsers, you can quickly switch between those run versions with the Browser and Time of Run dropdowns.

Filtering test run results

When viewing the run results, you can filter by various identifiers such as "Warning," "JS Exception," and "Error" to help get a better understanding of your test. To do this, take the following steps:

1. Navigate to the Test Output page for the test run you want to review.
2. Click on the "Filter" bar to open the filter dropdown.
3. Select a filter from the dropdown or, alternatively, type your own custom filter such as "loader," "fire," or anything you'd like. The filter uses word stemming to be able to filter additional words that may be relevant, such as "load" from a "loader" filter.

👍

Filter for test issues

If you select Warning, JavaScript exception, Error and Accessibility violation, you'll see all issues that mabl detected.

Viewing network activity (HAR File) details

Mabl supports the viewing of HTTP Archive (HAR) data for any given step in your test in JSON format. This data provide all the network requests made by the application under test during the current step and can be useful when trying to debug network errors that occur during test runs.

📘

Growth Feature

This feature is enabled during trials and requires a Growth or Enterprise plan.

Collapsing run logs & viewing thumbnails

Click the icon to the right of the filter bar to toggle between the detailed card view, and the page thumbnail view. The page thumbnail screenshots will be shown as smaller thumbnails while the main screenshot on the right, showing visual changes and the elements interacted with by mabl in that step, will expand to a much larger size for easier viewing.

Above each thumbnail is the step that the image is attached to, while hovering over any thumbnail will reveal the full step performed by mabl.

Live playback

While a test is running, you can watch it playback live on the output page. If a step fails during playback, it will be selected automatically and details about that step will load in the panel on the right.

If your test passes, the Test Output page will add a "passed" status to the header.

📘

Mabl Reporting API

For more information on retrieving test results programmatically, check out our resources on the mabl Reporting API:

• Introduction to the reporting API
• Custom integration with Google Sheets tutorial
• Exporting test results in Node tutorial
• Exporting test results in Bash tutorial