Troubleshooting failed tests can take up a lot of time. With GenAI Test Failure Summaries, you can reduce the time you spend troubleshooting and devote more time to other important priorities in your schedule.
Advanced AI add-on
GenAI Test Failure Summaries are available as an add-on to the mabl core subscription. Reach out to your customer success manager to learn more.
If your workspace includes the Advanced AI add-on, when you open up the test output for a failed test run, mabl sends the output to a large language model for analysis and returns a summary of why the test failed and a suggested failure reason to help your team save time on review.
This article lists the output that mabl uses to generate a test failure summary by test type.
A GenAI Test Failure Summary
Browser and mobile tests
For browser and mobile tests, mabl sends the following data to the model to generate a failure summary:
- Test name, description, and steps
- Test output logs and screenshot from the failing test step. If there are multiple failing steps in a test, mabl uses the first failing step for its analysis
- Test output logs and screenshot from the same test step in a recent passing test, if there is one
API tests
For API tests, mabl sends the following data to the model to generate a failure summary:
- Test name, description, and steps
- The variables defined in the test run and their values
- Information on the request and response for up to 5 failing test steps
- Information on the request and response for the same test steps in a recent passing run, if there is one
- The pre-request script, post-request script, and assertions for failing test steps