We’re happy to announce that we've expanded support for AI-generated test failure summaries to API tests!
Test failure summary for an API test
Already available in early access for web and mobile tests, test failure summaries use generative AI to analyze test output and provide a succinct explanation of why the test failed. With test failure summaries, you can quickly understand failures, identify patterns in failures, and reduce overall time spent on identifying and resolving bugs.
For API tests, mabl sends the following test output data to the model to generate a failure summary:
- Test name and description
- Information on the request and response for up to 5 failing test steps
- Information on the request and response for the same test steps in a recent passing run, if there is one
- The pre-request script, post-request script, and assertions for failing test steps
- The variables defined in the test run and their values
Early access feature
Test failure summaries are currently available for all mabl customers and trial users as an early access program. Prior to general availability, changes to the feature may be made without notice.