Managing large sets of test data with shifting requirements can sometimes feel like an unwieldy task. To assist with this challenge, we’re happy to share that you can now select DataTable scenarios for plan execution using natural language!
Instead of manually reconfiguring DataTable scenario selection every time you update a DataTable, use natural language descriptions to select which scenarios should execute at run time. For example:
“Choose all scenarios with the ‘EN’ prefix”
“Run the scenarios where the user_role is admin”
Benefits of natural language scenario selection include:
- Automated maintenance: plans automatically select new scenarios that match your description without manual updates
- Bulk selection: instead of manually selecting every relevant scenario, quickly select entire groups using naming patterns, prefixes, or other common attributes
- Sampling: run random scenarios for quick health checks
Try it out
Natural language scenario selection is configured at the plan level. To try it out, edit a plan that includes a test associated with a DataTable:
- On the plan edit page, click on Show tests.
- Click on the Configure test variables icon for the test you want to edit.
- Set the parameter to type DataTable and select your source.
- Select Run specific scenarios > Dynamic.
- Enter a description of the scenarios you want to run and click Test.
Testing out natural language select
When you click Test, the run count and credit estimate update immediately. Otherwise, these values update automatically after you close the test variables panel.
How it works
Every time the plan runs, mabl re-evaluates the scenario description and selects which scenarios to include at run time.
Best practices
To get the most out of natural language scenario selection, abide by the following guidelines:
- Use naming conventions: use consistent scenario naming patterns, such as prefixes, suffixes, or other identifiers, to make bulk selection more powerful
- Start with simple requests: use more straightforward selection criteria, such as “all scenarios with EN prefix”, before trying more complex multi-condition requests
- Verify your selection: always review the number of rows were selected before saving your plan settings, especially with new or unfamiliar DataTables