Use the mabl Test Creation Agent to jumpstart test authoring. Read on to learn how to set it up for a mobile test:
Define the intent of the test
When you create a new mobile test, include a description of what you want the test to accomplish. mabl’s AI will use this description to build out a test outline as a starting point.
Providing a test prompt
For guidelines on how to write an effective test prompt, click here.
Launch the Trainer
After describing the intent of the test, fill out the remaining information on the test creation form and click on Create test. As the Trainer launches, mabl gathers information about the flows in your workspace, and the GenAI model uses this information to create an outline of your test.
The Trainer loads a set of generated steps, including tasks, flows, and GenAI Assertions.
- Tasks - tasks are headers that break down the overall intent of the test into smaller goals
- Flows - if any existing flows are pertinent to the test case, mabl adds them to the relevant task.
- GenAI Assertions - each task finishes with a GenAI Assertion to validate the expected behavior once a task is complete.
A test with mabl-generated tasks
Here’s what you can expect in the following situations:
- Empty workspace: In a workspace with no flows, the Trainer cannot add flows to your tasks.
- Using the same prompt multiple times: Generative AI is non-determistic. If you repeatedly generate tests with the same prompt, you could end up with slightly different test outlines even if the core logic is similar.
- Defining the test intent in a non-English language: The agent is biased towards English. If you define the test intent in a non-English language, the Trainer may still generate tasks and assertions in English.
Build out the test
Review each task in the Trainer and train any additional steps required to complete the task:
Make sure your application is in the right state and the “Rec” button is on before you insert new steps.
Add steps
To add steps to a task, hover over the task and click on the Insert step button to place the Trainer cursor at that location.
Adding a step to a task
Build out flows
If the task contains a flow, you may need to train additional steps before or after the flow to accomplish the task. If the flow uses parameters, make sure the parameter values are properly configured.
To ensure mabl selects appropriate flows for your test, we recommend reviewing the existing flows in your workspace on a regular basis.
The following practices can help improve the overall quality of the flows:
- Use flow naming conventions
- Add echo steps, renamed steps, and assertions for readability
- Make sure flows target one specific purpose
- Remove redundant and unused flows
Complete GenAI Assertions
Test the GenAI Assertions to make sure they pass and generate appropriate criteria:
- Click on the edit pencil next to the GenAI Assertion.
- Revise the assertion description if it is too vague or specifies inaccurate or irrelevant details.
- Click on Test assertion to generate assertion criteria. Generating assertion criteria helps ensure the reliability of the GenAI Assertion.
For more information on working with GenAI Assertions, check out these articles:
Iterate as needed
Play back the test in the Trainer and iterate on this process as needed:
- Record any necessary steps that are not covered by the imported flows within each task.
- Revise GenAI Assertions to make sure they pass and generate the appropriate criteria.
- If necessary, update the structure of the test by deleting, adding, or editing tasks.
To create a new task header, insert an echo step and add the special symbol “–>” before the text.