Can I run a performance test locally?
No, mabl performance tests can only be run in the cloud.
How do I know what my failure criteria should be?
Baseline performance testing is a great way to identify reasonable failure criteria for performance tests. Organizations may also have codified performance SLAs that can be used for failure criteria. Learn more about which metrics you can use to set failure criteria here.
Does mabl allow performance testing in private environments?
We currently support a static IP range for performance testing:
220.127.116.11/27. Mabl Link is not currently supported for performance testing. If testing through mabl Link is important to your team, please let us know in the mabl Product Portal.
Can I generate load from different geographies?
No, configuring load traffic from different geographies is not currently supported. If this functionality is important to your team, please let us know in the mabl Product Portal.
Can I import tests from JMeter?
No, at this point in time, we do not support import for JMeter scripts. However, users can import Selenium tests and Postman collections into mabl and then reuse those browser and API tests within a performance test. If this functionality is important to your team, please let us know in the mabl Product Portal.
How does mabl measure usage of performance testing?
Mabl measures performance testing in virtual user hours (VUH).
- VUH for API load testing is the number of concurrent users multiplied by the number of hours.
- VUH for browser load testing is the number of concurrent users multiplied by the number of hours times two.
40 concurrent users x 15 minutes = 10 VUH
|40 concurrent users x 15 minutes x 2 = 20 VUH
How are virtual user hours (VUH) billed?
When you run a performance test, the total billable VUH is converted to test credits for billing purposes. One virtual user hour is the same as four test credits. For more information on test credits, see the article on reviewing workspace usage.
Do performance tests pull from my API allocation?
No, performance tests will not impact API test or browser test allocation. They are billed separately and pulled from an allocated bucket of virtual user hours.
What happens if I stop a performance test?
If you stop a performance test, it takes up to one minute for all tests to stop running. Stopped performance tests consume the number of VUH up until the test stopped.
What are the current limitations with performance testing?
The following are limitations with performance tests:
- Performance tests cannot simulate traffic by geography, networking throttling, or service mocking.
- Mabl Link is not yet supported for performance tests.
- Performance tests do not support API requests with a “binary” request body type.
- Virtual users will reuse connections, assuming the server under test permits it, so that multiple requests from the same virtual user as well as the associated responses from the server will all pass over the same underlying TCP connection.