Link crawler settings

You can edit the following settings for link crawler tests:

  • Auto-login
  • Copy with custom login
  • Change the link crawler's starting URL

Auto-login

If the application URL points to a login page, you can add an auto-login flow to automatically log in before crawling links:

  1. Open the Plan Details page for "Check all pages for broken links and errors."
  2. Click on the edit pencil.
  3. Scroll to the "Advanced" section.
  4. Toggle on "Login credentials required."
  5. Select the mabl credentials required to log into your app.
  6. Save your settings.
Adding an auto-login flow

Adding an auto-login flow

Copy with custom login

Auto-login flows do not work if the login requires more than username and password or if the login isn't in English. If auto-login is unable to log into your application, you can create a copy of the link crawler test and add your own custom login flow to it:

  1. Open the Test Details page for "Checked all linked pages within the app."
  2. Click on the "Copy with custom login" button.
  3. Select the login flow you want to use instead.
  4. Click on the "Duplicate" button.
Copying with a custom login flow

Copying with a custom login flow

Mabl generates a copy of the link crawler test with your custom login flow. You can run this copy of the link crawler test ad hoc or add it to a plan.

🚧

Notes about copying link crawler tests

  • While running the default link crawler test is free, running a copied link crawler test counts toward your monthly quota of allotted tests.
  • The output from copied link crawler tests still counts toward page coverage metrics.

Change the link crawler's starting URL

By default, the link crawler starts crawling links at the application URL. However, you can also configure the link crawler to start crawling links at a different specified URL.

Changing the link crawler's starting URL can be useful if the application URL points to an authentication page, but you still want to crawl your application's links once the login flow is executed.

To change the starting URL, take the following steps:

  1. Open the Plan Details page for "Check all pages for broken links and errors."
  2. Click on the edit pencil.
  3. Scroll to the "Tests" section.
  4. Click on the edit pencil next to the test "Visit all linked pages within the app."
  5. In the data-driven variables panel, click the "Add parameter" button.
  6. Select "Crawler starting URL" as the parameter name.
  7. Enter the desired starting URL as the value.
  8. Click the "Done" button and save your plan settings.
Changing the starting URL

Changing the starting URL

📘

Note

You cannot specify a starting URL with a different domain than your application URL. For example, you cannot set the starting URL to www.google.com if your application URL is www.mabl.com.

The link crawler does not traverse links that do not match the domain of the application URL.