Email notifications

If you prefer to receive results of recent plan runs in your inbox, you can configure mabl to send one of the following types of email notifications:

• Workspace report - a status report on all active plans in a workspace, sent on a schedule, and configured as a per-user setting. Best for a quick recap of workspace activity.
• Plan report - a status report for a specific plan, generated on a schedule or triggered by a plan status, and delivered to the entire workspace or to specific workspace members. Best for keeping stakeholders informed on testing activity for a specific area.

This guide explains how to configure workspace reports and plan reports and what information is included in each type of report.

Workspace reports

Workspace reports include a summary of active plan runs across the workspace, including plan run statuses and recent insights. Contents of the workspace report include:

• A summary of test activity
  • Tests: number of tests that ran in the most recent run of each active plan
  • Test runs this month: number of browser tests that have run in the current month to date
  • Passed test runs: number of passing test runs from the most recent run of each active plan
  • Failed test runs: number of failing test runs from the most recent run of each active plan
• Recent insights
  • Test coverage: total test coverage averaged across all applications in the workspace for the last two weeks
  • Visual changes: number of steps with visual changes in the last 30 days
  • Broken links: number of broken links in the most recent link crawler run
  • Javascript errors: number of steps with JavaScript errors in the most recent link crawler run
• Plan run details
  • Details from the most recent run of each currently active plan, starting with failed plan runs
  • Direct links to view detailed results in the mabl app

Configuring workspace reports

To configure workspace report settings, click on the account dropdown in the top right corner of the app and select User settings.

Workspace reports are sent to the email address associated with your mabl account. Settings are configured per user per workspace.

You may configure the workspace report to be sent according to one of the following schedules:

• No report
• Daily
• Weekly - this is the default setting
• Custom

The report is delivered according to when you saved the setting. For example, if you configure the workspace report to be sent weekly and save it on Wednesday, it will always get sent on Wednesday. Use “Custom” to set a specific schedule.

Plan reports

If you want to follow a specific plan more closely with your team, you can set up plan reports. Plan reports contain a summary of the most recent active run for a specific plan, including:

• Plan name, application, and time of run
• Plan run status
• Status of test runs within the plan
• Link to results in the mabl app

Plan reports do not cover results of local and CI runs triggered using --from-plan-id.

Configuring plan reports

To configure plan report settings, go to the plan details page and click on the email icon to open the report settings modal.

Whereas workspace reports are configured by each individual user, plan reports are configured at the workspace level. Indicate whether the plan report should be sent to “specific email addresses” or all “workspace members”. If you select “specific email addresses”, indicate the email addresses in a text box that appears when you select a scheduled or triggered report option, and use commas to separate multiple email addresses.

Plan reports may be sent out on a schedule - daily or weekly - or according to a specific trigger, including:

• On pass/fail status change
• On each run
• On each passing run
• On each failing run

Similar to workspace reports, plan reports that go out daily or weekly are sent according to the day and time when they were saved. If you save a daily plan report at 4 PM, mabl will send out subsequent daily reports at that same time.