Understanding BigQuery feed export

As soon as a plan or journey completes, the execution details such as outcome, duration, and browser type will be immediately written to tables in your configured BigQuery dataset. See the export schema for details.

Enterprise Feature

This feature is enabled during trials and requires an Enterprise plan.

Getting Started

You'll need to add a Service Account to your destination GCP Project so mabl can deliver data.

Google Cloud Project Aliases

Sometimes GCP will alias a project, meaning the project Id and Name are different.
Make sure to use the account Id not the account Name in this case.

Run gcloud project list to see all project details (Id, Name, Number).

  1. Add the ServiceAccount mabl-feeds@mabl-prod.iam.gserviceaccount.com. as a BigQuery Data Editor to the destination Google Cloud Platform project (more details).
  2. In the mabl web UI, Visit Settings > Integrations and click BigQuery Export.
  3. Add the destination project Id, dataset name, and a prefix for the export table.
  4. Click save.
Click the `Export BigQuery` button to get started.

Click the Export BigQuery button to get started.

Upon running the first journey through the BigQuery export feed, the specified dataset and following tables will be created.

  • <table_prefix>_plan_run
  • <table_prefix>_journey_run

For example, if you use the defaults, the following BigQuery tables will be created:

  • <your-project>:mabl_export.mabl_plan_run
  • <your-project>:mabl_export.mabl_journey_run

Personally Identifiable Data Redaction

For readability, exports reference entities using both an opaque unique identifier, and the customer supplied name property.

For user entities, this name is their email. However, some customers may not want this information in BigQuery. Enabling the Redact Personal Information Fields will replace these entries with the value PII_REDACTED on all subsequent writes.

Redact personally identifiable fields.

Redact personally identifiable fields.

Field Redaction Doesn't Include Free Text

The PII redaction only excludes the below fields.

  • trigger_user_email

Other free text fields, like journey name will still be included. mabl does not inspect the contents of these fields.

Table Schema Changes

Table schema changes will be rare and only be additive if they occur

  • New columns only
  • Announcement via Friends of mabl Slack and email lists
  • Admins of active integration users will be notified

Table Schema

Table *_plan_run

Contains every plan run on the integrated workspace, written upon plan run completion.

Column Name
Type
Description

id

String

plan run id

plan_id

String

plan id

plan_name

String

plan name

plan_url

String

plan UI URL

status

String

plan run status

success

Boolean

overall plan run success

start_time

Timestamp

plan run start time UTC

stop_time

Timestamp

plan run stop time UTC

runtime_millis

Integer

total plan run time milliseconds

tags

String, Repeated

plan tags

application_id

String

application under test id

application_name

String

application under test name

application_url

String

application under test UI URL

starting_url

String

application under test starting url

trigger_type

String

execution trigger type

trigger_user_id

String

execution triggering user (optional)

trigger_user_email

String

execution triggering user email (optional)

deployment_id

String

execution trigger deployment id (optional)

workspace_id

String

workspace name

workspace_name

String

workspace name

Table *_journey_run

Contains every journey run on the integrated workspace, written upon journey run completion (possibly before parent plan run, as parent isn't yet complete).

Column Name
Type
Description

id

String

journey run id

journey_id

String

journey id

journey_name

String

journey name

journey_url

String

journey UI URL

view_output_url

String

journey run output UI URL

status

String

journey run status

success

Boolean

overall journey run success

start_time

Timestamp

journey run start time UTC

stop_time

Timestamp

journey run stop time UTC

runtime_millis

Integer

total journey run time milliseconds

tags

String, Repeated

journey tags

environment_id

String

journey run environment

environment_name

String

journey run environment name

environment_url

String

journey run environment UI URL

browser_type

String

browser under test type

browser_version

String

browser under test version

plan_id

String

plan id

plan_name

String

plan name

plan_url

String

plan UI URL

plan_run_id

String

plan run id

workspace_id

String

workspace id

workspace_name

String

workspace name


Understanding BigQuery feed export


Suggested Edits are limited on API Reference Pages

You can only suggest edits to Markdown body content, but not to the API spec.