Skip to main content

· One min read

✨ New ✨

dbt Integration

Details

More Detail

Bring data transformations into your metric store with Transform's first integration with dbt. This integration gives you the power to define Transform data sources using dbt models. Transform then surfaces useful metadata from your dbt models—like the time of the last successful run—and links to model documentation directly in the Transform UI.

Verification Steps

Read the documentation here!

· 3 min read

✨ New ✨

Alerts

Details

More Detail

Transform’s new Alerts feature helps us as data owners to proactively get alerted when a metric value goes down or up, providing time to investigate, author an annotation, and then publish that annotation to all subscribers of that metric. We believe this is a much stronger, push-based workflow for keeping track of value changes for the metrics we own.

Verification Steps

To access the new Alerts feature, visit any metric that you own and click the settings icon near the upper-right side of the page. From here, you'll see the "Owner Alerts" area where you can create new alerts that will be set for all technical and business owners of the metric. Here, you also have the ability to select how you'll receive those alerts, via Transform in-app notifications or via email, with Slack alerts coming soon.

Read the documentation here

Slack Integration

Details

More Detail

Our Slack integration allows users to share metric charts from Transform to a user or channel in Slack.

When enabled using our integrations page, every chart will have a "Share to Slack" button that can be found in the top right corner (menu with three dots).

Verification Steps

Enable Slack by visiting the integrations page

Read docs on how the integration works here.

New Search Filters

Details

More Detail

We upgraded our search filters to include the ability to filter metrics based on whether you are subscribed to them, who owns them, as well as the metric created date.

Verification Steps

Click on the "Metrics" button on the left navigation or search anything in the search bar at the top of the page to interact with these new filters.

Onboarding Cards

Details

More Detail

New users who log in to the Transform application will now see onboarding cards with links to content that will help them get up and running with Transform.

This includes links for creating your metrics, features of the metrics catalog, and exploring sample metrics.

The cards can be dismissed by the user and they’ll be able to access them anytime from our install page

Verification Steps

Visit the homepage or the installation page to see the onboarding cards.

Details

More Detail

On the left navigation, we've introduced a new button that allows you to go directly to a list of all your Transform metrics with the ability to search and filter them down.

Verification Steps

Click on the "Metrics" link in the left navigation.

Annotation Form updates

Details

More Detail

We restyled the form used to create an annotation with the goal of improving ease of use. It is now a separate modal with all of the same inputs.

Verification Steps

Create a new annotation!

· 2 min read

✨ New✨

MetricFlow

Details

Product Component

Metrics Framework

More Detail

We're proud to announce that MetricFlow (Transform’s metric creation framework) is now open source and available to all!

Starting today, you can download MetricFlow (pip install metricflow) and explore or contribute to the project on GitHub. We’re also starting the MetricFlow Slack community for collaborations, contributors, and general discussion on metric layers.

Learn more about MetricFlow here!

New Integration Page

Details

Product Component

Metrics Catalog

More Detail

Our new Integration page in the settings panel allows you to view and learn about all integrations. Administrators can also use this page to set these integrations up.

Verification Steps

Go to Settings → Integrations in the Transform Catalog

Tableau Integrations

Details

Product Component

Integrations

More Detail

Send your metrics from Transform to Tableau with this first-class integration. You can now visualize, analyze, and share/publish data sources and dashboards with the confidence that your data is accurate and coming from the source of truth. We have two integration paths:

  1. Send your Transform materialized metrics to Tableau as a destination in your materialization config.

  2. Make ad-hoc selections from your Transform metrics and dimensions via the Tableau Web Data Connector.

Verification Steps

Read the documentation here!

· 3 min read

✨ New✨

Transform Connector for Google Sheets

Details

Product Component

Integrations

More Detail

Transform now has a Google Sheets integration, which allows you to make requests out of Transform directly in your Google Sheet. The integration comes both with a custom menu and custom function that allows you to make requests for metrics and dimensions just like you can through our UI or other APIs for easy data set building and sharing.

Verification Steps

Find the Transform Connector for Sheets in the Add on Menu

Install and Authenticate with a Transform API key

Start querying your metrics!

Notifications Panel

Details

Product Component

Metrics Catalog

More Detail

The notifications pane gives you the ability to see all metrics you are subscribed to and make adjustments to what types of Content Notifications you'll receive for those metrics. You have the ability to toggle on and toggle off whether you want Notifications to arrive in Transform or via email.

Verification Steps

To access this new page, click the settings icon on the bottom, left-hand side of any page. Then, under "User Settings" click "Notifications".

Alternatively, you can simply click this link: https://app.transformdata.io/settings/notifications

Okta SCIM functions

Details

Product Component

Security

More Detail

Transform already supports Okta SSO, and we’ve built upon the integration to also add functionality around various SCIM features (System for Cross-domain Identity Management)

We added support for the following actions to make your identity management even easier in Transform:

  • Push New Users: New users created through Okta will also be created in the third-party application.
  • Push Profile Updates: Updates made to the user's profile through Okta will be pushed to the third-party application.
  • Push User Deactivation: Deactivating the user or disabling the user's access to the application through Okta will deactivate the user in the third-party application.
    • Note: For this application, deactivating a user means removing access to login, but maintaining the user's Transform information as an inactive user.
  • Reactivate Users: User accounts can be reactivated in the application.
  • Import Users: Users can be imported from Transform into Okta.

Verification Steps

Enable provisioning using these steps

Details

Product Component

Documentation

More Detail

Our documentation site now has a search. Find it in the top right-hand corner of our documentation site to search all the Transform content you’ve been looking for.

Verification Steps

Access docs.transform.co and find the search bar in the top right-hand corner

· 3 min read

✨ New ✨

Homepage

Details

Product Component

Metrics Catalog

More Detail

Transform has now released our next iteration of the Homepage. This new Homepage has been refocused around Annotations and Subscriptions, providing more rich context about what is happening in a company's data ecosystem, tailored to each individual person at a company. The Homepage is now more of an insights hub, capturing important details about "the why" and helping contextualize what is causing metric values to move.

This new Homepage features Annotations in the left pane. When you click the "see more details" within an Annotation, the card will open to show all metrics affected by the Annotation and how the affected metric values moved during the relevant time range.

The new Homepage also has a set of Subscriptions widgets on the right-hand side of the page that show metric values and their percentage change from the last period.

At the bottom, there is a "Metrics You May Care About" section, containing a set of widgets that enable data consumers to subscribe to new metrics directly inline.

We will continue building out more features into this Homepage and expanding the functionality in the coming weeks, to help bring rich context about what is happening in our customers' data ecosystems.

Verification Steps

Login to Transform and confirm the updates to the homepage.

🐛 Bug Fixes 🐛

Respect Order With Time Comparison

Details

Product Component

CLI

More Detail

We have fixed a bug where the order was not being respected when a time comparison was applied.

Verification Steps

Run a query on the CLI like the following:

mql query —metrics metric_name —dimensions ds__day —time-comparison dod —order -ds__day

Time Comparison Gaps Fix

Details

Product Component

Metrics Framework

More Detail

Snowflake allows for session-level overrides for the start of the week, which means one user might be seeing weekly granularity metrics (or results from other week-based functions) returning with a week start of Monday while another sees a different week start (e.g. Wednesday).

This change brings Snowflake in line with our other engines and ensures consistency across user sessions within an organization by pinning all Snowflake sessions to have WEEK_START set to the ISO standard of Monday. We have pegged the setting to ‘1’ with no available override mechanism, although if such a feature is needed (e.g. customers who wish WEEK_START to be Sunday), we can expose an organization-level configuration setting for it.

For more information on the implications of this change, please refer to the Snowflake documentation on the WEEK_START parameter, how it affects calendar weeks, weekdays and the associated list of affected functions, and examples of how different WEEK_START values might affect output.

Please note that the only customers affected are:

  1. Customers running Snowflake warehouse instances with account or session-level overrides for the WEEK_START parameter that fix it to a value other than 0 or 1. These customers will now see MONDAY as the week start in all cases.
  2. Customers who are using the DAYOFWEEK function inside the expr parameter with the legacy Snowflake default WEEK_START = 0. For these customers, DAYOFWEEK will now return the ISO-standard values of 1 (Monday) through 7 (Sunday) instead of Snowflake’s legacy default values of 0 (Monday) through 6 (Sunday).

Verification Steps

Use a weekly time granularity in the CLI or Metrics Catalog and confirm it uses the ISO standard date.

· 3 min read

✨ New ✨

Subscriptions and Notifications

Details

Product Component

Metrics Catalog

More Detail

We’re excited to release Notifications and Subscriptions for Transform customers!

Subscriptions allow users to subscribe to metrics that they care about, so they can get updates and context about those metrics.

The notification types launching today include updates when new annotations are authored, new questions are asked, users are subscribed to metrics, and notifications for metric owners when their colleagues become subscribers to their metrics.

In the near future, we will be launching new notification types for tracking when metric values go up/down and we’ll also launch fine-grained controls to help users decide how they receive notifications: in Transform, over email, or via Slack.

Verification Steps

You’ll find the “Subscribe” button on all metric pages, and the new notification pane can be accessed by clicking the bell icon on the upper right of any Transform page.

🐛 Bug Fixes 🐛

Download CSV button not closing after selections made

Details

Product Component

Metrics Catalog

More Detail

When downloading a CSV with limited groupings on the chart, a modal appears that allows you to choose if you want all groupings or only the ones on the chart (limit 25). After making this selection, the modal n't close by default, and so now made sure it does.

Verification Steps

Download a CSV with a grouping that's been limited (more than 25 dimension values). Notice that the modal disappears after selection.

Time Comparison Gaps Fix

Details

Product Component

Metrics Catalog

More Detail

We have fixed an issue with time comparison where time periods with no data were being padded with the latest non-null data (the default setting for the pandas pct_change method - documentation here). When time comparison is added to a query now, no fill method will be applied, and therefore nulls will be respected.

Verification Steps

Navigate to a non-cumulative metric page that has gaps in data. Apply day over day time comparison (or the smallest available time comparison period) via chart filters. For any periods where there was no data, you should see either an infinite value (if the next period had data) or a null value (if the next date had no data).

Trim Current Dates from Chart by Default

Details

Product Component

Metrics Catalog

More Detail

We are now trimming the current date from chart queries by default, since the current date is not complete. The current date is determined in UTC, but we are also working on a feature to override this timezone at the organization & data source levels.

Verification Steps

Visit a metric page. The latest date shown on the chart should be no later than yesterday (in UTC).

· 4 min read

✨ New ✨

Okta Single Sign-On

Details

Product Component

Security

More Detail

Transform now supports single sign-on with Okta. This integration supports both IDP and SP initiated login.

Okta administrators can add Transform as an application from Okta’s integration network and add users that should have access to Transform. Once enabled in Okta, you can follow the instructions provided to enable this using both Okta and Transform. In Transform, we’ve added a new Settings Tab called Security, which you will use to configure Okta.

Verification Steps

If your organization uses Okta, find Transform in Okta’s integration network. See our documentation for step-by-step instructions.

Better Model and Data Warehouse Validation

Details

Product Component

Metrics Framework

More Detail

We’ve introduced both improved model and data warehouse validation that will make developing and committing configs easier by catching the errors ahead of the model being committed and surfacing useful errors.

Some examples of improved validation included but are not limited to the following:

  • Ensuring referenced tables exist in your fields and data warehouse
  • Checking that SQL expressions are valid
  • Making sure Inputs meet the expected constraints (e.g., name uniqueness, having a primary time dimension, ensuring you’ve completed all fields)
  • Handling empty documents and Nonetypes.

Verification Steps

  • Upgrade your MQL CLI via pip install --upgrade transform
  • Run mql validate-configs with your model to see new validations. If there are no issues found, you will not observe many changes to the validation process.

Note that we are consistently adding more data warehouse-based validations, if you run into issues please reach out to us. Additionally, if you experience validation failures due to timeouts you can add --skip-dw to the validate-configs or commit-config commands.

New Organization Setup Flow

Details

Product Component

Metrics Catalog

More Detail

While mostly for new organizations using Transform, we wanted to call out that we’ve introduced a new organization creation flow in Transform. This feature allows you to fill out a form with information which when submitted will create your Transform organization, spin up your MQL server, and guide you to help connect Github with Transform. Previously, this work was manual.

For existing users of Transform with an active organization, you might notice the Installation page differs a bit and now shows each step in the setup flow.

Verification Steps

You should only follow this guide if you are creating a new Transform instance: visit https://app.transformdata.io/create_organization.

For existing users curious about the new setup flow, visit the new install page to see what this looks like.

Copy Last Day Value Menu Action

Details

Product Component

Metrics Catalog

More Detail

The same menu that contains the export CSV now has an option called "Copy Last Day's Values". This simply copies out the latest day of data. If there is a grouping applied, it will copy out each respective dimension and value in list form with the latest date. If there is no grouping applied, it will copy out a single day of data with the date. The copy is meant to allow for easy pasting into a tool like Google Sheets or Excel.

Verification Steps

Open up any chart menu and confirm you see this option.

🐛 Bug Fixes 🐛

Dimension Value Menu Selection Fix

Details

Product Component

Metrics Catalog

More Detail

We fixed a bug where dimensions with a large number of values could sometimes cause the page to be unresponsive (in the chart filter menu).

Verification Steps

Find a metric that has a dimension associated that contains a large number of cardinal values. Determine when you filter and choose from those dimensions in the filter that everything works properly.

Granularity Fill 0 Bug

Details

Product Component

Metrics Catalog

More Detail

For measure proxy metrics using SUM, SUM_BOOLEAN, and COUNT_DISTINCT aggregations, nulls should be replaced with 0 when a granularity is applied. We’ve fixed a bug where charts were not filling 0 for these metrics.

Verification Steps

Navigate to a metric page for a measure proxy metric using using SUM, SUM_BOOLEAN, or COUNT_DISTINCT aggregation. Use the chart filters to apply a granularity. When the chart reloads, you should see a continuous line with no gaps in data.

· 3 min read

✨ New ✨

Metric Onboarding Flow

Details

Product Component

Metric Ownership and Management

More Detail

  • Adding new types of rich metadata for metrics (display value formatting, increase is good/bad, and business owners).
  • Ability to lock metadata down in configs or leave editable in Transform UI.
  • New metric modal experience in the Transform UI.

What’s changing?

There is a problem today where some metadata fields like description and owner fields can be edited both in the config as well as in the UI, and this creates potential mismatch between what appears in the config and the UI. Because we cannot sync things back to config files, and because some organizations will actually want to lock down metadata under version control, we needed a solution that could ensure no collisions.

To accomplish this aim, we are improving metric config files so that they have a clearly delineated locked-metadata section, which is optional to fill in through the config. If any specific locked-metadata field is authored in the config, then that field becomes locked in the UI and is no longer editable in the UI — but all other fields remain editable in the UI. The config will be the “source of truth” for any metadata fields.

  • We are also making entirely new types of metric metadata fields to help customers create more rich context and understanding metrics they build. New fields include: Business Owner, Display Number Type Format, Metric Increase Good or Bad. In the future, we’ll continue adding more metadata fields so that the context around metrics becomes richer.
  • The metric owner field in the config will continue being called “Owner” and in the UI we will refer to the metric config owner as the “Technical Owner”. This change will help us with adding a new “Business Owner” field that differentiates folks who may have built the technical ETL pipeline to create the metric, from the business people or business analysts who understand the context about why a metric value may have changed. Technical owner is not editable in the UI (since it is set in the config as we described above).
  • We will do away with the separation of config authored description and UI authored description, just having one description in the future that can be set as locked-metadata in the config or authored in the UI. We have a preference for companies authoring descriptions in the UI because we have found that the metric descriptions authored in config files are generally of poor quality and do not take advantage of our markdown editing abilities.

Our intention, and what we believe is the best user experience, is that people choose to edit almost all their metadata in the UI and only choose to lock down metadata in config files when needed for specific business reasons.

· One min read

Happy New Year to you all! We took a brief break to enjoy the holidays with our families, but we're back at it now at the start of 2022 developing features and fixing bugs.

You can expect to see release notes about every two weeks from our team. Onwards and upwards, Transformers!