Magic ETL Enhancements

Magic ETL is Domo’s secret weapon for building data pipelines with ease. This release, we’re excited to announce quality-of-life improvements that make managing your data and DataFlows easier than ever!

Updated "Remove Duplicates" Tile

Users often need to identify and quickly remove duplicates present in a DataSet to maintain clean and accurate data. Previously, the Remove Duplicates tile required users to add columns one at a time to capture fully duplicate rows. Now, you can easily add or remove ALL columns with the click of a button.

Upsert

Updating data within Domo DataSets is a common task for users, but the previous process required inefficiently reprocessing all the data through a DataFlow and using comparison logic to rewrite the most updated rows. With the new Upsert option in the Output tile, users can easily update rows in their output DataSets without needing to reprocess the full DataSet or perform complex logic.

Increased Canvas SizeLimited canvas size can hinder the creation of powerful, comprehensive DataFlows. Forcing users to crowd tiles onto their canvas makes it difficult for them to organize, manage, and perform all the necessary operations on their data—potentially requiring the division of their data into multiple DataFlows. So, we quadrupled the size of the canvas! You can use all the space to build and manage complex DataFlows without limitations.

Mini Map

Navigating large and complex DataFlows with many tiles can be difficult and confusing. The new Mini Map for Magic ETL provides a full visual overview of your DataFlow, allowing you to scroll around your DataFlow and quickly see the layout of your tiles at a glance.