Subset Processing and Partitioning in Magic ETL

Subset Processing and Partitioning is the process of extracting a portion or subset of your data from the data source, dividing data into smaller and more manageable units. We are happy to announce that Subset Processing and Partitioning is now available in Domo within Magic ETL.

Magic ETL now supports processing subsets of your data by loading and running your data incrementally, rather than having to perform full dataset replacement operations at each execution. This new data processing capability creates transactionally aware data pipelines that provide greater data integrity and reduce the load on processing to make your DataFlows more resilient and flexible.

Other benefits include:

• Faster insights and improved decision-making capabilities from precise and efficient data processing
• Efficient cost management with a usage-based billing model
• Faster and more integrated processing tool
• Consolidated customer data stacks within Domo
• Creation of more robust and efficient data pipelines with a more fault tolerant end-to-end pipeline, reducing the amount of data reprocessing that might otherwise occur.
• Less maintenance of recursive dataflows