Magic ETL on Databricks subset processing

Subset processing support gives users more flexibility in Databricks outputs. This update expands output tile options in Magic ETL beyond Replace to include Partition, Append, and Upsert.

Instead of replacing everything, you can pick what works best:

• Updating a sales table daily? Append just one day’s data.

• Managing historical snapshots? Use Upsert or Partitioning for smarter, more efficient updates.
 

This added flexibility empowers users to select the output method that best fits their specific use cases, optimizing both efficiency and cost. This feature can be found in Magic ETL output tiles when using a Databricks compute integration.