Databricks Integration Enhancements

Discover the full potential of your cloud data warehouse with Domo’s powerful cloud integration capabilities. Now, you can query, load, and process data directly within Databricks—no need to move or duplicate your data. We’ve made extensive updates across our cloud integration features, and our big highlights for this release are that Cloud Data Location Configuration and Cloud Integration Sharing, which went GA for Snowflake at Domopalooza 2025, are now fully available on Databricks. Let’s start by diving into Cloud Data Location Configuration and Cloud Integration Sharing.

Cloud Data Location Configuration

Data management is now easier for those using Databricks. With Domo’s Cloud Data Location Configuration feature, you can move data sets across databases and schemas, rename tables, and seamlessly align your data structure with your business needs.

Cloud Integration Sharing

Addressing the challenges of limited integration access, Cloud Integration Sharing enables admins to share integrations while configuring permissions with greater control. With improved governance, multiple users can now manage integrations collaboratively, controlling access to accounts and their data more effectively. This feature can be accessed through the accounts view under Data. You can learn how to share cloud integrations in the Knowledge Base.  

In addition to Cloud Data Location Configuration and Cloud Integration Sharing, Domo’s Databricks integration now has a streamlined write setup process, OAuth support, Magic ETL Pushdown, Append, Upsert, and Partition capabilities, Magic ETL pass-through SQL tile, and a new user interface for both configurations and connecting and disconnecting tables.

Databricks Streamlined Write Setup Process

Setting up a Databricks integration for Domo writeback is simpler than ever, involving a shorter form with fewer queries to execute in Databricks. Under the hood, this now uses temporary STS credentials. Existing Databricks writeback integrations require no change.

Databricks OAuth Support

Achieve secure data access with OAuth Support. Users authenticate to Databricks, so data visibility aligns with their permissions, reusing governance rules effortlessly without duplication in Domo.

Magic ETL on Databricks

- Magic ETL Pushdown on Databricks

Empower LOB users with Magic ETL on Databricks. Perform secure drag-and-drop data transformations directly on your engine without data movement or governance risks, freeing up data engineers while maintaining control and structure.

- Databricks – Append, Upsert, and Partition

Enjoy greater flexibility with Databricks outputs in Magic ETL. Expand beyond Replace to use Partition, Append, or Upsert for tailored updates. Append daily sales data or manage historical snapshots more efficiently with smarter update methods. Explore these options in Magic ETL Output tiles with a Databricks compute integration, along with Data Selection options in the Input tile.

- New Tile Options in Magic ETL

Magic ETL is more powerful than ever with our latest tile updates, designed to give you greater flexibility and control over your data transformations. Here’s what’s new:

• Split Join: Seamlessly manage multiple output streams from a single Join. Now, you can easily identify rows that joined and those that didn’t.  

• Split Filter: Filter smarter. Capture rows that meet your criteria while simultaneously viewing those that don’t in separate streams.  

You can learn how to use split join and split filter Magic ETL tiles in the Knowledge Base.  

• Rank & Window: Simplify ranking and window operations. Add new columns with ranking, framed, or offset functions directly into your dataset.  

• Pivot: Transform key-value pairs into multiple columns, de-normalizing your data and making it more digestible and actionable.  

• Unpivot: Normalize your data by transforming columns into rows, giving your tables added structure and simplifying analysis.  

• Writeback: Output the transformed data as a DataSet and easily send it to another system, enabling efficient data integration and improved workflow automation.  

• Bonus: Enhanced Append Rows: Handle unions of disparate data sets with greater flexibility with the updated Append Rows tile.

- Databricks Pass-Through SQL Tile

Advanced data transformation just got more flexible with the addition of Pass-Through SQL in Magic ETL’s SQL tile. This new feature is designed to meet the needs of advanced Databricks users who prefer using native SQL or already have SQL scripts tailored for their unique use cases.

With Pass-Through SQL, you can now apply Databricks-native SQL syntax directly within Magic ETL to transform your data without needing to refactor your existing SQL code. Whether you face constraints in your Databricks environment or want to maximize efficiency, this feature offers a seamless way to integrate and execute your custom transformations.

The Pass-Through SQL option will be available within the SQL tile in Magic ETL, located on the left-hand rail in the Magic ETL authoring canvas. This update is being made available immediately as part of Magic ETL on Databricks.  

We’re excited to offer this added flexibility for Databricks users and look forward to seeing how it will enhance your workflows.

Configure Databricks Integrations New UI

Another cloud integration enhancement for Databricks brings a fully redesigned user experience, making setup simpler than ever. The new, intuitive configuration interface streamlines the entire process, providing clear, step-by-step guidance. Enhanced documentation management ensures all resources are organized and easily accessible, eliminating previous usability challenges.

If you prefer the old UI, no stress—you can toggle between the new design and legacy experience and choose how you work best.

Databricks Connect Tables UI

We understand how frustrating it can be to work with an interface that is unclear, hard to use, and difficult to access. That’s why we have totally revamped the user interface for connecting and disconnecting tables via cloud integrations for Databricks to help streamline data management and eliminate confusion.  

The updated UI provides clear mapping visibility, so you can instantly see which tables are mapped to data sets and which are not. With a cleaner layout, improved navigation, and a more user-friendly design, finding the information you need and performing essential operations is faster and easier than ever. This means less time hunting for data and more time focusing on what matters most.

Miss the old UI? You can easily toggle between the new design and legacy experience.

At Domo, we remain dedicated to enhancing cloud integration for users of all skill levels. With our latest updates, we're paving the way for effortless setup, smarter integrations, and powerful data workflows—laying the foundation for future innovations.

‍