Dremio launches hybrid data catalog for Apache Iceberg

Dremio has launched a Hybrid Data Catalog for Apache Iceberg, designed to offer businesses flexibility and governance in data management across multiple environments.

The new offering from Dremio supports on-premises, cloud, and hybrid deployments, positioning Dremio as a unique provider in the lakehouse sector that offers full architectural flexibility. This development comes amidst a growing demand for hybrid solutions that ensure seamless data governance without vendor lock-in.

The integrations with Snowflake's Apache Polaris (in incubation) and Databricks' Unity Catalog managed service are also noteworthy. These integrations enable customers to select the most suitable catalog while using Dremio to provide comprehensive analytics across all data platforms. This flexibility allows users to reduce infrastructure costs and maintain robust governance and security measures, optimising data management performance.

Kevin Petrie, Vice President of Research at BARC, commented on the enterprise benefits, "Enterprises face extraordinary pressure to access, prepare, and govern distributed datasets for consumption by analytics and AI applications. To meet this demand, they need to catalog diverse data and metadata across data centres, regions, and clouds. Dremio is taking a logical step to enable this with an open catalog based on Apache Iceberg, the emerging standard for flexible table formats, and by integrating with an ecosystem of popular platforms."

Dremio's Data Catalog is built on the open-source Project Nessie and introduces several key features. These include interoperability through the Iceberg REST catalog API, centralised data governance with role-based access control, automated table optimisation, and Git-like data branching and versioning.

Tomer Shiran, Founder of Dremio, highlighted the importance of flexibility in modern data architecture, stating, "Flexibility is essential for modern organisations looking to maximise the value of their data. With expanded Iceberg catalog support across all environments, Dremio empowers businesses to deploy their lakehouse architecture wherever it's most effective. We're 100% committed to giving customers the freedom to choose the best tools and infrastructure while reducing fears of vendor lock-in."

Dremio's launch of the Hybrid Data Catalog for Apache Iceberg marks a significant advancement in data management solutions, particularly for organisations seeking flexibility across diverse environments. By integrating with platforms like Snowflake and Databricks, the catalog enhances data governance while reducing infrastructure costs. Its features, such as role-based access control and automated table optimisation, streamline data operations.