Hybrid and Multi-Cloud Data Integration in Qlik™

Qlik™ Cloud Data Integration updates available starting November 7, 2023!

Qlik™ Cloud Data Integration enables users to build automated data pipelines with an intuitive visual interface to ingest, transform, and deliver analytics-ready data. Several major capabilities have been added in the November 7th, 2023 release to strengthen Qlik™ Cloud for enterprise hybrid and multi-cloud data integration.

Data Lineage and Impact Analysis
With data lineage at the field and dataset levels, data and analytic users can enhance their understanding of the data’s origins and how it has transformed throughout the data pipeline. With this latest release, Qlik™ Cloud Catalog automatically captures dataset and field lineage within the context of a Qlik™ Cloud Data Integration pipeline, bringing more transparency and enhancing trust in data-driven outcomes for data and analytic users.

Additionally, impact analysis on the data pipeline artifacts facilitates proactive exploration of “what-if” scenarios, allowing for a comprehensive assessment of how changes in the source system may impact downstream data pipelines and transformations. This proactive approach aids in the prevention of potential issues before they occur.

Expanded Replication and Cloud Targets
Qlik™ Cloud Data Integration will gain expanded replication abilities for use cases like data sharing, synchronization, and incremental ETL. Microsoft SQL Server and Amazon S3 will be supported as targets for replicated data. To enable connectivity with private networks, Qlik™ Cloud Data Integration can be configured with Qlik™‘s data movement gateway’s private link capabilities when accessing data on the Microsoft Azure cloud platform.

Broader Native Data Type Support
Qlik™ Cloud Data Integration will also remove limitations on replicating complex data types like timestamps, geospatial data, and binaries from source systems. This builds on Qlik™ Cloud Data Integration’s native support for data types commonly found in modern data platforms. Users will be able to replicate a broader set of data “as-is” without needing to convert or approximate data types within pipelines.

Databricks Unity Catalog Integration
Additionally in November, Qlik™ Cloud Data Integration will integrate with Databricks Unity Catalog for centralized metadata management. Qlik™ users will be able to discover, understand, and gain insights into data objects and lineage created by Qlik™ Cloud pipelines for data in the Databricks Lakehouse Platform. This paves the way for expanded governance and collaboration on analytics projects as users implement Databricks as their data lakehouse.

With Qlik™ Cloud Data Integration’s roadmap centered on broader replication, incremental loading, and multi-cloud support, Qlik™ continues to be an enterprise leader in hybrid and multi-cloud data integration. By adding sophisticated data lineage, governance, and enhanced delivery functionality, Qlik™ Cloud Data Integration will allow users to confidently scale their analytics programs across complex cloud environments.

These updates in Qlik™ Cloud Data Integration are available starting November 7, 2023.

For information about Qlik™, please visit this site: qlik.com.
For specific and specialized solutions from QQinfo, please visit this page: QQsolutions.
In order to be in touch with the latest news in the field, unique solutions explained, but also with our personal perspectives regarding the world of management, data and analytics, we recommend the QQblog !