Introducing Lightup’s Integration with Collibra
We’re excited to announce that Lightup now integrates with Collibra’s Data Governance and Catalog platform. For this industry-first integration with Collibra, we partnered with leading Systems Integrator XponentL Data to surface Lightup Data Quality Indicators (DQI) inside Collibra’s Data Governance Center.
Lightup advances Collibra’s mission to democratize Data Discovery for data citizens by enhancing the platform with no-code Data Quality Checks — bridging the skills gap between technical data teams and non-technical business users that need to define, update, and deploy Data Quality Checks for Collibra data assets.
How Lightup and Collibra Work Better Together
Collibra automates Data Governance and Data Catalog processes, policies, and activities, providing cross-functional teams with a centralized platform to find and create a shared understanding of business-contextual data. While a Data Governance and Catalog platform can help you find the data you want, you won’t know if you trust the data without Data Quality Monitoring.
Conversely, a Data Quality Monitoring platform can analyze your data for attributes and health metrics, but without a Data Governance and Data Catalog solution, there’s no easy way to find and understand the context of the data in the first place.
For example, when business decision-makers receive BI reports with revenue metrics that look questionable, they typically go to their Data Governance platform to verify the accuracy of the data, first. If they can confirm the reliability of the data directly within the Governance platform by checking the Data Quality health status along with the lineage information, they can confidently trust the data. However, if Data Quality health insights aren’t surfaced in their Data Governance platform, they would have to rely on data engineering teams to investigate the quality of the data for them.
If the ultimate goal is to deliver trusted data for stakeholders, data consumers, and customers across and outside the organization, Data Governance and Catalog solutions without Data Quality is futile.
Why? Without reliable, high quality data, it’s impossible to develop and maintain trust in data assets. And without data trust, data consumers won’t use Data Governance and Catalog tools. With poor user adoption, Data Governance initiatives won’t succeed.
That’s where Lightup Data Quality Monitoring comes in, integrating Deep Data Quality Checks with Collibra for trusted data assets and stronger user adoption.
How Lightup and Collibra Work Better Together
Collibra users can deploy Data Quality Checks from Lightup and apply them to any data asset — such as a column or a table — inside Collibra’s Data Quality Dashboard. This empowers organizations to democratize Data Quality Checks for a variety of stakeholders and Collibra data consumers, distributing Data Quality workloads among data stewards, engineers, and non-technical business users.
5 Key Features Lightup Brings to Collibra
With the Lightup and Collibra integration, organizations can leverage a modern Data Governance and Catalog solution, with certified data assets — monitored by Lightup’s Deep Data Quality Checks. Here are five key features Lightup brings to Collibra to increase data trust and drive user adoption.
1.) No-Code Data Quality Checks
Lightup’s no-code Data Quality Checks bridge the skills gap between technical data teams and non-technical business users that need to define, update, and create queries. This allows business users to check the quality of their Collibra data assets without relying on data engineering resources as the sole authors of Data Quality metrics.
2.) Pushdown Queries
Lightup pushes queries down to data sources for in-place processing, instead of moving or copying data to run full table scans, making them highly efficient and cost-effective.
3.) AI-powered Monitoring and Anomaly Detection
Aggregate metrics are pulled from data sources for AI-powered Anomaly Detection and rule testing in Lightup. Data health insights are surfaced in Collibra.
4.) Incident Alerts
Lightup monitors data for quality issues and alerts users of any incidents through their preferred communication channel, including email, Slack, Microsoft Teams, PagerDuty, Flock, and Webhooks.
5.) Incident Remediation Workflows
When Lightup detects an anomaly, an incident alert is triggered in Collibra, where you can click the hyperlinked incident to:
- Drill into the incident time frame in Lightup
- See correlated issues
- Create Jira or ServiceNow tickets for further investigation
Key Benefits for Our Joint Customers
Democratize Data Quality Checks
Empower data citizens to write their own no-code Data Quality Checks, reducing reliance on engineering resources as sole authors of Data Quality metrics for Collibra data assets.
Achieve 100% Data Quality Coverage
Accelerate and scale Data Quality Checks for 100% endorsed data assets in Collibra.
Improve User Adoption
Increase trust in Collibra data assets for stronger user adoption.
Solution Highlights
Detailed Quality Score
- Publish Lightup Data Quality scores in the “Quality” tab of Collibra asset pages (table, column, or any other data asset).
- Explore details of metrics defined in Lightup, surfaced in Collibra’s “Quality” tab of data assets.
- See how many rows conform to the conditions defined by metrics, along with their quality scores.
Enriched Insights in Collibra
See table and column details of metrics and monitors defined in Lightup in Collibra’s “Details” tab, including:
- Monitor names linked to Lightup monitors for more details.
- Underlying metrics for monitors, with references to column asset names, where applicable.
- Incident count showing the number of incidents per monitor, linked to the Lightup incidents for further investigation.
- Health indicators showing red for ongoing incidents or green for no incidents on assets.
Why Lightup for Collibra?
The integration of Lightup with Collibra significantly advances Data Quality awareness, facilitating cross-functional collaboration and self-service access to trusted data within organizations.
Lightup’s no-code environment democratizes Data Quality Checks, empowering everyone from technical data engineers to non-technical data stewards, analysts, and business users to quickly and easily create Data Quality Checks for Collibra data assets.
This not only accelerates the entire process of writing Data Quality Checks — reducing it from months to minutes — but also transforms the Collibra Data Governance and Catalog into a business-critical tool. Ultimately, the Lightup integration with Collibra increases data trust and results in stronger user adoption, enabling organizations to build and sustain a successful data-driven culture — without overburdening data engineers or relying solely on developer support.
Questions? We’re here to help. Email us at info@lightup.ai or book a free demo today.
