How Automated SQL Lineage works

SQL Lineage module has as a core feature the automatic extraction of data lineage from SQL statement, speeding up documentation and mapping processes. As data lineage is the process of comprehension, storage and viewing of the entire data life cycle. Data lineage has among its purposes to:

• View the interactions and correlations that data has with each other.
• Detect potential errors in data processing.
• Implement changes to data transformation processes with less risk.

Many of the useful information for the reconstruction of the data lineage are inside the SQL statements used for:

• Creating views
• Statement contained in stored procedure (es. PL/SQL).
• Statement of insert, update, merge or create table
• Statement of select used to extract data and populate tables on other systems.

The manual analysis of these statements requires a a watchful and expert eye and it is an extremely expensive and, in particular, not scalable process.

To overcome this problem SQL Lineage module offers a statement analysis functionality, which allows users to rapidly view the changes that occur inside themselves and to automatically generate data flows between the tables involved.

In addition to simplifying the statement analysis process, SQL lineage module facilitates the creation of flows between connected tables but not directly involved by statements.

Examples of SQL Lineage Analysis

In this paragraph are presented some sql statements examples which participate in the lineage definition.

Create View Statement

Insert Statement

Update Statement

Merge Statement

Select Statement

Select Into Statement

Create Table Statement

Definitions