Microsoft Fabric connector

Fabric to Blindata catalog

How Microsoft Fabric workspaces, items, tables and columns appear in the Blindata catalog

This page explains where each Fabric object lands in the Blindata catalog, so you know what to look for after a run.

How Fabric objects map to Blindata

The rule of thumb:

  • An item that stores data (a lakehouse, a warehouse, a database) becomes a system of its own.
  • What it contains (tables, views, files) becomes physical entities, and their columns become physical fields.
  • An item that processes or presents data (a pipeline, a notebook, a report) becomes a physical entity inside a shared product system, such as Microsoft Fabric Data Factory.
  • Data moving between them becomes data flows. See Data lineage .

The workspace has no object of its own: its name prefixes the system names and groups the item entities inside product systems.

Systems

One system per data store

Fabric item Blindata system Technology
Lakehouse <workspace> / <lakehouse> Microsoft Fabric Lakehouse
Warehouse, warehouse snapshot <workspace> / <warehouse> Microsoft Fabric Warehouse
Mirrored database, mirrored warehouse <workspace> / <item> Microsoft Fabric Mirrored Database
Mirrored catalog <workspace> / <item> Microsoft Fabric Mirrored Catalog
Mirrored Snowflake database <workspace> / <item> Microsoft Fabric Snowflake Database
SQL database <workspace> / <database> Microsoft Fabric SQL Database
Cosmos DB database <workspace> / <database> Microsoft Fabric Cosmos DB
KQL database <workspace> / <database> Microsoft Fabric KQL Database
Datamart <workspace> / <datamart> Microsoft Fabric Datamart

You can change the name pattern, lowercase it, or pin an item to a system that already exists in Blindata with systemNaming .

One system per product

Product system (default name) Contains
Microsoft Fabric Data Engineering Notebooks, Spark job definitions
Microsoft Fabric Data Factory Pipelines, Copy jobs, Dataflows Gen2 and their queries, Airflow and dbt jobs
Microsoft Fabric Real-Time Intelligence Eventstreams, eventhouses
Microsoft Fabric Graph Graph models
Power BI Datasets Semantic models with their tables, columns and measures, Gen1 dataflows
Power BI Reports Reports, dashboards and tiles, org apps

Product systems are created only when the run publishes at least one of their items. You can rename them or point them to existing systems under products .

Physical entities

Fabric object System Schema Name Type
Lakehouse, warehouse or database table The item’s system Table schema (dbo when the lakehouse has no schemas) Table name TABLE
View The item’s system View schema View name VIEW
Lakehouse folder or file The lakehouse system Files Path under Files/, such as raw/2024/orders.csv FOLDER, FILE
Shortcut The lakehouse system As the table or folder it exposes As the table or folder it exposes SHORTCUT
KQL table, materialized view The KQL database system none (KQL has no schemas) Table or view name TABLE, MATERIALIZED_VIEW
Pipeline, Copy job, Dataflow Gen2 Data Factory Workspace name Item name DATA_PIPELINE, COPY_JOB, DATAFLOW_GEN2
Dataflow Gen2 query Data Factory <workspace>.<dataflow> Query name DATAFLOW_QUERY
Notebook, Spark job definition Data Engineering Workspace name Item name NOTEBOOK, SPARK_JOB_DEFINITION
Eventstream, eventhouse Real-Time Intelligence Workspace name Item name EVENTSTREAM, EVENTHOUSE
Graph model Graph Workspace name Item name GRAPH_MODEL
Semantic model Power BI Datasets Workspace name Model name DATASET
Semantic model table Power BI Datasets <workspace>.<model> Table name DATASET_TABLE
Dataflow Gen1, and its entities Power BI Datasets Workspace name, or <workspace>.<dataflow> for entities Dataflow or entity name DATAFLOW, DATAFLOW_ENTITY
Report, dashboard Power BI Reports Workspace name Item name REPORT, DASHBOARD
Org app Power BI Reports Workspace name App <app id> ORG_APP
Dashboard tile Power BI Reports <workspace>.<dashboard> Tile title TILE
Item listed as inventory only Its product system Workspace name Item name The Fabric item type

Physical fields

Fabric object Blindata field Type
Table or view column Column name, position and comment The T-SQL type from the SQL endpoint, such as decimal(10,2); otherwise the Spark type, such as double
KQL column Column name KQL type
Semantic model column Column name, with format, category and sort-by column Column data type
Measure Measure name, with its DAX expression as description MEASURE
Report page, visual Page or visual name REPORT_SECTION, or the visual kind

Stored procedures and functions of lakehouses, warehouses and SQL databases are published as system routines with their definition, so Blindata’s SQL lineage can analyze them. View definitions are published as query statements in a query bucket named <system> (Fabric SQL).

Properties

Each entity carries additional properties that tie it back to Fabric. The most useful ones:

Property Meaning
fabricWorkspaceName, fabricWorkspaceId Workspace the item belongs to
fabricItemId, fabricItemType The Fabric item, and its type such as Lakehouse or Notebook
fabricPortalUrl Link to open the item in the Fabric or Power BI portal
oneLakePath Path of a table or file in OneLake
shortcutTarget Where a shortcut points to
sqlEndpointHost SQL endpoint of the item
fabricMetadataGap Why some metadata is missing, for example COLUMNS_UNAVAILABLE, VIEW_DEFINITION_UNAVAILABLE, FILES_LISTING_TRUNCATED or ACCESS_DENIED:WORKSPACE_ROLE

Notebooks also list their attached lakehouses, language and environment and, with code analysis on, their kernel, parameters and analysis status.

The connector sets no tags and creates no tasks or logical entities.

Example

A workspace Sales Medallion with three lakehouses (Bronze, Silver, Gold) and a notebook produces four systems. Silver holds shortcuts to the Bronze data, so its entities point back to Bronze instead of copying it.

Example of the Blindata catalog for the Sales Medallion workspace

Re-runs and changes

You can run the job again as often as you like. Each run updates what is already in Blindata instead of adding a second copy.

What changes in Fabric What happens in Blindata
A workspace or item is renamed The existing system is renamed. Systems are matched to their Fabric item by ID, so no new system appears.
A table, column or other object changes The entity or field is updated in place, with no duplicates. Data flows are updated in the same way.
An object is deleted It stays in Blindata. It is removed only by the optional cleanup, which deletes content of a published system that has not been updated for a number of days. See cleanupOptions .
The application cannot read an item The item is still published, with a fabricMetadataGap property that says why its content is missing, such as ACCESS_DENIED:WORKSPACE_ROLE.

A system’s description and technology are written only when the system is created. Edit them in Blindata afterwards and later runs keep your changes.

Note

Cleanup runs only after a complete, unfiltered run, so a partial run never removes content by mistake. The conditions are listed under cleanupOptions .