DuckDB

Supported Data warehouses & lakehouses

Catalog DuckDB database files, including attached Parquet, CSV and Iceberg sources.

Capabilities

CapabilitySupportNotes
Tables, views & columns Supported Read from information_schema or duckdb_tables() / duckdb_columns().
Keys, constraints & indexes Supported
Procedures & functions Not available
Data lineage Partial
Lineage from query history Not available
Business glossary links Supported
Data quality probes Supported
Data profiling Supported
Data classification Supported
Chat with your data Supported

Connection settings

Create the connection on the Blindata Agent from Settings > Agents > Connections with the connection wizard, choosing DuckDB in the technology step.

Driver classorg.duckdb.DuckDBDriver
JDBC URLjdbc:duckdb:database.db
Authentication
Service principal (shared technical user)
User principal (personal credentials, BYOC)
Ephemeral credentials (asked at each run)
Crawling strategySQL

The Blindata Agent does not include this driver: download the vendor JDBC driver and copy the .jar into the agent drivers folder, as described in Add JDBC drivers. Driver properties can be added under Advanced settings in the connection wizard.

Prerequisites & permissions

  • A Blindata Agent installed with network access to DuckDB.
  • The vendor JDBC driver installed on the agent (see Add JDBC drivers).
  • Read access to the database file from the agent host.

Set up metadata crawling

  1. Create the connection to DuckDB on the agent (see Connection settings) and use Test to verify it.
  2. Create or open the system that represents DuckDB in the catalog and link it to the connection.
  3. In the CRAWLING tab add a crawling job with strategy SQL.
  4. Run a TEST to check the number of extracted objects, then RUN or schedule the job.

The job options and the column aliases of every extraction query are described in the Generic JDBC reference.