What is a System?

A System is the representation of a physical repository responsible for storing or processing the data of interest. It serves as an external entity of different types, from which metadata is imported to facilitate data governance based on user needs. The extraction of metadata is customizable based on the type of System and user requirements. To access the Systems section, click on the “Data Catalog” option as shown in the figure.

The page displays all defined Systems with their respective names and descriptions. It is also possible to operate directly on the System through the buttons that make up the object.

How to create a System

To access the modal for defining a new System, click on the “+” icon at the bottom right, as shown in the figure. The button opens the definition modal.

The modal allows you to define:

• Name: the name of the System (the only mandatory field).
• System Technology: the technology of the System.
• Subtype: indicates the type of System being defined. Possible choices are:
  • APPLICATION: if the data comes from an application.
  • SERVICE: if the data comes from a service.
  • DATABASE: if the data comes from a database.
  • ARCHIVE: if the data comes from an archive.
  • QUEUE: if the data comes from a queue.
  • JOB: if the data is extracted from an external method.
• Description: description (optional) of the System.
• Additional Properties: (optional) System properties.

Once the properties are specified, you can create the System by clicking the “Submit” button or cancel the operation by clicking the “Cancel” button.

Available actions on the System detail page

Once the System is created, it is possible to access the detail page through the “Detail” button available in each object of the list, as shown in the figure. Clicking on it will take you to the detail page of the System.

The page is divided into two sections:

1. The first, static, displays the name of the System, its subtype, description, and buttons to operate on the element.
2. The second, dynamic, changes based on the selected tab between: “Home”, “Dataflows”, “Crawling”, “Classification”, “Properties”.

To modify a System, click on the “Modify” button, which opens the modification modal. The “Delete” button deletes the System, and all associated Physical Entities and Physical Fields. The “Logins” button allows seeing which users have access rights to the System, specifying the table and type of user-table relationship (e.g., EDITOR). The “Entities” and “Routines” buttons allow you to view the Physical Entities of the System and its System routines, respectively.

The System is a historicized entity, and every modification made to it can be viewed through the “History” button.

Each System has five different tabs, each showing different information:

• Home: This tab shows the statistics of the System, particularly the number of:

  • Logins
  • Physical Entities
  • Physical Fields
  • Data Actors
  • Concepts
  • Attributes

  It is also possible to export the Physical Entities belonging to the System and their respective Physical Fields in .csv format. The statistics also count the data subjects involved, and their keys can be downloaded.

  On the right, you’ll find the “Responsibilities” card, which enables you to assign specific roles and responsibilities to users for managing the System. To learn more about stewardship roles and responsibility assignment, refer to the Stewardship user guide.

• Dataflows: From here, it is possible to visualize all the data flow belonging to the System.

• Crawling: This section is used to manage the crawling settings, through which metadata will be extracted from physical Systems and loaded onto the System.

• Classification: Rules for data classification can be set up to build rules and dictionaries.

• Properties: View custom user-defined properties for the System.

Physical Entities

Physical Entities are entities within a System. Access to the Physical Entities section can be done in two ways:

1. By clicking the “Entities” button on the System detail page, displaying the list of Physical Entities associated with the System.
2. By clicking the “Physical Entities” button in the top-right navbar, displaying all available Physical Entities.

Physical Entities Registry

The “Physical Entities” section contains a list of Physical Entities.

The table displays:

• System: the System to which the Physical Entity belongs.
• Schema: the schema from which it originates.
• Name: the name of the Physical Entity.
• Type: the type of Physical Entity (e.g., BASE_TABLE).
• Description: the description of the Physical Entity.
• Data Set: a descriptive tag for grouping similar Physical Entities.
• Issues: The count of possible open issues on the Physical Entity.
• Actions: the actions that can be performed on the Physical Entity.

The navbar allows for filtering by name using the search bar and exporting Physical Entities in .csv format.

By clicking the icon on the top-right as shown in the figure, it is also possible to filter by System, schema, type, data set, Physical Fields count, concepts, attributes, creation and modification date, and hidden tables.

It is also possible to perform actions on each row element by clicking on the three dots icon.

The three actions allow you to:

• Navigate to the Physical Entity detail page.
• Modify the Physical Entity.
• Delete the Physical Entity.

Definition of a Physical Entity

To create a Physical Entity, click the button on the “Physical Entities” page, which opens the creation modal.

It is possible to define:

• Name: required field that defines the name of the Physical Entity.
• Description: description of the Physical Entity.
• System: mandatory field indicating the System of reference.
• Schema: the System scheme.
• Type: the type of Physical Entity.
• Data Set: additional tag to allow the collection of Physical Entities in homogeneous groups.
• Date created and last modified in the source System: time fields that define the date of creation and last modification of the Physical Entity in the source System.
• Hidden: indicates if the Physical Entity is hidden. A hidden Physical Entity is not shown on lists and not counted in dashboards.
• Additional Properties: possible additional properties.

Details of a Physical Entity

Clicking on a Physical Entity row or the “Detail” button on the registry page brings up the Physical Entity detail page.

As for the System, the page is divided into a static part where general information is shown:

• Name.
• System.
• The type of Physical Entity.
• The description of the entity.

The button “History” shows the history of changes made to the Physical Entity.

The page is completed by a dynamic part, which changes behavior based on the selected tab:

• Home: Includes the list of Physical Fields and the list of Constraints of the Physical Entity. On the right is the responsibilities card with the users responsible for the Physical Entity, divided by role (further information is available in the Stewardship user guide), the related concepts to the entity, which can be automatically mapped through defined rules as explained in the Data Classification user guide, and the comment section where users can write comments and post them for the benefit of others.
• Documentation: This tab allows to view and write a documentation for the Physical Entity.
• Lineage: data flows, statements and assignments involving the Physical Entity (further information is available in the Data lineage user guide).
• Quality: Quality Checks and Quality Assessment associated with the Physical Entity (further information is available in the Data Quality user guide).
• Profiling: allows the definition of profiling monitors for the Physical Entity.
• Properties: View custom user-defined properties for the Physical Entity.

Physical Fields

A Physical Field is an attribute of a Physical Entity. Unlike Physical Entities, it is not possible to visualize all the records of Physical Fields, but it is possible to access only those that are related to the selected Physical Entity. To view the record of Physical Fields of a Physical Entity, make sure you are on the “Home” tab.

The registry shows:

• Name: the name of the Physical Field.
• Description: the description.
• Type: The type of Physical Field, for example Timestamp or Numeric.
• Attributes: The attributes connected to the Physical Field (if present).
• Issue: issues connected to Physical Field (if present)

Definition of a Physical Field

To define a Physical Field within a Physical Entity, you must click on the “+” icon in the top right corner of the table, as shown in the figure. By clicking the button, the Physical Field definition modal opens.

Here it is possible to define:

• Name: a mandatory field that defines the name of the Physical Field.
• Description: a possible brief description.
• Type: the type of Physical Field.
• Ordinal Position: the position within the Physical Entity, accepting only numeric values.
• Attributes: it is possible to define the connection with Attributes directly from the definition modal by clicking on the “+ add” button.
• Created/Updated on System at: temporal fields that define the creation and modification date of the Physical Field within the source System.
• Additional Properties: Optional user-definable properties.

Detail of a Physical Field

By clicking on the “Detail” button in the actions or directly on the table row, you can access the detail page of the Physical Field.

As for Systems and Physical Entities, in this case, there is a static part that includes:

• Name
• System
• Entity
• Description

The section concludes with the “Edit” buttons to open the modal for modifying the Physical Field, “Delete” for deletion, and “History” to see the history of modifications.

The dynamic part is divided into tabs, similarly to Systems and Physical Entities, which in this case are:

• Home: Physical constraints, related attributes and comments.
• Documentation: documentation for the Physical Field.
• Lineage: data flows, statements and assignments involving the Physical Field (further information is available in the Data lineage user guide).
• Quality: Quality Checks associated with the Physical Field (further information is available in the Data Quality user guide).
• Profiling: allows the definition of profiling monitors for the Physical Field.
• Properties: View custom user-defined properties for the Physical Field.