Data Integration

Ingestion Configuration

The Ingestion Configuration screen allows you to edit the headers used in the ingestion CSV files for Entities. It also allows you to sort data in Entities with complex attributes, e.g. InLine attribute.

Ingestion Configuration Screen

The Ingestion Configuration screen comprises of a grid with a list of Entities which are eligible for data ingestion:

  • Name- name of the Entity; the name is a link that allows you to go to the details screen for the given Entity
  • Namespace- namespace in which the Entity is located
  • Total Attributes- the number of attributes defined in the Entity
  • Type- information whether the Entity is a Protected Entity, i.e. a system created Entity, or a Defined Entity, i.e. a user created Entity
  • Temporality Type- information what kind of data are contained in this Entity, Reference or Transaction
  • Sort- information if automatic sorting was enabled for this Entity
  • Last Updated- information when the Entity definition was last updated

Details Screen

When you click on a name of an Entity in the grid, you will be redirected to the Details screen for that Entity. The Details screen comprises:

  • Entity details
  • CSV Data ordering
  • Rules, which comprise a grid with the following:
    • Attribute reference - name of the attribute defined in the Data Structure
    • Children - for complex attributes, such as InLine and List, the nested attributes
    • Defined column name - the new name of the attribute that will be used in the CSV header and which Fynpase will map with the attribute reference, i.e. the name of the attribute in the Data Structure
    • Data type - data type of the attribute

Actions

On the Details screen there is the Edit button which allows you to enter the editing mode for the given Entity.

In the CSV Data ordering section there is a radio button that allows you to choose whether you want Fynapse to sort the data in the CSV files ingested to the given Entity.

This feature allows you to sort data based on a selected attribute. It is useful for Entities with hierarchical structure, such as Journals or custom Transaction Entities, where you have nested complex attributes.

For example each Journal which is ingested into Journals Entity comprises of multiple Journal Lines which should be sorted by, e.g. Journal ID to ensure they are all ingested into the correct Journal. In this case you would choose the option to have Fynapse automatically sort the data by Journal ID attribute.

Please note that this will affect the performance, so please think carefully if your Entity, especially if this is an Entity with a flat structure, requires this option to be enabled.

In the Rules section there are the Expand all and Collapse all buttons that will either expand or collapse complex attributes.

The Reset button clears the mappings.

This section also has a filter that allows you to filter by attribute reference or column name.

Tutorials

  1. Go to Integration > Ingestion Configuration.
  2. Select the Entity you want to work on and click on the link to open the Details screen.
  3. On the Details screen, click the Edit button.
  4. In the CSV Data ordering section use the radio button to choose whether you want Fynapse to sort the ingested data.
    1. If you select My CSV file is already sorted correctly and does not need sorting Fynapse will ingest data from the CSV file as is
    2. If you select Automatically sort my CSV by the ‘Order by’ column before processing (this takes longer), an additional Order by column will appear in the grid in the Rules section below. In the column, select which attribute you want to use for sorting.
  5. In the grid in the Rules section, the current names of Entity attributes are listed in the Attribute reference column. For any attribute you want to change the name that will be used in the CSV header, type the new name in the Defined column namecolumn.
  6. Once you made all your changes, click the Save button to save your changes or the Cancel button to discard them.