NetFind Table Import Node

Basic Information

Description	This node is use import tabular data to elasticsearch index
Input	One table
Output	Without
Usage Tags	DESTINATION , ELASTICSEARCH

Node Settings

Input Table (string, required) : name of a table from process context which will be uploaded into elasticsearch.
Elastic Index Name ( string, required, injectable) : name of an elasaticsearch index where table will be stored.
ID Column ( string, optional) : name of an ID column from above table. It will be set as a key field in elasticsearch index.
RecreateIndex ( bool, required) : If set to true the index will first be dropped and then created. Otherwise only rows will be uploaded.
AutoCreateView ( bool, required) : If set to true the index will be automatically addet to NetFind views.
BatchSize ( int, required) : Size of the batch that will be uploaded into elasticsearch. If request is to large try to reduce this number.

A supplied table will be uploaded to elasticsearch index in a multiple “import” steps. Each step will consist of BatchSize number of rows. This ensures that the memory consumption is not to large but can take a bit longer.

Tips and Advanced usage

NetFind Table import node uses REST Api call to NetFind import endpoint using service account token. It can therefore be used in an on demand process or in automatically scheduled process.

Examples

Simple import

This examples imports table named csv_parsed into index csv_import. It does not uses id column and it does not recreate an index.

Example configuration

JSON

{
  "IndexName": "csv_import",
  "TableName": "csv_parsed",
  "ID": null,
  "RecreateIndex": false,
  "AutoCreateView": true,
  "BatchSize": "5000"
}

Advanced import

This examples uploads table csv_parsed into an injectable index (@indexName metadata must be set in process context). It uses CarID as ID filed (CarID must be a column in csv_parsed table) and it does not recreate an index.

Example configuration

JSON

{
    "IndexName": "@indexName",
    "TableName": "csv_parsed",
    "ID": "CarID",
    "RecreateIndex": false,
    "AutoCreateView": true,
    "BatchSize": "5000"
}