Starting to Transfer Data from Postgres Database
Let's create a integration (Data Connector)
In Integration Page, you need to select data source type that will be used for transfering data.
In this case you choose Postgres Database.
.
Provide Credentials, the username and password will be stored into internal database
Once the integration done, you can start to create features of tool.
Start to create a job to transfer data from Postgres Database to other Postgres Database
In Transfer Data Page, you can create a job with existing data source integrated from first part.
Parameters to trasfer data:
- sourceType: Using Postgres Database
- targetType: Using Postgres Database
- sourceSchema: Postgres Database Schema (public)
- targetSchema: Postgres Database Schema (your own schema)
- tableName: exact table name
- chunkSize: split data in chunks when loading data to avoid database corrupted
- loadType: in order to capture the right data, keep data consistency with
Full LoadandIncremental Loadto load data. WithIncremental Loadwill has to provide the delta column to identify the delta data. - scheduledDate: combine with
isScheduledto automatic load data by daily, weekly, monthly. - isTruncated: has to be chosen with
loadTypeto avoid duplicated data in target table.
With the following parameters above, we setup the transfer and schedule data transfer.
.
That's it !!! You have setup the connection and transferred your data.