Skip to content

Connector specific instructions

PostgreSQL

PostgreSQL credentials

The required fields for creating new PostgreSQL credentials are provided below along with a description of each field.

Field name Description
Name Custom credentials name.
Username PostgreSQL database username.
Password PostgreSQL database password.
Hostname PostgreSQL hostname.
Port PostgreSQL port.

PostgreSQL connectors

The required fields for creating new PostgreSQL connectors are provided below along with a description of each field.

Field name Description
Name Custom credentials name.
Username PostgreSQL database username.
Password PostgreSQL database password.
Hostname PostgreSQL hostname.
Port PostgreSQL port.

Given that the PostgreSQL connector is a structured-type connector, it requires the input fields it deals with to be specified upfront. For each input field, the name of the field and the data type need to be specified.

MySQL

MySQL credentials

The required fields for creating new MySQL credentials are provided below along with a description of each field.

Field name Description
Name Custom credentials name.
Username MySQL database username.
Password MySQL database password.
Hostname MySQL hostname.
Port MySQL port.

MySQL connectors

The required fields for creating new MySQL connectors are provided below along with a description of each field.

Field name Description
Database MySQL database name.
Table MySQL table name in which we want to insert the data in.

Given that the MySQL connector is a structured-type connector, it requires the input fields it deals with to be specified upfront. For each input field, the name of the field and the data type of it need to be specified.

BigQuery

BigQuery credentials

The required fields for creating new BigQuery credentials are provided below along with a description of each field.

Field name Description
Name Custom credentials name.
JSON key file Google Application Credentials file content. The exact content of the file should be copied into this field textarea.

BigQuery connectors

The required fields for creating new BigQuery connectors are provided below along with a description of each field.

Field name Description
Table Name of the BigQuery table.
Dataset Name of the BigQuery dataset.

Given that the BigQuery connector is a structured-type connector, it requires the input fields it deals with to be specified upfront. For each input field, the name of the field and the data type of it need to be specified.

Google Cloud Storage

GCS credentials

The required fields for creating new GCS credentials are provided below along with a description of each field.

Field name Description
Name Custom credentials name.
JSON key file Google Application Credentials file content. The exact content of the file should be copied into this field textarea.

GCS connectors

The required fields for creating new GCS connectors are provided below along with a description of each field.

Field name Description
Bucket name The name of the GCS bucket to insert the blobs in.
Path prefix Path prefix inside the GCS bucket in which to insert the blobs in (may be left empty)

Given that the GCS connector is a blob-type connector, it does not require any fields to be specified upfront.

Azure Storage

Azure credentials

The required field for creating new Azure credentials is provided below.

Field name Description
Connection string Azure connection string.

Azure connectors

The required fields for creating new Azure connectors are provided below along with a description of each field.

Field name Description
Container name The name of the Azure container to insert the blobs in.
Path prefix Path prefix inside the Azure container in which to insert the blobs (may be left empty).

Given that the Azure connector is a blob-type connector, it does not require any fields to be specified upfront.

S3 storage

S3 credentials

The required fields for creating new S3 credentials are provided below along with a description of each field.

Field name Description
Name Custom credentials name.
AWS access key User's AWS access key.
AWS secret key User's AWS secret key.
AWS region The region where S3 storage resides.

S3 connectors

The required fields for creating new S3 connectors are provided below along with a description of each field.

Field name Description
Bucket name The name of the S3 bucket to insert the blobs in.
Path prefix Path prefix inside the S3 bucket in which to insert the blobs (may be left empty).

Given that the S3 connector is a blob-type connector, it does not require any fields to be specified upfront.

Kinesis

Kinesis credentials

The required fields for creating new Kinesis credentials are provided below along with a description of each field.

Field name Description
Name Custom credentials name.
AWS access key id User's AWS access key id.
AWS secret access key User's AWS secret access key.
Region name Region name where the stream resides.

Kinesis connectors

The required fields for creating new Kinesis connectors are provided below along with a description of each field.

Field name Description
Stream name AWS Kinesis stream name to insert data in.
Partition key type This field can have 2 values: "random" or "field". In the cases where "field" is specified, the "partition_key_field" will be used as a partition key. When it is "random", a random partition key field will be generated.
Partition key field In the cases where "field" is specified in the "partition_key_field", the "partition_key_field" will be used as a partition key. Otherwise, it is omitted, and should be an empty string.
Region name Region name where the stream resides.