Connectors

HTTP/HTTPS

Description	An HTTP or HTTPS endpoint is a specific URL on a web server where a client can access a particular service or resource.
Supported Event	Time based & Event based.
Parameter	HTTP Input Connector: The HTTP input connector allows your data pipeline to receive data from an HTTP source, such as a web server or a REST API. This connector can accept HTTP requests with various HTTP methods such as GET and POST. To use the HTTP input connector, you will need to specify the URL endpoint from which data will be received. You can also configure any required authentication or authorization mechanisms, such as API keys, or basic authentication, to ensure that only authorized users can access the data.
	HTTPS Input Connector: The HTTPS input connector provides the same functionality as the HTTP input connector, but it also provides secure and encrypted communication between the data pipeline and the HTTP source. This is achieved using SSL/TLS encryption to protect the data being transmitted. To use the HTTPS input connector, you will need to specify the URL endpoint from which data will be received, as well as any required authentication or authorization mechanisms. You will also need to specify the SSL/TLS configuration, such as the certificate and private key, to establish the secure connection.
	HTTP Output Connector: The HTTP output connector allows your data pipeline to send data to an HTTP destination, such as a web server or a REST API. This connector can send HTTP requests with HTTP method such as POST. To use the HTTP output connector, you will need to specify the URL endpoint to which data will be sent. You can also configure any required authentication or authorization mechanisms, such as API keys, or basic authentication, to ensure that only authorized users can access the data.
	HTTPS Output Connector: The HTTPS output connector provides the same functionality as the HTTP output connector, but it also provides secure and encrypted communication between the data pipeline and the HTTP destination. This is achieved using SSL/TLS encryption to protect the data being transmitted. To use the HTTPS output connector, you will need to specify the URL endpoint to which data will be sent, as well as any required authentication or authorization mechanisms. You will also need to specify the SSL/TLS configuration, such as the certificate and private key, to establish the secure connection.

FTP/FTPS

Description	FTP (File Transfer Protocol) and SFTP (Secure File Transfer Protocol) are both used to transfer files over a network.
Supported Event	Time based.
Parameter	FTP Input Connector: The FTP input connector allows your data pipeline to receive data from an FTP source, such as an FTP server. To use the FTP input connector, you will need to specify the FTP server and port from which data will be received. You can also configure any required authentication or authorization mechanisms, such as username and password, to ensure that only authorized users can access the data.
	SFTP Input Connector: The SFTP input connector provides the same functionality as the FTP input connector, but it also provides secure and encrypted communication between the data pipeline and the FTP server. This is achieved using SSL/TLS encryption to protect the data being transmitted. To use the SFTP input connector, you will need to specify the FTP server and port from which data will be received, as well as any required authentication or authorization mechanisms. You will also need to specify the SSL/TLS configuration, such as the private key, to establish the secure connection.
	FTP Output Connector: The FTP output connector allows your data pipeline to send data to an FTP destination, such as an FTP server. To use the FTP output connector, you will need to specify the FTP server and port to which data will be sent. You can also configure any required authentication or authorization mechanisms, such as username and password, to ensure that only authorized users can access the data.
	SFTP Output Connector: The SFTP output connector provides the same functionality as the FTP output connector, but it also provides secure and encrypted communication between the data pipeline and the FTP destination. This is achieved using SSL/TLS encryption to protect the data being transmitted. To use the FTPS output connector, you will need to specify the FTP server and port to which data will be sent, as well as any required authentication or authorization mechanisms. You will also need to specify the SSL/TLS configuration, such as the private key, to establish the secure connection.

AWS S3

Description	Amazon S3 (Simple Storage Service) is a cloud-based object storage service provided by Amazon Web Services (AWS).
Supported Event	Time based.
Parameter	AWS S3 Input Connector: The AWS S3 output connector allows your data pipeline to read data to an Amazon S3 bucket. To use the AWS S3 input connector, you will need to specify the S3 bucket name, object key and, AWS region from which data will be read. You will also need to configure the AWS credentials, such as an access key and secret key, to authenticate and authorize the connector to access the S3 bucket.
	AWS S3 Output Connector: The AWS S3 input connector allows your data pipeline to write data from an Amazon S3 bucket. To use the AWS S3 input connector, you will need to specify the S3 bucket name, object key and, AWS region to which data will be written. You will also need to configure the AWS credentials, such as an access key and secret key, to authenticate and authorize the connector to access the S3 bucket.

Custom Connector

Description	The custom output connector allows users to write their own JavaScript code for output operations.
Supported Event	Time based.
Parameter	Custom Output Connector: The custom output connector allows users to write their own JavaScript code to perform custom data transformation and output operations. This connector provides the flexibility to write custom code to handle specific use cases, such as sending data in chunks, sending data to multiple APIs, or nesting data. To use the custom output connector, you will need to write JavaScript code that implements the desired functionality for your specific use case. This code will have access to the data that is being processed by the pipeline and can transform it in any way required. It is important to ensure that the custom code is designed and tested to handle any potential errors or issues that may arise during execution, as this code is responsible for handling the data output process.