Added the functionality within a JavaScript function to mark rows that need to be excluded or disregarded during the pipeline run. By invoking modifier.removeRow() within the JS function, our system will disregard the specified row. This capability proves beneficial when comparing data with external sources in a JavaScript function, and there is a need to exclude data that already exists.
Added the option to create email input and output connectors. With the email input connector, you can build event-based data pipelines that execute whenever an email with a valid attachment is received at the designated email address. On the other hand, the email output connector allows you to receive the output of a pipeline directly to your desired email address.
Added three sample output connectors to match the three existing sample input connectors and TDMs to set up a demo pipeline as quickly as possible.
Added advanced configuration options to the (S)FTP and AWS S3 input connector. You can now define a target directory, add inclusion and exclusion tags and determine if the input file should stay the same, be renamed or be deleted after being successfully read.