CreatePipeline Embeddable Guide
The CreatePipeline
embeddable allows you to create nuvo pipelines within your application, whether for internal teams to set them up or to enable your customers to create pipelines within your product. Like all nuvo pipeline components, the CreatePipeline
embeddable can be easily integrated into your existing application.
This guide will help you implement the CreatePipeline
component and configure it based on your specific requirements:
- Install the nuvo package
- Get your nuvo license key
- Get the access token
- Implement the embeddable component in your application
- Configure the component based on your specific use case
Let's get started
Step 1: Install the nuvo package
Installing the nuvo package is super easy.
Install the React package with NPM:
Install it with Yarn:
Step 2: Get your nuvo license key
You can get your nuvo license key from our customer support team. They will be happy to assist you. Contact us at [email protected].
If you don’t have an account yet, you can sign up here.
Please note that pipelines in development mode only send the first 100 rows to your defined output destination. If you would like to increase your quota, please contact us at [email protected].
Step 3: Get the access token
In order to authorise yourself or rather the component you have to first get the access token via our authentication API.
You can get access tokens for two different cases:
- You want your internal users to create pipelines
- You want your customers to create pipelines
You want your internal users to create pipelines
- To get the access token for an internal user, you need to first create an user in the nuvo dashboard or use the user API
- Use the user’s email address and your license key to request the access token. Here is the cURL or JavaScript request you can use to get the access token:
You want your customers to create pipelines
- To get the access token for your customer, you need to first create a sub-organization (sub-org) via the sub-organization API
- Use the sub-orgs’s identifier and your license key to retrieve the access token. Here is the cURL or JavaScript request you can use to retrieve the access token:
Step 4: Implement the embeddable component in your application
With the package installed, you can add the CreatePipeline
component to your application.
First, import the component in the file where you want to use the CreatePipeline
component:
Step 5: Configure the component based on your specific use case
Add the code snippet below and place the component on the page where you want it to appear:
accessToken
Add here the access token you’ve got in Step 3
templateId
Add here the ID of the template you want to use when a pipeline is created
configuration
The configuration determines if certain settings or components, such as connectors, target data model, schedule config etc., are already set for the pipeline, meaning that users going through the flow won’t have to set them themselves
developerMode
Set developer mode to true
to test pipelines in your testing environment. Pipeline executions in developer mode are free of charge. Set it to false
for production use. Please note that pipelines executed in developer mode will only output 100 rows
name
The name of the pipeline
tdmId
The ID of the target data model that should be used for the created pipeline. If this is set, the user won’t be able to select another target data model
inputConnectorId
The ID of the input connector that should be used for the created pipeline. If this is set, the user won’t be able to select another input connector
outputConnectorId
The ID of the output connector that should be used for the created pipeline. If this is set, the user won’t be able to select another output connector
errorConfig
Defines how the pipeline should handle errors that might occur during pipeline execution
errorThreshold
A number between 0 and 100, representing the allowed percentage of erroneous cells during a pipeline execution. For example, if it is set to 10, it means that pipeline executions with less than 10% erroneous cells will be considered successful and will not fail
scheduleConfig
Defines when the pipeline is executed for the first and last time, as well as the interval at which it is executed
frequency
Sets how often the pipeline is executed. It is intertwined with interval
. For example, if frequency
is set to HOURLY
and interval
is set to 2, the pipeline is executed every 2 hours:
- HOURLY
- DAILY
- WEEKLY
- MONTHLY
interval
Sets the interval based on the frequency at which the pipeline is executed. For example, if interval
is set to 2 and frequency
is set to HOURLY
, the pipeline is executed every 2 hours. The next execution cannot be scheduled further into the future than 1 year from the set start date and time
startsOn
The date and time when the pipeline is first executed, provided as a timestamp in UTC (e.g. 2024-09-02T13:26:13.642Z). The date and time cannot be in the past
endsOn
The date and time when the pipeline is last executed, provided as a timestamp in UTC (e.g. 2024-09-02T13:26:13.642Z). This date and time cannot be earlier than the start date and time
settings
i18nOverrides
Allows you to override each text element in the interface
language
Defines the language of the flow. So far we only support English ("en"
).
modal
Defines whether the component is shown inline (false
) or within a modal view (true
)
allowTdmCreation
Defines whether the "Create target data model" button is shown in the TDM selection dropdown
allowInputConnectorCreation
Defines whether the "Create connector" button is shown in the input connector selection dropdown
allowOutputConnectorCreation
Defines whether the "Create connector" button is shown in the output connector selection dropdown
onPipelineCreate
This callback runs after the user has confirmed the final step of the flow to create a pipeline
onClose
This callback runs when the user attempts to exit the "Create Pipeline" flow by clicking "Cancel" or closing the modal using the "x" button
onConnectorCreate
Runs when the user clicks on "Create connector" when selecting an input or output connector
onTdmCreate
Runs when the user clicks on "Create target data model" when selecting a target data model