Skip to main content

First Steps with the nuvo pipeline

Our pipeline helps you automate and monitor the data onboarding and ingestion process with ease. You can manage and create pipelines in three different ways:

  • by using our embeddables inside your own application
  • by using our API
  • in the nuvo user platform (coming soon)

Pipeline structure​

A nuvo pipeline has three main components:

  • Input connector: Defines the source your data is coming from. You can set up different kinds of connectors like HTTP(S), (S)FTP, E-Mail, Azure Blob Storage or AWS S3
  • Target data model: Defines the data structure you expect for your target system. This structure is used to map and transform the input data during each pipeline run
  • Output connector: Defines the target to which the transformed input data will go. You can setup different kinds of connectors like HTTP(S), (S)FTP, E-Mail, Azure Blob Storage or AWS S3

Setting up a nuvo pipeline​

Setting up a nuvo pipeline has four different steps:

  1. Setup: Selecting the input and output connectors, the target data model and giving your pipeline a name
  2. Header Selection: Identifying and confirming the column header row
  3. Data Transformation: Confirm the column mappings and add your own transformation formulas to adjust the input data to match your expected output structure
  4. Config: Set the schedule for when and how often the pipeline should run as well as define when a pipeline should fail

Using our embeddable components​

Use our customisable components to implement setting up nuvo pipelines within your own application. This allows you to split the work of creating connectors or target data models and setting up pipelines.

Get more information here.

Monitor and fix pipelines​

We’ve built the nuvo pipeline with as many use cases in mind as possible.

It doesn’t matter if:

  • you manage and fix all pipelines yourself
  • you want to let your customers create and fix pipelines on their own
  • or if different teams are responsible for managing different parts of the pipelines

Using our API​

Our API gives you full flexibility for automating, managing, and running pipelines. If you prefer, you can use your own UI and use our API headless.

Follow our guide to help you get started.