Skip to Content
DocumentationPipelineOverview

Pipeline Overview

Pipelines let you chain multiple JSON transformations together visually. Instead of manually applying one utility at a time, you build a flow of connected steps that process your data in sequence.

What is a pipeline?

A pipeline consists of:

  • Input nodes — your source JSON data
  • Step nodes — utilities that transform the data (e.g., Clean JSON, Find & Replace, Flatten)
  • Connections — wires that define how data flows from one step to the next

Data flows left-to-right through the pipeline. Each step receives JSON from its connected input, applies a transformation, and passes the result to the next step.

Visual canvas

The pipeline builder uses a visual canvas powered by React Flow. You can:

  • Drag nodes to arrange them on the canvas
  • Connect nodes by dragging from an output handle to an input handle
  • Zoom and pan to navigate large pipelines
  • Select nodes by clicking them to configure their settings

Execution model

When you click Run, the pipeline engine:

  1. Builds a dependency graph from the connections between nodes
  2. Sorts topologically to determine the correct execution order
  3. Executes each step in order, passing outputs as inputs to downstream steps
  4. Stores the result of the final step as the pipeline output

Steps that don’t depend on each other could theoretically run in parallel, but the current engine executes them sequentially in topological order.

Demo vs. saved pipelines

  • Demo pipeline (/demo/pipeline) — works without sign-in, saved to localStorage
  • Saved pipelines (/dashboard/pipeline/[id]) — requires sign-in, saved to the cloud with full version history

Next steps

Last updated on
Building GuideAuthentication