versipellis

Versipellis - The Data Flow Shape Shifter

Versipellis (versi) is a versatile, scalable tool for transferring and transforming data reliably across services, networks, protocols and formats, without altering the data itself.

It is an easy-to-use adapter and conduit around data pipelines, sources, and sinks. It can move and restructure data of any shape or size, with adjustable security in transit and at rest - while maintaining strong safeguards against corruption and loss, or latency and crashes under heavy load.

In other words: “We should take all this data and push it somewhere else!”

The primary design principles of this project are: ease of use, efficiency at scale, security, low footprint, and maintainability.

Getting Started

1. Choose any of the installation options below
2. Quickstart demos & tutorials
3. Configuration reference

Installation Option 1: Docker Image

https://github.com/daabr/versipellis/pkgs/container/versipellis

Command line example:

docker run -d --name my-versi-container \
       -v $HOME/versi/config:/app/config -v $HOME/versi/data:/app/data \
       ghcr.io/daabr/versipellis:latest

• Platforms: Linux (amd64/arm64)
• Volumes / mount points:
  • /app/config - app and database configuration files, TLS certificates
  • /app/data - dead-letter queue (data that was received but not sent)
• Already bundled and tested with:
  • Oracle Instant Client
  • unixODBC

Installation Option 2: Precompiled Executable Binary

https://github.com/daabr/versipellis/releases/latest

• Platforms:
  • Linux (amd64/arm64)
  • macOS (amd64/arm64)
  • Windows (amd64 only)
• Optional runtime dependencies:
  • Oracle Instant Client (basic lite) - needed only for Oracle Database
  • unixODBC - needed only for ODBC, and only on Linux and macOS

Installation Option 3: Build From Source

Required Go version: 1.27

Command line:

CGO_ENABLED=0 go build ./cmd/versi && ./versi -h

Or:

CGO_ENABLED=1 go build -tags=odbc ./cmd/versi && ./versi -h

• CGO_ENABLED=1 - optional, needed only for Oracle Database and unixODBC
• -tags=odbc - optional, needed only for unixODBC

Supported Inputs

HTTP Input

• Protocols: HTTP/1.1 and HTTP/2 (TCP), HTTP/3 (QUIC/UDP)
• Directions: pull (retrieve from servers), push (receive from clients)
• Encryption: none, TLS, mTLS
• Content encoding: identity (none), gzip
• Auth: coming soon!

SQL Input

Supported SQL-based databases:

• CockroachDB
• MariaDB
• Microsoft SQL Server
• MySQL
• ODBC
• Oracle Database
• PostgreSQL
• SAP HANA
• Snowflake
• SQLite

Supported Outputs

Zero Config

• Stdout
• Local filesystem (dead-letter queue)

HTTP Output

• Directions: push (send to servers)
• Same feature set as HTTP input above

This site is open source. Improve this page.