ProductDocsArchitectureBlogGitHubGitHubGet Started
Available

Installation

Build features, Cargo feature presets, and Python setup.

Rust Feature Presets

Cargo features select compiled capabilities. They are additive — do not use them as mutually exclusive mode switches.

FeaturePurpose
minimalSmallest facade; no optional deployment capabilities.
localDefault developer build: embedded + single-node.
embeddedIn-process API use; no optional dependencies.
single-nodeLocal daemon/in-process cluster with Flight SQL, shuffle, RocksDB metadata.
distributedRemote cluster support with Flight SQL, shuffle, etcd metadata.
k8sDistributed + Kubernetes operator/CRD.
fullDistributed/k8s, Kafka, primary Iceberg. Excludes AI/vector and secondary lakehouse formats.

Optional Integration Features

FeaturePurpose
flight-sqlArrow Flight SQL transport/server.
shuffleShuffle service/store.
etcdetcd-backed scheduler metadata.
kafkaKafka connector.
icebergPrimary lakehouse platform.
deltaOptional experimental Delta compatibility.
uiOperator UI integration.

Build Commands

just check                  # verify all four modes compile
just build-single-node      # debug binary for local dev
just build-bare-metal       # release binary for VMs
just build-k8s              # release binary + operator for Kubernetes

# GCC 15 workaround for RocksDB
CXXFLAGS="-include cstdint" just build-single-node

Python Features

FeaturePurpose
kafkaKafka sources/connectors.
icebergIceberg lakehouse bindings.
vector-sinksOptional vector sink compatibility.
qdrantExperimental Qdrant vector sink.
pgvectorExperimental pgvector sink.
maturin develop --manifest-path crates/krishiv-python/Cargo.toml
maturin develop --manifest-path crates/krishiv-python/Cargo.toml --features iceberg
maturin develop --manifest-path crates/krishiv-python/Cargo.toml --features kafka