All Tools
K
DataFreeOpen Source
KESTRA
Event-driven orchestration for data, AI, and infrastructure workflows
Apache 2.0
ABOUT
Managing complex multi-step workflows across data pipelines, AI/ML training, and infrastructure provisioning typically requires stitching together multiple tools (schedulers, event triggers, state machines) with inconsistent configuration and no unified observability. Kestra provides a single declarative YAML platform for authoring, scheduling, and monitoring workflows — from simple cron-driven jobs to event-triggered multi-tool data pipelines — with built-in retries, error handling, version control, and 1,200+ plugins for databases, cloud services, and scripting languages.
INSTALL
docker run --pull=always -d --name kestra -p 8080:8080 -v /var/run/docker.sock:/var/run/docker.sock kestra/kestra:latest server localINTEGRATION GUIDE
1. Orchestrate end-to-end data pipelines: ingest from Airbyte or Fivetran, transform with dbt, and load into Snowflake or BigQuery
2. Trigger AI/ML training pipelines on new data arrival with event-driven workflows
3. Automate cloud infrastructure provisioning alongside scheduled data processing jobs
4. Build CI/CD pipeline automation with Git-triggered deployments and approval gates
5. Coordinate multi-tool business processes across SaaS APIs, databases, and scripts
TAGS
orchestrationworkflow-automationdata-pipelineETLevent-drivenschedulinginfrastructure-as-codedata-engineeringjava