Hamilton helps data scientists and engineers define testable, modular, self-documenting dataflows, that encode lineage and metadata. Runs and scales everywhere python does.
-
Updated
May 14, 2024 - Jupyter Notebook
Hamilton helps data scientists and engineers define testable, modular, self-documenting dataflows, that encode lineage and metadata. Runs and scales everywhere python does.
An experimental multi-tenant distributed system platform
Lightweight function pipeline (DAG) creation: 📚 Less Bookkeeping, 🎯 More Doing
Apache Airflow - A platform to programmatically author, schedule, and monitor workflows
A reactive notebook for Python — run reproducible experiments, execute as a script, deploy as an app, and version with git.
async DAG task scheduling in Rust (WIP)
Go Implementation of the Spacemesh protocol full node. 💾⏰💪
A distributed, fault-tolerant task queue
Workflow Engine for Kubernetes
HathorNetwork's fullnode core
Rill Flow is a high-performance, scalable distributed workflow orchestration service
🚀 The Mixin TEE-BFT-DAG network reference implementation.
🚀 JavaScript diagramming library that uses SVG and HTML for rendering.
Open data platform based on Kubernetes. Scaleph supports SeaTunnel、Flink and Doris backended by SeaTunnel on Flink engine、Flink Kubernetes Operator and Doris operator.
【A common used C++ DAG framework】 一个通用的、无三方依赖的、跨平台的、收录于awesome-cpp的、基于流图的并行计算框架。欢迎star & fork
A high performance Python graph library implemented in Rust.
automated data pipeline using beautiful soup, apache airflow and dvc data versioning
Iris is an extensible asynchronous header-only framework written in pure modern C++, including a M:N task scheduler (with coroutine support for C++ 20 optionally) and an advanced DAG-based task dispatcher.
A small library to orchestrate and visualize function calls using graph structure.
Add a description, image, and links to the dag topic page so that developers can more easily learn about it.
To associate your repository with the dag topic, visit your repo's landing page and select "manage topics."