Prefect

The easiest way to build, run, and monitor data pipelines at scale. Prefect 2 is the second-generation dataflow coordination and orchestration platform from Prefect. Prefect 2 has been designed from the ground up to handle the dynamic, scalable workloads that the modern data stack demands. Powered by Prefect Orion, a brand-new, asynchronous rules engine, it represents an enormous amount of research, development, and dedication to a simple idea: