Prefect

A Native Integration to Increase Data Loads, Higher-Performance Data Science, and Machine Learning

Utilize Prefect’s task library to schedule the most common tasks without writing any code

A First-In-Class Analytics Platform in Python With Next-Generation Workflow Orchestration Tools

Flow Code

Prefect flows are Python, so you can build and modify them however you like.

Parameters

Add parameters to any flow for easy runtime templating and reuse.

Robust States

Prefect handles every error, whether expected or not. Some tasks might only run if upstream tasks fail.

Dataflow

Pass data between tasks for complex processing and advanced analytics.

Low-Latency

When paired with Dask, Prefect’s event-driven scheduler can execute tasks with millisecond latency.

Custom Schedules

Specify custom schedule logic including business days, offsets, and blackout windows, or fall back on good old cron.

After spinning a Jupyter instance and spinning up a Dask cluster in Saturn, you can use Prefect to create DAGs to automate your Data Science and Machine Learning workflows.

Ready to get started?