Link parkin’: flyte
The infinitely scalable and flexible workflow orchestration platform that seamlessly unifies data, ML and analytics stacks.
From the flyte docs:
Flyte is an open-source, Kubernetes-native workflow orchestrator implemented in Go. It enables highly concurrent, scalable and reproducible workflows for data processing, machine learning and analytics.
Flyte provides first-class support for Python and has a community-driven Java and Scala SDK. Data Scientists and ML Engineers in the industry use Flyte to create:
- Data pipelines for processing petabyte-scale data.
- Analytics workflows for business and finance use cases.
- Machine learning pipelines for logistics, image processing, and cancer diagnostics.
Missed posting yesterday, so this is a bonus makeup. I can at least get a post a day on average.