Flyte School: Enrich your AI pipelines - A deep dive into Flyte plugins
Flyte plugins are extensions or integrations that enhance the functionality of the Flyte platform. Plugins allow Flyte to interact with external services, systems, or tools — extending its capabilities beyond its core features. These plugins provide the flexibility to customize and adapt Flyte to specific use cases and workflows.
In this session, we’ll explore the reasons behind and the process of developing plugins for Flyte. You’ll gain insights into when and why to implement and deploy a custom plugin. In addition, we’ll showcase examples such as the Spark, MLFlow, and many other plugins.
Learning Objectives
- Understand the motivations for creating backend plugins in the Flyte platform.
- Learn how and when to implement a backend and flytekit plugin.
- Learn the difference between flytekit plugin vs backend plugin.
- Learn how to use existing plugins.
Agenda
- Introduction to Backend Extensions
- ~Reasons for developing backend plugins
- ~Scenarios where backend plugins are beneficial
- Introduction to Flytekit Extensions
- ~Interface specification
- ~Flytekit plugin implementation
- How to test and deploy your plugins
- Case studies
- Q&A and Discussion