Secure AI Orchestration: Mitigate Model-centric Attacks - AI Workshop
Major progress in machine learning (ML) has led to a corresponding boom in the broader artificial intelligence (AI) space, opening up commercial applications in text, image, audio, and video generation.
However, data scientists and ML engineers still face many security issues that may lead to arbitrary code execution even in the space of "classical" ML, which often involves classification or regression on tabular data.
This workshop will outline and prepare you for two types of model-centric attacks:
- Malicious code injection on pickled model files
- Malicious code written and executed by an LLM
We'll create a basic setup for these two attacks and see how Union, a ML workflow platform, can help mitigate some of the risks associated with these two attacks.
Finally, we'll analyze the limitations of the solutions provided by Union, abstract some of the ideas out in an orchestrator-agnostic way, and cover other open source tools, like safetensors and Onyx which we can leverage on top of Union to reduce these risks even further.
What you'll need to follow along
- A Union.ai account
- A GitHub account
About the Speaker
Niels is a machine learning engineer and core maintainer of Flyte, an open source ML orchestration tool and author and maintainer of Pandera, a data testing tool for dataframes. He has a Masters in Public Health with a specialization in sociomedical science and public health informatics, and prior to that a background in developmental biology and immunology. His research interests include reinforcement learning, AutoML, creative machine learning, and fairness, accountability, and transparency in automated systems. He enjoys developing open source tools to make data science and machine learning practitioners more productive.
About Union.ai
Union is an AI platform that simplifies ML infrastructure so you can develop, deploy, and innovate faster.
Write your code in Python, collaborate across departments, and enjoy full reproducibility and auditability. Union lets you focus on what matters.
💬 Join our AI and MLOps Slack Community: slack.flyte.org
⭐ Check out Flyte on GitHub: github.com/flyteorg/flyte
🤝 Learn about everything else we’re doing at union.ai