AWS SageMaker inference agent
The AWS SageMaker inference agent allows you to deploy models, and create and trigger inference endpoints. You can also fully remove the SageMaker deployment.
Installation
To use the AWS SageMaker inference agent, run the following command:
pip install flytekitplugins-awssagemaker
Example usage
For a usage example, see AWS SageMaker inference agent example.
Local testing
To test the SageMaker inference agent locally, create a class for the agent task that inherits from AsyncAgentExecutorMixin
. This mixin can handle synchronous tasks and allows Union to mimic FlytePropeller’s behavior in calling the agent.
Union.ai cluster deployment
After you have finished testing the agent locally, contact the Union.ai team to enable it in your cluster.