Agent to deploy and configure open source model serving frameworks

So that my ML and application team can easily test frameworks that best suit our use case without having to rely on extensive platform engineering support

• Deploy and configure with best practices on my EKS cluster

• Support custom and self hosted open source models like Llama, DeepSeek etc.

• Connect to common model registries, like MLFlow

• Optimal inference service for my model type, ie LLM, inference optimized for MLFlow models, TensorFlow ,etc.