Deploy an external model

Requirements

🔒 This tutorial requires full authentication.

You can deploy models from external marketplaces in AI4OS dedicated resources to perform inference. Currently we support the following marketplaces:

AI4Life

We currently support all V5 models from the AI4Life BioImage Model Zoo. Those model are accessible in the Dashboard Marketplace panel.

../../_images/marketplace-ai4life.png

When clicking on a given model you will be show the model information along with the metadata of that model.

../../_images/module-ai4life.png

Click Deploy and configure the resources. Once it is deployed you can find it on the Tools deployment table (similar to the Modules deployments table).

../../_images/deployments_modules_tools.png

Clicking on the Quick access button you will be redirected to the Gradio UI to make an inference with the model.

../../_images/gradio_ai4life.png