Bring your own docker container images. ( This might have higher coldstarts )
--inferapi
)"Add a custom model"
button that you see on the top right. An import wizard will open up.Click on Add Model
Docker Hub
as the method of upload from the Provider
list.
Docker Hub account
. This is a mandatory step as this helps us download the image from your Docker Hub.
After you have selected Repo
Image URL
, Health check API
, Infer API
and Server Port
Model Name
: The desired name of the model that you wish to giveEnter the details as noted
Automatic rebuild
for your model, enable it
Set runtime and configuration
Deploy
to start the model import process.
Review all the details carefully before proceeding
"In Progress/Failed"
tab.View the model under `In-Progress/ Failed`
-> API -> Inference Endpoint details.
Here you would find the API endpoints that can be called. You can click on the copy button on the right and can call your model.
Under the API Tab, you can view the API endpoint details.
Sample for now
"Add a custom model"
button that you see on the top right. An import wizard will open up.Click on Add Model
Dockerfile
as the method of upload from the Provider
list.
GitHub/GitLab account
. This is a mandatory step as this helps us get the file from your repository.
After you have selected Repo
Github Repository
and the branch
.Health check API
, Infer API
, Server Port
and the Docker File Path
Model Name
: The desired name of the model that you wish to giveEnter the details as noted
Automatic rebuild
for your model, enable it
Set runtime and configuration
Deploy
to start the model import process.
Review all the details carefully before proceeding
"In Progress/Failed"
tab.View the model under `In-Progress/ Failed`
-> API -> Inference Endpoint details.
Here you would find the API endpoints that can be called. You can click on the copy button on the right and can call your model.
Under the API Tab, you can view the API endpoint details.
Sample for now