- Docker Image
- Docker File
Docker Image URI ( Private/ Public )
We Currently support DockerHub Private / AWS Elastic Container registry, Once you have pushed your image, you need to make sure to follow the specifications for APIsAPI Contract Requirements
The image is expected to run a web server when started using the commanddocker run
- It is mandatory to host the web server on
port **8080**
Server Metadata API
-
path =
/v2
, http_method =GET
-
path =
/v2/models/{$MODEL_NAME}
, http_method =GET
Health APIs
-
path =
/v2/health/live
, http_method =GET
-
path =
/v2/health/ready
, http_method =GET
-
path =
/v2/models/{$MODEL_NAME}/ready
, http_method =GET
Inference API
-
path =
/v2/models/{$MODEL_NAME}/infer
-
http_method =
POST
, -
content_type =
application/json
For Docker File Integration
You can use GitHub/ GitLab for the docker file integration.Example
This is a sample fastApi application for a test generation use casemain.py
model.py
Dockerfile
requirements.txt