Deploying models using CLI required files in a particular format. This guide will explain about all the required files
app.py
. When you run the command inferless init
, you are required to have this file in your root folder.
app.py
: This file will have the InferlessPythonModel
class, which will contain the below functions(Mandatory)
def initialize(self)
def infer(self, inputs)
def finalize(self)
input_schema.py
This file should have all the inputs that you are taken
inferless init
, all the other files required for the deployment will be created and the user can update these files according to their requirements.
inferless-runtime-config.yaml
This file will have all the software packages and the Python packages required for the model inferencing.
inferless.yaml
This file will have all the configurations required for the deployment. Users can update this file according to their requirements.
input_schema.py
This file will have all the configurations required for the deployment. Users can update this file according to their requirements.
input.json
This file will have the key for the input parameter. Whenever you change the name of the key in the app.py
, update it accordingly.
output.json
This file will have the name
of the output key that the def infer
the function is going to return.
inferless deploy
to deploy your model.