Custom software and dependencies in your Runtime
Setup Environment
step.inferless runtime
command allows users to list
, select
and upload
the runtimes.
Commands:
generate
: use to generate a new runtime from your virtual envlist
: list all runtimes.select [options]
: use an existing runtime with the current modelupload [options]
: create or update runtime on inferless with yaml.patch [options]
: update the runtime with the config fileversion-list
: use to update the runtime in inferless.inferless init
, continue the process and select the requirements.txt file. This will create the inferless-runtime-config.yaml
, which you can update according to your software and Python libraries requirements.
inferless runtime generate
and then select the virtual environment that you want to use. This will create the inferless-runtime-config.yaml
file.
inferless runtime upload
to start the uploading process. First, you are required to pass the file name, and then you need to set a name to your runtime. Update the same to the inferless.yaml file.
Now your runtime is ready to use!