CLI
inferless runtime
Is can be used to list runtimes and create new runtimes.
Usage:
Commands:
generate
: use to generate a new runtime from your virtual envlist
: list all runtimes.select [options]
: use an existing runtime with the current modelupload [options]
: create or update runtime on inferless with yaml.patch [options]
: update the runtime with the config fileversion-list
: use to update the runtime in inferless.
Example
Usage:
Generate a new runtime from your local environment.
Activate you virtual environment and then run
list all the runtime in the workspace.
select a existing runtime for the model in the current directory.
select a a different runtime.yaml for the model in the current directory.
create runtime in the workspace
update runtime in the workspace
list the runtime versions