​

Import from S3

Once you have made sure the model file structure is in the right format, you can upload the model to Inferless using the"Import Model"option.

• Choose the source as "File" and choose "Cloud repository"

• Choose AWS, authenticate, and connect your AWS Account.

• Enter Model Name and paste the S3 Url link from AWS Sagemaker

  • Sample S3 link - s3://infer-global-models/sample-module/gpt2-medium-1.5gb.zip

• Make sure you follow the folder structure as described here while creating the Zip.

• Make sure to enter the input and output parameters as JSON required for the model.

• Proceed with the configuration and load the model into Inferless.

​

Import From Google Cloud buckets

Once you have made sure the model file structure is in the right format, you can upload the model to Inferless using the"Import Model"option.

• Choose the source as "File" and Choose "Cloud repository"

• Choose GCP, authenticate and connect your GCP Account.

• Enter Model Name and paste the Artifact Link link from GCP Cloud Bucket.

  • A Sample of an artifact link is - gs://pp-samplebucket/gpt2-medium-1.5gb.zip

• Make sure you follow the folder structure as described here while creating the Zip.

• Make sure to enter the input and output parameters as JSON required for the model (View here for more Infor).

• Proceed and load the model into Inferless.