​
Import from S3

Once you have made sure the model file structure is in the right format, you can upload the model to Inferless using the"Import Model"option.

  • Choose the source as "File" and choose "Cloud repository"

  • Choose AWS, authenticate, and connect your AWS Account.

  • Enter Model Name and paste the S3 Url link from AWS Sagemaker

    • Sample S3 link - s3://infer-global-models/sample-module/gpt2-medium-1.5gb.zip

  • Make sure you follow the folder structure as described here while creating the Zip.

  • Make sure to enter the input and output parameters as JSON required for the model.

  • Proceed with the configuration and load the model into Inferless.

​
Import From Google Cloud buckets

Once you have made sure the model file structure is in the right format, you can upload the model to Inferless using the"Import Model"option.

  • Choose the source as "File" and Choose "Cloud repository"

  • Choose GCP, authenticate and connect your GCP Account.

  • Enter Model Name and paste the Artifact Link link from GCP Cloud Bucket.

    • A Sample of an artifact link is - gs://pp-samplebucket/gpt2-medium-1.5gb.zip

  • Make sure you follow the folder structure as described here while creating the Zip.

  • Make sure to enter the input and output parameters as JSON required for the model (View here for more Infor).

  • Proceed and load the model into Inferless.