Skip to main content

​
Import from S3

Once you have made sure the model file structure is in the right format, you can upload the model to Inferless using the"Import Model"option.
  • Choose the source as "File" and choose "Cloud repository"
  • Choose AWS, authenticate, and connect your AWS Account.
  • Enter Model Name and paste the S3 Url link from AWS Sagemaker
    • Sample S3 link - s3://infer-global-models/sample-module/gpt2-medium-1.5gb.zip
  • Make sure you follow the folder structure as described here while creating the Zip.
  • Make sure to enter the input and output parameters as JSON required for the model.
  • Proceed with the configuration and load the model into Inferless.

​
Import From Google Cloud buckets

Once you have made sure the model file structure is in the right format, you can upload the model to Inferless using the"Import Model"option.
  • Choose the source as "File" and Choose "Cloud repository"
  • Choose GCP, authenticate and connect your GCP Account.
  • Enter Model Name and paste the Artifact Link link from GCP Cloud Bucket.
    • A Sample of an artifact link is - gs://pp-samplebucket/gpt2-medium-1.5gb.zip
  • Make sure you follow the folder structure as described here while creating the Zip.
  • Make sure to enter the input and output parameters as JSON required for the model (View here for more Infor).
  • Proceed and load the model into Inferless.