​
Types of alerts supported by Inferless

  • You will be notified for the following events:
    1. Your model inference is getting a non 200 http response code
      • Sample SNS subject and message format
        • subject: “4xx errors increased for 4f1b4709-394b-4424-90f2-729881cee8cf by 1”
        • message: 
          {
   "model_id": "4f1b4709-394b-4424-90f2-729881cee8cf",
   "model_url": "https://test-inferless.com/model-details?model_id=4f1b4709-394b-4424-90f2-729881cee8cf",
   "message": "The service https://test-inferless.com/model-details?model_id=4f1b4709-394b-4424-90f2-729881cee8cf had 1 4xx errors over the last 30 seconds.",
   "error_type": "4xx_error_increased",
   "value": 1
}
    2. Your model inference latency is more than 20 seconds
      • Sample SNS subject and message format
        • subject: “High latency for 2c7f23d5-27b1-4e21-8dbf-f8c926e4385d above 20 seconds”
        • message: 
          {
"model_id": "2c7f23d5-27b1-4e21-8dbf-f8c926e4385d",
"model_url": "https://test-inferless.com/model-details?model_id=2c7f23d5-27b1-4e21-8dbf-f8c926e4385d",
"message": "The service https://test-inferless.com/model-details?model_id=2c7f23d5-27b1-4e21-8dbf-f8c926e4385d had latency above 20 seconds. Current latency in milliseconds: 59640 ms",
"error_type": "latency_increased",
"value": 59640
}

​
Steps to integrate with AWS SNS

  • Create a new Standard SNS topic in your AWS account.

    Create SNS topic.

  • Create and IAM user in your AWS account and add a SNS policy to write to topic

    Create SNS user and write policy.

  • Add the topic ARN, access and secret keys in the Manage Integrations —> Workspace Integrations —> AWS SNS section

    Add SNS Integration

Add SNS Integration

  • You can also enable or disable alerts in Workspace Settings —> Integrations —> AWS SNS section

    Enable Alerts

  • You can then create a subscription of choice to recieve notifications.

    Create SNS subscription