How to enable web-hooks in AWS for activating auto-rebuilt/CI-CD function in Inferless
To enable auto rebuild, there has to be some steps done prior that is required as mentioned below:
The model should be present in a model group
and should have a model package
.
An event bridge webhook is then required to relay the model package updates to Inferless.
The following steps will illustrate how we can create a model group, model package ,create an event bridge and approve a model version
using the boto3 python library.
To create a model group by using Boto3, call the create_model_package_group
method and specify a name and description as parameters.
The response from the create_model_package_group
call is the Amazon Resource Name (ARN) of the new model package group.
The following example shows how to create a model package group.
Reference: 1) https://.aws.amazon.com/sagemaker/latest/dg/model-registry-model-group.html
To register a model version by using Boto3, call the create_model_package
method.
First, you set up the parameter dictionary to pass to the create_model_package
method.
Then you call the create_model_package
method, passing in the parameter dictionary that you just set up.
The following example shows the above steps mentioned:
Reference:https://docs.aws.amazon.com/sagemaker/latest/dg/model-registry-version.html
Post this, you will get a new ARN link generated by running the code below:
Note the ARN printed as you will be required to input this into Inferless as part of **"Input Package URL"**
You need to set up an AWS Event Bridge to monitor the AWS events and send a webhook to Inferless whenever there is an update to the package.
You can view the video below to understand how to create one.
scrnli_28_02_2023_16-48-52.webm
22MB
Binary
View the video to learn to create a Event bridge
Setting the status to Approved
can initiate CI/CD deployment for the model.
The following code snippet shows how to manually change the approval status to Approved
.
Reference: https://docs.aws.amazon.com/sagemaker/latest/dg/model-registry-approve.html
Once you have completed the above and saved your file, Inferless would be able to listen to web-hooks and create new versions automatically.
You can view a sample video example below:
How to enable web-hooks in AWS for activating auto-rebuilt/CI-CD function in Inferless
To enable auto rebuild, there has to be some steps done prior that is required as mentioned below:
The model should be present in a model group
and should have a model package
.
An event bridge webhook is then required to relay the model package updates to Inferless.
The following steps will illustrate how we can create a model group, model package ,create an event bridge and approve a model version
using the boto3 python library.
To create a model group by using Boto3, call the create_model_package_group
method and specify a name and description as parameters.
The response from the create_model_package_group
call is the Amazon Resource Name (ARN) of the new model package group.
The following example shows how to create a model package group.
Reference: 1) https://.aws.amazon.com/sagemaker/latest/dg/model-registry-model-group.html
To register a model version by using Boto3, call the create_model_package
method.
First, you set up the parameter dictionary to pass to the create_model_package
method.
Then you call the create_model_package
method, passing in the parameter dictionary that you just set up.
The following example shows the above steps mentioned:
Reference:https://docs.aws.amazon.com/sagemaker/latest/dg/model-registry-version.html
Post this, you will get a new ARN link generated by running the code below:
Note the ARN printed as you will be required to input this into Inferless as part of **"Input Package URL"**
You need to set up an AWS Event Bridge to monitor the AWS events and send a webhook to Inferless whenever there is an update to the package.
You can view the video below to understand how to create one.
scrnli_28_02_2023_16-48-52.webm
22MB
Binary
View the video to learn to create a Event bridge
Setting the status to Approved
can initiate CI/CD deployment for the model.
The following code snippet shows how to manually change the approval status to Approved
.
Reference: https://docs.aws.amazon.com/sagemaker/latest/dg/model-registry-approve.html
Once you have completed the above and saved your file, Inferless would be able to listen to web-hooks and create new versions automatically.
You can view a sample video example below: