- Docker Build Synchronization: We’ve introduced a new workflow in the inferless-docker service to optimise docker builds, effectively preventing timeouts caused by prolonged build time.
- Infrastructure Stability Improvements: Significant stability fixes have been applied to the inference pod system, enabling automatic recovery from states of failure and crash backoff loops.
- CLI Enhancement for Runtime Export: The CLI has been upgraded to support a straightforward command for exporting from Cog runtime to Inferless runtime, simplifying the transition and enhancing usability.
- NVIDIA Driver Update for US East Region: For customers in region-1, the NVIDIA driver version has been updated from 480 to 525. This change addresses CUDA runtime errors, ensuring smoother operation and compatibility for our users.