Skip to main content

Documentation Index

Fetch the complete documentation index at: https://docs.inferless.com/llms.txt

Use this file to discover all available pages before exploring further.

Latest Enhancements & Features:
  1. Runtime Updates: You can now change the default runtime used by a model and update runtime versions in-place.
  2. Streaming Logs: We have rolled-out real-time logs for model imports using WebSockets, giving you live feedback as each step in the import process progresses.
  3. Improved Warm Pool Integration: The autoscaler now uses Warm Pools more efficiently to accelerate spin-up times during scaling events, reducing cold start delays and improving overall responsiveness.