Update hosted model.

patch

https://api.cast.ai/ai-optimizer/v1beta/organizations/{organizationId}/clusters/{clusterId}/hosted-models/{id}

Updates hosted model configuration

Recent Requests

Time	Status	User Agent
Retrieving recent requests…

Loading…

Path Params

organizationId

string

required

The ID of the Organization.

clusterId

string

required

The ID of the cluster that hosted model is deployed in

string

required

The ID of hosted model to be updated.

Body Params

nodeTemplateName

string

The name of the node template that will be used to deploy the model. If not provided, a Cast AI managed node template will be used.

vllmConfig

object

Configuration specific to the vLLM provider.

horizontalAutoscaling

object

The settings for horizontal autoscaling.

hibernation

object

The settings for automatic hibernation and resumption of the hosted model.

fallback

object

The fallback to use when the primary model is not available.

edgeLocations

object

Edge locations where the model can be deployed

Responses

Language

Credentials

URL

Loading…

Response

Click Try It! to start a request and see the response here! Or choose an example:

application/json

200OK