Update hosted model.

patch

https://api.cast.ai/ai-optimizer/v1beta/organizations/{organizationId}/clusters/{clusterId}/hosted-models/{id}

Updates hosted model configuration

Recent Requests

Time	Status	User Agent
Retrieving recent requests…

Loading…

Path Params

organizationId

string

required

The ID of the Organization.

clusterId

string

required

The ID of the cluster that hosted model is deployed in

string

required

The ID of hosted model to be updated.

Body Params

A request message for updates hosted model fields

nodeTemplateName

string

The name of the node template that will be used to deploy the model. If not provided, a Cast AI managed node template will be used.

vllmConfig

object

Configuration for the vLLM provider.

horizontalAutoscaling

object

The settings for horizontal autoscaling

hibernation

object

The settings for hibernation

fallback

object

The fallback model to use when the primary model is not available.

edgeLocations

object

Edge locations where the model can be deployed.

Responses

Language

Credentials

URL

Loading…

Response

Click Try It! to start a request and see the response here! Or choose an example:

application/json

200OK