For AI agents: visit https://docs.cast.ai/llms.txt for an index of all pages formatted in Markdown and endpoints in OpenAPI.

Jump to Content

Docs API Reference Release Notes

Docs

Docs API Reference Release Notes

Getting started
- About the read-only agent
- Step by step guide to connecting your cluster
  - GCP Private Service Connect
  - AWS PrivateLink
Enable automation
- Autoscaler preparation checklist
- Troubleshooting cluster onboarding
Platform permissions & data privacy
Cast AI Anywhere
- Overview
- Getting started
API access
Component management
Cluster and node status overview
Disconnect your cluster

Overview
Getting started
Feature reference
Kentroller
Scheduled rebalancing for Karpenter clusters
Continuous rebalancing

Overview
Getting started
Runbooks
- Fix container image vulnerabilities
- Synchronize Workload Autoscaler recommendations

Autoscaling
Downscaling
- Evictor
- Evictor vs. Rebalancer
Rebalancing
Cluster hibernation
- Cluster hibernation (Legacy)
Migration from Karpenter
Upgrading Kubernetes version
Cluster certificate rotation
Container Live Migration
Pod mutations
Using ARM nodes with Cast AI
Business continuity
Watchdog
OMNI Edge Provisioning

Overview
Workload Autoscaler configuration
- Available settings
- Annotations reference
  - Legacy annotations reference (deprecated)
Scaling policies
- How-to: Create a scaling policy
- How-to: Manage scaling policies
In-Place Pod Resizing
Pod startup recommendations
Horizontal Pod Autoscaling
- Tutorials
- Reference
Event log

Overview
Available savings
OpsPilot
Dashboard
Cluster score
Organization-level reports
Cluster-level reports
GPU utilization
Network cost
Storage cost
CPU vs. memory cost calculation
Metrics
- Tutorials
  - Integrating Prometheus Metrics with New Relic

Getting started
Serverless inference
Supported LLM providers
Hosted model deployment
- Model autoscaling and hibernation
- Tutorials
  - Deploy custom model with AI Enabler
AI Enabler settings
Batch processing
- Create and manage batch jobs
Tags
- Tag Support

Introduction
Getting started
- AWS RDS & Aurora quick start
- Cloud SQL Proxy quick start
How does it work?
Connecting client applications
Application failover configuration
Connection Pooling
- PostgreSQL
- MySQL
Tutorials
- Analyzing database performance
How-to
- Pause DBO for troubleshooting
Performance Advisor
- Installing the Performance Advisor agent for PostgreSQL
- Installing the Performance Advisor agent for MySQL
Database Optimizer FAQ

Getting started
Kvisor security agent
Security reports
Runtime security

Single Sign-On (SSO)
- IdP user group sync
  - Okta: Set up IdP user group sync
  - Okta: Managing IdP user group sync
Organization management
Role-Based Access Control (RBAC)
AWS Marketplace subscription setup
Price adjustments
- Overview
- Getting started
Notifications
- Tutorials
  - Set up Slack notifications
  - Set up webhook notifications
- Webhook integration examples
Audit log
Platform usage

General
API
Arm and Graviton
Autoscaler
Evictor
CUD, Savings Plans, and reservations
egressd, network and VPC
Helm
Kubernetes
Logs, alerts, and metrics
Node templates, node configuration, and labels
Permissions, users, Orgs, and SSO
Reports and UI/UX
Storage
Terraform
Updates and images

Introducing Cast AI
Component management

Open source components

Cast AI develops and maintains several open source components that run in your cluster. The source code for each is available on GitHub.

Updated 11 days ago

Cast AI Operator

Cluster controller