Jump to Content

Docs API Reference Release Notes

Docs

Docs API Reference Release Notes

All

Pages

Start typing to search…

Getting started
- About the read-only agent
- Step by step guide to connecting your cluster
  - GCP Private Service Connect
  - AWS PrivateLink
Cast AI Anywhere
- Overview
- Getting started
Enable automation
- Autoscaler preparation checklist
Platform permissions & data privacy
API access
Component management
Disconnect your cluster

Overview
Getting started
Feature reference
Kentroller
Scheduled rebalancing for Karpenter clusters

Overview
Getting started
Runbooks
- Fix container image vulnerabilities
- Synchronize Workload Autoscaler recommendations

Autoscaling
Downscaling
- Evictor
- Evictor vs. Rebalancer
Rebalancing
Cluster hibernation
- Cluster hibernation (Legacy)
Migration from Karpenter
Upgrading Kubernetes version
Container Live Migration
Pod mutations
Using ARM nodes with Cast AI
Business continuity
Watchdog
OMNI Edge Provisioning
- Overview
- Getting started

Overview
Workload Autoscaler configuration
- Available settings
- Annotations reference
  - Legacy annotations reference (deprecated)
Scaling policies
- How-to: Create a scaling policy
- How-to: Manage scaling policies
In-Place Pod Resizing
Pod startup recommendations
Horizontal Pod Autoscaling
- Tutorials
- Reference
Event log

Overview
Available savings
OpsPilot
Dashboard
Cluster score
Organization-level reports
Cluster-level reports
GPU utilization
Network cost
Storage cost
CPU vs. memory cost calculation
Metrics
- Tutorials
  - Integrating Prometheus Metrics with New Relic

Getting started
Serverless inference
Supported LLM providers
Hosted model deployment
- Model autoscaling and hibernation
- Tutorials
  - Deploy custom model with AI Enabler
AI Enabler settings
Tags
- Tag Support

Introduction
Getting started
- AWS RDS & Aurora quick start
- Cloud SQL Proxy quick start
How does it work?
Connecting client applications
Application failover configuration
Is Your Application Ready for Connection Pooling?
Tutorials
- Analyzing database performance
How-to
- Pause DBO for troubleshooting
Index Advisor
- Installing the Index Advisor agent
Database Optimizer FAQ

Getting started
Kvisor security agent
Security reports
Runtime security

Single Sign-On (SSO)
- IdP user group sync
  - Okta: Set up IdP user group sync
  - Okta: Managing IdP user group sync
Organization management
Role-Based Access Control (RBAC)
AWS Marketplace subscription setup
Price adjustments
- Overview
- Getting started
Notifications
- Tutorials
  - Set up Slack notifications
  - Set up webhook notifications
- Webhook integration examples
Audit log
Platform usage

Cluster and node status overview
Managing DaemonSets with Cast AI
Cast AI components troubleshooting
Cloud provider troubleshooting
Common deployment challenges
Terraform troubleshooting
Cluster certificate rotation
Pod startup failures with PD Standard on C3/C3D nodes (GKE)

General
API
Arm and Graviton
Autoscaler
Evictor
CUD, Savings Plans, and reservations
egressd, network and VPC
Helm
Kubernetes
Logs, alerts, and metrics
Node templates, node configuration, and labels
Permissions, users, Orgs, and SSO
Reports and UI/UX
Storage
Terraform
Updates and images

Powered by

Introducing Cast AI
Component management

Open source components

Cast AI develops and maintains several open source components that run in your cluster. The source code for each is available on GitHub.

Updated about 3 hours ago

Cast AI Operator

Cluster controller