Docs
AISIX AI GatewayOperateDeployment and RuntimeDeployment and Runtime

Deployment and Runtime

Operate AISIX AI Gateway across its lifecycle — from pre-launch checks through day-to-day operation, incident recovery, and routing configuration.

Deployment work spans a lifecycle: decisions made before a gateway takes traffic, the operational habits that keep it healthy day to day, the response when something breaks, and the routing-layer configuration that shapes how requests reach it. The pages in this section are grouped by where they fall in that lifecycle, not alphabetically — start with the group that matches what you're doing.

Before Go-Live

PageCovers
Deploy the Open-Source AISIX Gateway on KubernetesInstall the gateway without a control plane, choose a resources file source, verify readiness, and apply updates.
Production ReadinessThe production baseline: capacity and availability planning, configuration dependencies, network exposure, health checks, and shutdown.
Performance and SizingMeasured gateway latency and throughput on a reference machine, and the formula to size CPU for your own traffic.
Startup ConfigurationThe process-level settings a gateway needs before it can serve traffic — resource source, listeners, runtime dependencies, and the AISIX Enterprise connection.
Network and SecurityWhich network surfaces a gateway exposes — proxy, metrics/status, configuration store, control-plane connection — and the exposure policy each one needs.
Secrets managementWhere provider keys, caller API keys, and control-plane tokens live, and how to store and rotate them.
TLS and mTLSThe four independent places AISIX uses TLS — the proxy listener, upstream trust, etcd, and the AISIX Enterprise control-plane connection.

Ongoing Operations

PageCovers
Configuration PropagationHow a resource update reaches a running gateway from each resource source, and how to verify it actually applied.
Health ChecksThe separate health and status endpoints for process liveness, traffic readiness, configuration state, and per-model health, and how to read them together.
Thread-per-Core WorkersThe proxy.workers and proxy.thread_per_core settings, how to verify which serving mode is active, and what follows from each.
GitOpsVersioning, reviewing, and promoting AISIX configuration through Git and a continuous-delivery pipeline.

Incident Response

PageCovers
Backup and RestoreBack up and restore the control-plane database, exported configuration, provider secrets, TLS certificates, and audit-log exports.
Disaster RecoveryScenario-by-scenario recovery — region or availability-zone loss, control-plane loss, gateway-fleet loss, and database loss.

Routing Configuration

PageCovers
URL RewritingRewriting the incoming request path at the proxy entry so existing clients migrate to AISIX without configuration changes.
Forward Proxy for IDE AI TrafficDeploying AISIX behind a TLS-terminating egress device to govern traffic from IDEs and coding agents that must keep their official endpoints.

For fleet-wide monitoring — metrics, logs, and exporters across every gateway instance — see Observability. Troubleshooting is surfaced separately under Releases and support in the sidebar rather than duplicated here.