KAOS – The Kubernetes Agent Orchestration System

Summary

KAOS: K8s Agent Orchestration System Deploy, manage, and orchestrate AI agents on Kubernetes KAOS is a Kubernetes-native framework for deploying and orchestrating AI agents with tool access, multi-agent coordination, and seamless LLM integration. Features Feature Description Agentic Graphs Deploy distributed agents networks as Kubernetes resources MCP Primitives Tool integration via the Model Context Protocol standard Multi-Agent Support Hierarchical agent systems with automatic delegation OpenAI-Compatible All agents expose /v1/chat/completions endpoints KAOS CLI Install and manage agents and environments with kaos CLI Visual Dashboard UI to monitor agents, test chat, debug memory and tools Quick Start Prerequisites Kubernetes cluster kubectl configured helm installed Option 1: KAOS CLI/UI # Install the CLI pip install kaos-cli # Install KAOS in your cluster kaos install # Open the UI kaos ui The UI opens at axsaucedo.github.io/kaos-ui. For CLI/UI documentation, see the CLI Guide. Option 2: Helm/kubectl # Add the Helm repository helm repo add kaos https://axsaucedo.github.io/kaos/charts helm repo update # Install the operator helm install kaos kaos/kaos-operator -n kaos-system --create-namespace Deploy Your First Agent # simple-agent.yaml apiVersion : kaos.tools/v1alpha1 kind : ModelAPI metadata : name : ollama spec : mode : Hosted hostedConfig : model : " smollm2:135m " --- apiVersion : kaos.tools/v1alpha1 kind : MCPServer metadata : name : echo-tools spec : type : python-runtime config : tools : fromString : | def echo(message: str) -> str: """Echo back the message.""" return f"Echo: {message}" --- apiVersion : kaos.tools/v1alpha1 kind : Agent metadata : name : assistant spec : modelAPI : ollama mcpServers : - echo-tools config : description : " AI assistant with echo tools " instructions : " You are a helpful assistant. " env : - name : MODEL_NAME value : " ollama/smollm2:135m " kubectl apply -f simple-agent.yaml # Wait for pods to be ready kubectl wait --for=co...