From 08e039382f90099224d396a6035ebbb4232dbd56 Mon Sep 17 00:00:00 2001 From: Rachael Graham Date: Mon, 10 Aug 2026 12:27:10 -0500 Subject: [PATCH 1/4] Create byo-agentgateway.md Signed-off-by: Rachael Graham --- .../supported-providers/byo-agentgateway.md | 138 ++++++++++++++++++ 1 file changed, 138 insertions(+) create mode 100644 docs-site/content/kagent/supported-providers/byo-agentgateway.md diff --git a/docs-site/content/kagent/supported-providers/byo-agentgateway.md b/docs-site/content/kagent/supported-providers/byo-agentgateway.md new file mode 100644 index 00000000..8732899a --- /dev/null +++ b/docs-site/content/kagent/supported-providers/byo-agentgateway.md @@ -0,0 +1,138 @@ +--- +title: agentgateway +description: Configure an agentgateway deployment as a model endpoint for kagent. +weight: 9 +author: kagent.dev +--- + +You can route model requests through an [agentgateway](https://agentgateway.dev/docs/) deployment. agentgateway is an AI-native proxy that provides traffic management, observability, and security for LLM calls. Because agentgateway exposes an OpenAI-compatible API, you configure the `ModelConfig` with `provider: OpenAI` and point `openAI.baseUrl` at the agentgateway Gateway service address. + +## Set up agentgateway model routing + +> [!NOTE] +> The `AgentgatewayModel` feature is experimental and disabled by default. Enable it when you install agentgateway by passing `--set agentgatewayModels.enabled=true` to the control plane Helm chart. + +1. Install agentgateway in your cluster. For more information, see the [agentgateway documentation](https://agentgateway.dev/docs/kubernetes/latest/setup/). Add `--set agentgatewayModels.enabled=true` to the Helm command for the agentgateway control plane. + +2. Create a `Gateway` resource for model routing. agentgateway uses a separate `Gateway` for model traffic, independent of any waypoint proxy you may already have. + + ```yaml + kubectl apply -f - <}} + {{% tab name="No authentication" %}} + If your agentgateway deployment does not enforce API key authentication, apply the following `ModelConfig`. + + ```yaml + kubectl apply -f - < + kubectl create secret generic kagent-agentgateway-key -n kagent \ + --from-literal AGENTGATEWAY_API_KEY=$AGENTGATEWAY_API_KEY + ``` + + 2. Create the `ModelConfig` resource. + + ```yaml + kubectl apply -f - <}} + +2. Verify that the `ModelConfig` is accepted. + + ```bash + kubectl get modelconfig agentgateway-model -n kagent -o yaml + ``` + +agentgateway is now added as a model endpoint in kagent. Next, you can {{< upstream >}}[create or update an agent](https://kagent.dev/docs/kagent/getting-started/first-agent){{< /upstream >}}{{< downstream >}}[create or update an agent]({{< link-hextra path="/agents/basic/" >}}){{< /downstream >}} to use this model. From 70e6a8834966a883bbd47527d20de2a2a38d4143 Mon Sep 17 00:00:00 2001 From: Rachael Graham Date: Mon, 10 Aug 2026 12:56:14 -0500 Subject: [PATCH 2/4] edits Signed-off-by: Rachael Graham --- .../snippets/field-desc/review-table.md | 1 + .../supported-providers/byo-agentgateway.md | 34 ++++++++++--------- 2 files changed, 19 insertions(+), 16 deletions(-) create mode 100644 docs-site/assets/conrefs/snippets/field-desc/review-table.md diff --git a/docs-site/assets/conrefs/snippets/field-desc/review-table.md b/docs-site/assets/conrefs/snippets/field-desc/review-table.md new file mode 100644 index 00000000..2ab68fa4 --- /dev/null +++ b/docs-site/assets/conrefs/snippets/field-desc/review-table.md @@ -0,0 +1 @@ +Review the following table to understand this configuration. \ No newline at end of file diff --git a/docs-site/content/kagent/supported-providers/byo-agentgateway.md b/docs-site/content/kagent/supported-providers/byo-agentgateway.md index 8732899a..8d939e5d 100644 --- a/docs-site/content/kagent/supported-providers/byo-agentgateway.md +++ b/docs-site/content/kagent/supported-providers/byo-agentgateway.md @@ -5,17 +5,16 @@ weight: 9 author: kagent.dev --- -You can route model requests through an [agentgateway](https://agentgateway.dev/docs/) deployment. agentgateway is an AI-native proxy that provides traffic management, observability, and security for LLM calls. Because agentgateway exposes an OpenAI-compatible API, you configure the `ModelConfig` with `provider: OpenAI` and point `openAI.baseUrl` at the agentgateway Gateway service address. +You can route model requests through an [agentgateway](https://agentgateway.dev/docs/) deployment. Agentgateway is an AI-native proxy that provides traffic management, observability, and security for LLM calls. Because agentgateway exposes an OpenAI-compatible API, you configure the `ModelConfig` with `provider: OpenAI` and set `openAI.baseUrl` to your agentgateway Gateway service address. -## Set up agentgateway model routing +## Set up agentgateway model routing {#setup} > [!NOTE] -> The `AgentgatewayModel` feature is experimental and disabled by default. Enable it when you install agentgateway by passing `--set agentgatewayModels.enabled=true` to the control plane Helm chart. +> The `AgentgatewayModel` feature is experimental and disabled by default. You must enable it when you install agentgateway by passing `--set agentgatewayModels.enabled=true` to the control plane Helm chart. 1. Install agentgateway in your cluster. For more information, see the [agentgateway documentation](https://agentgateway.dev/docs/kubernetes/latest/setup/). Add `--set agentgatewayModels.enabled=true` to the Helm command for the agentgateway control plane. -2. Create a `Gateway` resource for model routing. agentgateway uses a separate `Gateway` for model traffic, independent of any waypoint proxy you may already have. - +2. Create a `Gateway` resource for model routing. ```yaml kubectl apply -f - <}} {{% tab name="No authentication" %}} - If your agentgateway deployment does not enforce API key authentication, apply the following `ModelConfig`. - + If your agentgateway deployment does not enforce any API key authentication, apply the following `ModelConfig`. ```yaml kubectl apply -f - <}} For more information, see the [API docs]({{< link-hextra path="/reference/api/kagent/#modelconfigspec" >}}). + | Setting | Description | | --- | --- | | `provider` | Set to `OpenAI`, because agentgateway exposes an OpenAI-compatible API. | @@ -92,8 +95,7 @@ You can route model requests through an [agentgateway](https://agentgateway.dev/ {{% tab name="API key authentication" %}} If your agentgateway deployment applies an `apiKeyAuthentication` policy with `mode: Strict`, you must provide an API key in the `ModelConfig`. - 1. Save your agentgateway API key and create a Kubernetes secret in the same namespace as your agent, such as `kagent`. - + 1. Save the API key that the agentgateway `apiKeyAuthentication` policy requires. This is the key that clients must send in the `Authorization` header when they call agentgateway. Create a Kubernetes secret in the same namespace as your agent, such as `kagent`. ```bash export AGENTGATEWAY_API_KEY= kubectl create secret generic kagent-agentgateway-key -n kagent \ @@ -101,7 +103,6 @@ You can route model requests through an [agentgateway](https://agentgateway.dev/ ``` 2. Create the `ModelConfig` resource. - ```yaml kubectl apply -f - <}} For more information, see the [API docs]({{< link-hextra path="/reference/api/kagent/#modelconfigspec" >}}). + | Setting | Description | | --- | --- | | `provider` | Set to `OpenAI`, because agentgateway exposes an OpenAI-compatible API. | @@ -130,9 +133,8 @@ You can route model requests through an [agentgateway](https://agentgateway.dev/ {{< /tabs >}} 2. Verify that the `ModelConfig` is accepted. - ```bash kubectl get modelconfig agentgateway-model -n kagent -o yaml ``` -agentgateway is now added as a model endpoint in kagent. Next, you can {{< upstream >}}[create or update an agent](https://kagent.dev/docs/kagent/getting-started/first-agent){{< /upstream >}}{{< downstream >}}[create or update an agent]({{< link-hextra path="/agents/basic/" >}}){{< /downstream >}} to use this model. +Agentgateway is now added as a model endpoint in kagent. Next, you can [create or update an agent]({{< link-hextra path="/getting-started/first-agent/" >}}) to use this model. \ No newline at end of file From 830980da352269431e74826175a252216631efc3 Mon Sep 17 00:00:00 2001 From: Rachael Graham Date: Mon, 10 Aug 2026 13:11:56 -0500 Subject: [PATCH 3/4] Update docs-site/content/kagent/supported-providers/byo-agentgateway.md Co-authored-by: Art Signed-off-by: Rachael Graham --- .../content/kagent/supported-providers/byo-agentgateway.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/docs-site/content/kagent/supported-providers/byo-agentgateway.md b/docs-site/content/kagent/supported-providers/byo-agentgateway.md index 8d939e5d..04a320b4 100644 --- a/docs-site/content/kagent/supported-providers/byo-agentgateway.md +++ b/docs-site/content/kagent/supported-providers/byo-agentgateway.md @@ -1,5 +1,5 @@ --- -title: agentgateway +title: Agentgateway description: Configure an agentgateway deployment as a model endpoint for kagent. weight: 9 author: kagent.dev From 65956d16cb761c92e1d86f885922d0cecd7569ba Mon Sep 17 00:00:00 2001 From: Rachael Graham Date: Mon, 10 Aug 2026 13:20:20 -0500 Subject: [PATCH 4/4] Update byo-agentgateway.md Signed-off-by: Rachael Graham --- .../content/kagent/supported-providers/byo-agentgateway.md | 6 +++--- 1 file changed, 3 insertions(+), 3 deletions(-) diff --git a/docs-site/content/kagent/supported-providers/byo-agentgateway.md b/docs-site/content/kagent/supported-providers/byo-agentgateway.md index 8d939e5d..d09a7520 100644 --- a/docs-site/content/kagent/supported-providers/byo-agentgateway.md +++ b/docs-site/content/kagent/supported-providers/byo-agentgateway.md @@ -84,7 +84,7 @@ You can route model requests through an [agentgateway](https://agentgateway.dev/ EOF ``` - {{< reuse "conrefs/snippets/field-desc/review-table.md" >}} For more information, see the [API docs]({{< link-hextra path="/reference/api/kagent/#modelconfigspec" >}}). + {{< reuse "conrefs/snippets/field-desc/review-table.md" >}} For more information, see the [API docs](https://kagent.dev/docs/kagent/resources/api-ref#modelconfigspec). | Setting | Description | | --- | --- | @@ -120,7 +120,7 @@ You can route model requests through an [agentgateway](https://agentgateway.dev/ EOF ``` - {{< reuse "conrefs/snippets/field-desc/review-table.md" >}} For more information, see the [API docs]({{< link-hextra path="/reference/api/kagent/#modelconfigspec" >}}). + {{< reuse "conrefs/snippets/field-desc/review-table.md" >}} For more information, see the [API docs](https://kagent.dev/docs/kagent/resources/api-ref#modelconfigspec). | Setting | Description | | --- | --- | @@ -137,4 +137,4 @@ You can route model requests through an [agentgateway](https://agentgateway.dev/ kubectl get modelconfig agentgateway-model -n kagent -o yaml ``` -Agentgateway is now added as a model endpoint in kagent. Next, you can [create or update an agent]({{< link-hextra path="/getting-started/first-agent/" >}}) to use this model. \ No newline at end of file +Agentgateway is now added as a model endpoint in kagent. Next, you can [create or update an agent](https://kagent.dev/docs/kagent/getting-started/first-agent) to use this model. \ No newline at end of file