You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: scenarios/AksKaito/README.md
+10-45Lines changed: 10 additions & 45 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -36,7 +36,7 @@ This article shows you how to enable the AI toolchain operator add-on and deploy
36
36
## Prerequisites
37
37
38
38
* If you don't have an Azure subscription, create a [free account](https://azure.microsoft.com/free/?WT.mc_id=A261C142F) before you begin.
39
-
* If you have multiple Azure subscriptions, make sure you select the correct subscription in which the resources will be created and charged using the [az account set][az-account-set] command.
39
+
* If you have multiple Azure subscriptions, make sure you select the correct subscription in which the resources will be created and charged using the [az account set](https://learn.microsoft.com/en-us/cli/azure/account?view=azure-cli-latest#az-account-set) command.
40
40
41
41
> [!NOTE]
42
42
> The subscription you use must have GPU VM quota.
@@ -48,7 +48,7 @@ This article shows you how to enable the AI toolchain operator add-on and deploy
48
48
49
49
## Set up resource group
50
50
51
-
Set up a resource group with a random ID. Create an Azure resource group using the [az group create][az-group-create] command.
51
+
Set up a resource group with a random ID. Create an Azure resource group using the [az group create](https://learn.microsoft.com/en-us/cli/azure/group?view=azure-cli-latest#az-group-create) command.
52
52
53
53
```bash
54
54
export RANDOM_ID="$(openssl rand -hex 3)"
@@ -63,7 +63,7 @@ az group create \
63
63
64
64
## Install the Azure CLI preview extension
65
65
66
-
Install the Azure CLI preview extension using the [az extension add][az-extension-add] command. Then update the extension to make sure you have the latest version using the [az extension update][az-extension-update] command.
66
+
Install the Azure CLI preview extension using the [az extension add](https://learn.microsoft.com/en-us/cli/azure/extension?view=azure-cli-latest#az-extension-add) command. Then update the extension to make sure you have the latest version using the [az extension update](https://learn.microsoft.com/en-us/cli/azure/extension?view=azure-cli-latest#az-extension-update) command.
## Verify the AI toolchain operator add-on registration
83
83
84
-
Verify the registration using the [az feature show][az-feature-show] command.
84
+
Verify the registration using the [az feature show](https://learn.microsoft.com/en-us/cli/azure/feature?view=azure-cli-latest#az-feature-show) command.
## Create an AKS cluster with the AI toolchain operator add-on enabled
98
98
99
-
Create an AKS cluster with the AI toolchain operator add-on enabled using the [az aks create][az-aks-create] command with the `--enable-ai-toolchain-operator` and `--enable-oidc-issuer` flags.
99
+
Create an AKS cluster with the AI toolchain operator add-on enabled using the [az aks create](https://learn.microsoft.com/en-us/cli/azure/aks?view=azure-cli-latest#az-aks-create) command with the `--enable-ai-toolchain-operator` and `--enable-oidc-issuer` flags.
100
100
101
101
> [!NOTE]
102
102
> AKS creates a managed identity once you enable the AI toolchain operator add-on. The managed identity is used to create GPU node pools in the managed AKS cluster. Proper permissions need to be set for it manually following the steps introduced in the following sections.
@@ -115,20 +115,9 @@ az aks create --location ${REGION} \
115
115
--k8s-support-plan KubernetesOfficial
116
116
```
117
117
118
-
## Enable AI toolchain operator for cluster
119
-
120
-
On an existing AKS cluster, you can enable the AI toolchain operator add-on using the [az aks update][az-aks-update] command.
121
-
122
-
```bash
123
-
az aks update --name ${CLUSTER_NAME} \
124
-
--resource-group ${AZURE_RESOURCE_GROUP} \
125
-
--enable-oidc-issuer \
126
-
--enable-ai-toolchain-operator
127
-
```
128
-
129
118
## Connect to your cluster
130
119
131
-
Configure `kubectl` to connect to your cluster using the [az aks get-credentials][az-aks-get-credentials] command.
120
+
Configure `kubectl` to connect to your cluster using the [az aks get-credentials](https://learn.microsoft.com/en-us/cli/azure/aks?view=azure-cli-latest#az-aks-get-credentials) command.
132
121
133
122
```bash
134
123
az aks get-credentials --resource-group ${AZURE_RESOURCE_GROUP} --name ${CLUSTER_NAME}
@@ -142,25 +131,16 @@ kubectl get nodes
142
131
143
132
## Export environment variables
144
133
145
-
Export environment variables for the MC resource group, principal ID identity, and KAITO identity using the following commands:
134
+
Export environment variables for the MC resource group, KAITO identity, and AKS OIDC Issuer URL using the following commands:
146
135
147
136
```bash
148
137
export MC_RESOURCE_GROUP=$(az aks show --resource-group ${AZURE_RESOURCE_GROUP} \
149
138
--name ${CLUSTER_NAME} \
150
139
--query nodeResourceGroup \
151
140
-o tsv)
152
-
export PRINCIPAL_ID=$(az identity show --name "ai-toolchain-operator-${CLUSTER_NAME}" \
export AKS_OIDC_ISSUER=$(az aks show --resource-group "${AZURE_RESOURCE_GROUP}" \
165
145
--name "${CLUSTER_NAME}" \
166
146
--query "oidcIssuerProfile.issuerUrl" \
@@ -169,7 +149,7 @@ export AKS_OIDC_ISSUER=$(az aks show --resource-group "${AZURE_RESOURCE_GROUP}"
169
149
170
150
## Establish a federated identity credential
171
151
172
-
Create the federated identity credential between the managed identity, AKS OIDC issuer, and subject using the [az identity federated-credential create][az-identity-federated-credential-create] command.
152
+
Create the federated identity credential between the managed identity, AKS OIDC issuer, and subject using the [az identity federated-credential create](https://learn.microsoft.com/en-us/cli/azure/identity/federated-credential?view=azure-cli-latest) command.
173
153
174
154
```bash
175
155
az identity federated-credential create --name "kaito-federated-identity" \
@@ -209,18 +189,3 @@ echo "See last step for details on how to ask questions to the model.
209
189
## Next steps
210
190
211
191
For more inference model options, see the [KAITO GitHub repository](https://github.com/Azure/kaito).
0 commit comments