This topic describes how to launch Auto Scaling groups of Windows nodes that register with your Amazon EKS cluster. After the nodes join the cluster, you can deploy Kubernetes applications to them.
ImportantAmazon EKS nodes are standard Amazon EC2 instances, and you are billed for them based on normal Amazon EC2 instance prices. For more information, see Amazon EC2 pricing.
You can launch Windows nodes in Amazon EKS extended clusters on AWS Outposts, but you canât launch them in local clusters on AWS Outposts. For more information, see Deploy Amazon EKS on-premises with AWS Outposts.
Enable Windows support for your cluster. We recommend that you review important considerations before you launch a Windows node group. For more information, see Enable Windows support.
You can launch self-managed Windows nodes with either of the following:
eksctl
Launch self-managed Windows nodes using eksctl
This procedure requires that you have installed eksctl
, and that your eksctl
version is at least 0.210.0
. You can check your version with the following command.
eksctl version
For instructions on how to install or upgrade eksctl
, see Installation in the eksctl
documentation.
This procedure only works for clusters that were created with eksctl
.
(Optional) If the AmazonEKS_CNI_Policy managed IAM policy (if you have an IPv4
cluster) or the AmazonEKS_CNI_IPv6_Policy
(that you created yourself if you have an IPv6
cluster) is attached to your Amazon EKS node IAM role, we recommend assigning it to an IAM role that you associate to the Kubernetes aws-node
service account instead. For more information, see Configure Amazon VPC CNI plugin to use IRSA.
This procedure assumes that you have an existing cluster. If you donât already have an Amazon EKS cluster and an Amazon Linux node group to add a Windows node group to, we recommend that you follow Get started with Amazon EKS â eksctl. This guide provides a complete walkthrough for how to create an Amazon EKS cluster with Amazon Linux nodes.
Create your node group with the following command. Replace region-code
with the AWS Region that your cluster is in. Replace my-cluster
with your cluster name. The name can contain only alphanumeric characters (case-sensitive) and hyphens. It must start with an alphanumeric character and canât be longer than 100 characters. The name must be unique within the AWS Region and AWS account that youâre creating the cluster in. Replace ng-windows
with a name for your node group. The node group name canât be longer than 63 characters. It must start with letter or digit, but can also include hyphens and underscores for the remaining characters. You can replace 2019
with 2022
to use Windows Server 2022. Replace the rest of the example values
with your own values.
To deploy a node group to AWS Outposts, AWS Wavelength, or AWS Local Zone subnets, donât pass the AWS Outposts, Wavelength, or Local Zone subnets when you create the cluster. Create the node group with a config file, specifying the AWS Outposts, Wavelength, or Local Zone subnets. For more information, see Create a nodegroup from a config file and Config file schema in the eksctl
documentation.
eksctl create nodegroup \
--region region-code \
--cluster my-cluster \
--name ng-windows \
--node-type t2.large \
--nodes 3 \
--nodes-min 1 \
--nodes-max 4 \
--managed=false \
--node-ami-family WindowsServer2019FullContainer
Note
If nodes fail to join the cluster, see Nodes fail to join cluster in the Troubleshooting guide.
To see the available options for eksctl
commands, enter the following command.
eksctl command -help
An example output is as follows. Several lines are output while the nodes are created. One of the last lines of output is the following example line.
[â] created 1 nodegroup(s) in cluster "my-cluster"
(Optional) Deploy a sample application to test your cluster and Windows nodes.
We recommend blocking Pod access to IMDS if the following conditions are true:
You plan to assign IAM roles to all of your Kubernetes service accounts so that Pods only have the minimum permissions that they need.
No Pods in the cluster require access to the Amazon EC2 instance metadata service (IMDS) for other reasons, such as retrieving the current AWS Region.
For more information, see Restrict access to the instance profile assigned to the worker node.
Prerequisites
Step 1: Launch self-managed Windows nodes using the AWS Management Console
Wait for your cluster status to show as ACTIVE
. If you launch your nodes before the cluster is active, the nodes fail to register with the cluster and you need to relaunch them.
Open the AWS CloudFormation console
Choose Create stack.
For Specify template, select Amazon S3 URL.
Copy the following URL and paste it into Amazon S3 URL.
https://s3.us-west-2.amazonaws.com/amazon-eks/cloudformation/2023-02-09/amazon-eks-windows-nodegroup.yaml
Select Next twice.
On the Quick create stack page, enter the following parameters accordingly:
Stack name: Choose a stack name for your AWS CloudFormation stack. For example, you can call it my-cluster-nodes
.
ClusterName: Enter the name that you used when you created your Amazon EKS cluster.
ClusterControlPlaneSecurityGroup: Choose the security group from the AWS CloudFormation output that you generated when you created your VPC. The following steps show one method to retrieve the applicable group.
Open the Amazon EKS console.
Choose the name of the cluster.
Choose the Networking tab.
Use the Additional security groups value as a reference when selecting from the ClusterControlPlaneSecurityGroup dropdown list.
NodeGroupName: Enter a name for your node group. This name can be used later to identify the Auto Scaling node group thatâs created for your nodes. The node group name canât be longer than 63 characters. It must start with letter or digit, but can also include hyphens and underscores for the remaining characters.
NodeAutoScalingGroupMinSize: Enter the minimum number of nodes that your node Auto Scaling group can scale in to.
NodeAutoScalingGroupDesiredCapacity: Enter the desired number of nodes to scale to when your stack is created.
NodeAutoScalingGroupMaxSize: Enter the maximum number of nodes that your node Auto Scaling group can scale out to.
NodeInstanceType: Choose an instance type for your nodes. For more information, see Choose an optimal Amazon EC2 node instance type.
NodeImageIdSSMParam: Pre-populated with the Amazon EC2 Systems Manager parameter of the current recommended Amazon EKS optimized Windows Core AMI ID. To use the full version of Windows, replace Core
with Full
.
NodeImageId: (Optional) If youâre using your own custom AMI (instead of an Amazon EKS optimized AMI), enter a node AMI ID for your AWS Region. If you specify a value for this field, it overrides any values in the NodeImageIdSSMParam field.
NodeVolumeSize: Specify a root volume size for your nodes, in GiB.
KeyName: Enter the name of an Amazon EC2 SSH key pair that you can use to connect using SSH into your nodes with after they launch. If you donât already have an Amazon EC2 key pair, you can create one in the AWS Management Console. For more information, see Amazon EC2 key pairs in the Amazon EC2 User Guide.
NoteIf you donât provide a key pair here, the AWS CloudFormation stack fails to be created.
BootstrapArguments: Specify any optional arguments to pass to the node bootstrap script, such as extra kubelet
arguments using -KubeletExtraArgs
.
DisableIMDSv1: By default, each node supports the Instance Metadata Service Version 1 (IMDSv1) and IMDSv2. You can disable IMDSv1. To prevent future nodes and Pods in the node group from using MDSv1, set DisableIMDSv1 to true. For more information about IMDS, see Configuring the instance metadata service.
VpcId: Select the ID for the VPC that you created.
NodeSecurityGroups: Select the security group that was created for your Linux node group when you created your VPC. If your Linux nodes have more than one security group attached to them, specify all of them. This for, for example, if the Linux node group was created with eksctl
.
Subnets: Choose the subnets that you created. If you created your VPC using the steps in Create an Amazon VPC for your Amazon EKS cluster, then specify only the private subnets within the VPC for your nodes to launch into.
ImportantIf any of the subnets are public subnets, then they must have the automatic public IP address assignment setting enabled. If the setting isnât enabled for the public subnet, then any nodes that you deploy to that public subnet wonât be assigned a public IP address and wonât be able to communicate with the cluster or other AWS services. If the subnet was deployed before March 26, 2020 using either of the Amazon EKS AWS CloudFormation VPC templates, or by using eksctl
, then automatic public IP address assignment is disabled for public subnets. For information about how to enable public IP address assignment for a subnet, see Modifying the public IPv4 addressing attribute for your subnet. If the node is deployed to a private subnet, then itâs able to communicate with the cluster and other AWS services through a NAT gateway.
If the subnets donât have internet access, then make sure that youâre aware of the considerations and extra steps in Deploy private clusters with limited internet access.
If you select AWS Outposts, Wavelength, or Local Zone subnets, then the subnets must not have been passed in when you created the cluster.
Acknowledge that the stack might create IAM resources, and then choose Create stack.
When your stack has finished creating, select it in the console and choose Outputs.
Record the NodeInstanceRole for the node group that was created. You need this when you configure your Amazon EKS Windows nodes.
Step 2: Enable nodes to join your cluster
Check to see if you already have an aws-auth
ConfigMap
.
kubectl describe configmap -n kube-system aws-auth
If you are shown an aws-auth
ConfigMap
, then update it as needed.
Open the ConfigMap
for editing.
kubectl edit -n kube-system configmap/aws-auth
Add new mapRoles
entries as needed. Set the rolearn
values to the NodeInstanceRole values that you recorded in the previous procedures.
[...]
data:
mapRoles: |
- rolearn: <ARN of linux instance role (not instance profile)>
username: system:node:{{EC2PrivateDNSName}}
groups:
- system:bootstrappers
- system:nodes
- rolearn: <ARN of windows instance role (not instance profile)>
username: system:node:{{EC2PrivateDNSName}}
groups:
- system:bootstrappers
- system:nodes
- eks:kube-proxy-windows
[...]
Save the file and exit your text editor.
If you received an error stating "Error from server (NotFound): configmaps "aws-auth" not found
, then apply the stock ConfigMap
.
Download the configuration map.
curl -O https://s3.us-west-2.amazonaws.com/amazon-eks/cloudformation/2020-10-29/aws-auth-cm-windows.yaml
In the aws-auth-cm-windows.yaml
file, set the rolearn
values to the applicable NodeInstanceRole values that you recorded in the previous procedures. You can do this with a text editor, or by replacing the example values
and running the following command:
sed -i.bak -e 's|<ARN of linux instance role (not instance profile)>|my-node-linux-instance-role|' \
-e 's|<ARN of windows instance role (not instance profile)>|my-node-windows-instance-role|' aws-auth-cm-windows.yaml
Important
Donât modify any other lines in this file.
Donât use the same IAM role for both Windows and Linux nodes.
Apply the configuration. This command might take a few minutes to finish.
kubectl apply -f aws-auth-cm-windows.yaml
Watch the status of your nodes and wait for them to reach the Ready
status.
kubectl get nodes --watch
Enter Ctrl
+C
to return to a shell prompt.
If nodes fail to join the cluster, then see Nodes fail to join cluster in the Troubleshooting chapter.
Step 3: Additional actions
(Optional) Deploy a sample application to test your cluster and Windows nodes.
(Optional) If the AmazonEKS_CNI_Policy managed IAM policy (if you have an IPv4
cluster) or the AmazonEKS_CNI_IPv6_Policy
(that you created yourself if you have an IPv6
cluster) is attached to your Amazon EKS node IAM role, we recommend assigning it to an IAM role that you associate to the Kubernetes aws-node
service account instead. For more information, see Configure Amazon VPC CNI plugin to use IRSA.
We recommend blocking Pod access to IMDS if the following conditions are true:
You plan to assign IAM roles to all of your Kubernetes service accounts so that Pods only have the minimum permissions that they need.
No Pods in the cluster require access to the Amazon EC2 instance metadata service (IMDS) for other reasons, such as retrieving the current AWS Region.
For more information, see Restrict access to the instance profile assigned to the worker node.
RetroSearch is an open source project built by @garambo | Open a GitHub Issue
Search and Browse the WWW like it's 1997 | Search results from DuckDuckGo
HTML:
3.2
| Encoding:
UTF-8
| Version:
0.7.4