SageMaker AI Spaces on EKS brings IDEs into Kubernetes clusters

Amazon EKS cluster concept with JupyterLab, Code Editor and Cognito access for SageMaker AI Spaces.

AWS puts managed ML workspaces inside EKS clusters​

AWS has detailed how its SageMaker AI Spaces add-on can run managed JupyterLab and Code Editor environments directly on Amazon EKS. The approach targets machine learning teams that already operate Kubernetes clusters for training, storage and access control. AWS says the add-on can reduce the gap between pipeline infrastructure and interactive development, while adding browser, VS Code and corporate identity access paths. The trade-off is that teams must handle EKS, networking, IAM, certificate and cost controls with care.

A managed IDE layer for existing EKS clusters​

AWS presents SageMaker AI Spaces for Amazon EKS as a way to keep interactive machine learning work inside the same cluster that hosts training pipelines. The source says the add-on runs managed JupyterLab and Code Editor environments on the EKS cluster a team already operates, instead of pushing data scientists toward a separate JupyterHub installation or local laptop.

The operational problem is concrete: when notebook work leaves the cluster, developers may lose direct access to GPU nodes, shared storage and IAM roles used by their pipelines. AWS estimates that standing up a standalone JupyterHub environment with GPU access, storage and authentication typically takes a platform team 3-5 days, while a data scientist can launch a configured Space in about 5 minutes with the add-on. That estimate is vendor-supplied, but it identifies the intended market: teams trying to reduce duplicated ML environments rather than replace Kubernetes operations.


Architecture combines access, routing and storage controls​

The AWS design uses one EKS cluster with three main layers: network access, cluster routing, and compute plus storage. Route 53 resolves a wildcard domain to an internet-facing Application Load Balancer with TLS from AWS Certificate Manager, while VS Code remote access uses AWS Systems Manager tunnels directly to the Space pod.

Inside the cluster, the AWS Load Balancer Controller provisions the ALB, Traefik routes by hostname, and auth middleware validates tokens using AWS Key Management Service for JSON Web Token encryption. Space pods run on private-subnet workers. Persistent storage can come from the Amazon EBS CSI driver, while Amazon EFS or Amazon FSx can handle shared or high-throughput storage. EKS Pod Identity grants scoped IAM roles to pods, making identity design part of the deployment rather than an afterthought.

AWS also lists prerequisites that limit where the add-on fits. The walkthrough calls for Kubernetes 1.30 or later, kubectl 1.30 or later, Helm v3, a Route 53 public hosted zone, and IAM permissions to create roles, policies, EKS add-ons, access entries, Pod Identity associations, ACM certificates and KMS keys. The source says the Spaces add-on must be version 0.1.4 or later, because earlier versions supported Amazon SageMaker HyperPod only.


Browser and VS Code access use separate connection models​

For browser access, the Spaces controller issues a short-lived presigned URL that carries the user token. AWS says the presigned URL contains a KMS-encrypted JWT with a 5-minute expiry enforced by the exp claim, and that this value is not configurable in the current add-on version.

The VS Code path is different. AWS describes a vscode:// deep link that lets the AWS Toolkit establish an SSH-over-SSM tunnel to the Space, attaching VS Code to the remote filesystem. The source says this route does not require a browser, domain or ALB, which makes it relevant for private-subnet setups or teams that prefer local editor workflows.

Access mode still matters. In the example workspace definition, OwnerOnly restricts browser access to the IAM principal that created the Space, while Public allows any namespace-authorized user. That distinction makes namespace authorization and workspace ownership central to how teams separate shared development from individual sessions.


Corporate sign-in depends on OIDC and RBAC mapping​

AWS describes an IAM-based starting point, then shows how teams can move toward corporate credentials through OpenID Connect. In the IAM model, access is granted through an EKS access entry scoped to a namespace, which limits users from reaching resources outside that namespace.

For OIDC sign-in, the source points to the open source jupyter-deploy project and its aws-eks-oidc template. Dex runs in the cluster as the OIDC provider, Amazon EKS trusts it as an identity provider, and a web console gives users self-service workspace management. AWS says the template provisions its own VPC and cluster, so it should run alongside the cluster from the main walkthrough rather than be applied as a small configuration change.

Amazon Cognito requires specific claim handling in this setup. AWS says EKS reads the username from preferred_username, which Cognito does not issue, so it must be mapped from email. Cognito also publishes group membership as cognito:groups rather than groups. If teams miss those mappings, authorization can fail in ways that look like session problems rather than clear access denials.


Cost and security caveats remain material​

AWS frames consolidation as a utilization and operations benefit, but the same source highlights costs. The walkthrough says the resources created can incur charges for an internet-facing ALB, EBS volumes and an EKS cluster. It also says the SSM advanced-instances tier adds about $0.00695 per hour per Space pod, and that skipping cleanup can leave charges running for the cluster, node group, EBS volumes, ALB and registered hybrid instances.

The vendor estimate on utilization is also qualified. AWS says consolidating interactive and training workloads on one cluster can lift GPU utilization by up to 30 percent compared with a dedicated notebook fleet, and can avoid an always-on GPU environment that may cost thousands of dollars a month. Those are AWS statements, not independent benchmarks, so teams should compare them against their own cluster schedules, node types and notebook usage.

Security controls are spread across the setup. AWS advises minimum-action Pod Identity roles, namespace-scoped access over cluster-wide policies, keeping ACM DNS validation CNAME records in Route 53 for renewal, and avoiding logging or sharing presigned URLs over unencrypted channels. The implication is straightforward: the add-on can reduce environment sprawl, but it does not remove the need for platform engineering discipline.


Conclusion​

SageMaker AI Spaces on Amazon EKS is AWS's attempt to bring managed interactive IDEs closer to the Kubernetes infrastructure already used for ML workloads. The strongest practical change is not just JupyterLab on EKS, but the combination of managed workspaces, SSM-based VS Code access, namespace-aware authorization and optional OIDC sign-in.

For platform teams, the decision depends on whether the reduced separation between notebooks and pipelines outweighs the added AWS service dependencies. The source supports a clear use case for ML organizations already standardized on EKS, but the cost, identity and networking requirements make it a planned infrastructure rollout rather than a simple notebook feature.


Sources​


Editorial Team - CoinBotLab
  • Reading time 5 min read
  • Views3
  • Reading time 5 min read
  • Views4
  • Reading time 5 min read
  • Views5
  • Reading time 5 min read
  • Views7
  • Reading time 4 min read
  • Views13
  • Reading time 5 min read
  • Views13

Comments

There are no comments to display

Information

Author
CoinBotLab AI Editor
Published
Reading time
6 min read
Views
5

More by CoinBotLab AI Editor

Top