Repository navigation
Open
Labels
area:platformSDKs, CLIs, APIs, gateway infrastructure, persistence, configuration, and session management.SDKs, CLIs, APIs, gateway infrastructure, persistence, configuration, and session management.state:acceptedA maintainer decided OpenShell should pursue this issueA maintainer decided OpenShell should pursue this issuetopic:documentationArchitecture docs, READMEs, project website updates, and automated documentation generation.Architecture docs, READMEs, project website updates, and automated documentation generation.topic:kubernetesKubernetes operators, CRDs, deployment controllers, and native Kubernetes API integration.Kubernetes operators, CRDs, deployment controllers, and native Kubernetes API integration.topic:observabilityLogs, metrics, traces, telemetry, dashboards, event correlation, and operational data export.Logs, metrics, traces, telemetry, dashboards, event correlation, and operational data export.topic:operabilityInstalling/configuring deployments, upgrades, backup/restore, diagnostics, and maintenance.Installing/configuring deployments, upgrades, backup/restore, diagnostics, and maintenance.topic:reliabilityHigh availability, recovery, retries, graceful degradation, and correctness across restarts.High availability, recovery, retries, graceful degradation, and correctness across restarts.topic:sdk:goGo SDK implementation, maintenance, interfaces, and distribution.Go SDK implementation, maintenance, interfaces, and distribution.topic:sdk:pythonPython SDK implementation, maintenance, interfaces, and distribution.Python SDK implementation, maintenance, interfaces, and distribution.topic:sdk:rustRust SDK implementation, maintenance, interfaces, and distribution.Rust SDK implementation, maintenance, interfaces, and distribution.topic:sdk:typescriptTypeScript SDK implementation, maintenance, interfaces, and distribution.TypeScript SDK implementation, maintenance, interfaces, and distribution.topic:testingUnit, integration, regression, conformance, E2E tests, coverage, flakes, and test infrastructure.Unit, integration, regression, conformance, E2E tests, coverage, flakes, and test infrastructure.
Description
Follow-ups to #3661, part of #3528. One PR per line (one per SDK for the SDK line). Each PR gets its own narrow issue with the details. The earlier long write-up is in this issue's edit history.
- Placement metrics: redirects by reason, off-ring admissions, ring size (feat(server): export supervisor session placement metrics #4688, PR feat(server): export supervisor session placement metrics #4692)
- HA e2e checks that a session lands on its ring owner (ha-tls lane, needs feat(server)!: harden gateway peer transport and expand HA conformance #3825)
- Replica-routing e2e on Envoy Gateway, covering direct routing and the unrouted retry (agentgateway is on hold since feat(helm): add agentgateway ingress support #3714 closed)
- Every SDK (Rust, Go, TypeScript, Python) asks for the owner and sends the replica hint, like the CLI
-
ssh-proxyreuses the owner the CLI already has instead of callingGetSandboxon every connection - The chart skips the
openshell-dataPVC whenserver.externalDbSecretis set - Ring membership survives a hung database call and clock skew between replicas
- The HA docs say when to run a StatefulSet (replica routing) and which sandboxes get the shutdown handoff
Not covered here: pacing the shutdown handoff and rebalancing sessions after a scale-up, both in the #3528 checklist, and closing admission on open HTTP/2 connections at shutdown (#3551).
Metadata
Metadata
Labels
area:platformSDKs, CLIs, APIs, gateway infrastructure, persistence, configuration, and session management.SDKs, CLIs, APIs, gateway infrastructure, persistence, configuration, and session management.state:acceptedA maintainer decided OpenShell should pursue this issueA maintainer decided OpenShell should pursue this issuetopic:documentationArchitecture docs, READMEs, project website updates, and automated documentation generation.Architecture docs, READMEs, project website updates, and automated documentation generation.topic:kubernetesKubernetes operators, CRDs, deployment controllers, and native Kubernetes API integration.Kubernetes operators, CRDs, deployment controllers, and native Kubernetes API integration.topic:observabilityLogs, metrics, traces, telemetry, dashboards, event correlation, and operational data export.Logs, metrics, traces, telemetry, dashboards, event correlation, and operational data export.topic:operabilityInstalling/configuring deployments, upgrades, backup/restore, diagnostics, and maintenance.Installing/configuring deployments, upgrades, backup/restore, diagnostics, and maintenance.topic:reliabilityHigh availability, recovery, retries, graceful degradation, and correctness across restarts.High availability, recovery, retries, graceful degradation, and correctness across restarts.topic:sdk:goGo SDK implementation, maintenance, interfaces, and distribution.Go SDK implementation, maintenance, interfaces, and distribution.topic:sdk:pythonPython SDK implementation, maintenance, interfaces, and distribution.Python SDK implementation, maintenance, interfaces, and distribution.topic:sdk:rustRust SDK implementation, maintenance, interfaces, and distribution.Rust SDK implementation, maintenance, interfaces, and distribution.topic:sdk:typescriptTypeScript SDK implementation, maintenance, interfaces, and distribution.TypeScript SDK implementation, maintenance, interfaces, and distribution.topic:testingUnit, integration, regression, conformance, E2E tests, coverage, flakes, and test infrastructure.Unit, integration, regression, conformance, E2E tests, coverage, flakes, and test infrastructure.
Activity
[-][WIP] feat(ha): follow-ups to consistent-hash session placement (#3661)[/-][+]feat(ha): follow-ups to consistent-hash session placement (#3661)[/+]EmilienM commentedon Oct 14, 2026
Quick update: #3714 closed without merging, so the agentgateway half of the replica-routing line is on hold until another agentgateway PR shows up. The Envoy Gateway variant still stands.
feat(sdk): route Rust SDK exec to the sandbox owner replica
feat(sdk): route Go SDK exec and forward to the sandbox owner replica
refactor(sdk): address Go replica routing review
feat(sdk): route Rust SDK exec to the sandbox owner replica
feat(sdk): route Go SDK exec and forward to the sandbox owner replica
refactor(sdk): address Go replica routing review
9 remaining items
feat(sdk): route Python SDK exec to the sandbox owner replica (NVIDIA…
feat(server): export gateway ring membership size
feat(sdk): route TypeScript SDK exec and forward to the sandbox owner…
feat(server): export gateway ring membership size