Skip to content

Regenerate cli.json and command stubs for immutable create-only flags (preview) - #7318

Open
janniklasrose wants to merge 2 commits into
janniklasrose/cligen-immutable-create-flagsfrom
janniklasrose/cligen-immutable-regen
Open

janniklasrose wants to merge 2 commits into
janniklasrose/cligen-immutable-create-flagsfrom
janniklasrose/cligen-immutable-regen

Conversation

@janniklasrose

@janniklasrose janniklasrose commented Nov 3, 2026 •

Copy link
Copy Markdown
Member

Changes

Preview regeneration stacked on #7309: shows what cli.json and the generated command stubs look like once the genkit change (databricks-eng/universe#2777642) is in the spec and #7309's template consumes it. It exists so the user-visible effect can be reviewed now; it must be regenerated for real (and this description's provenance replaced) once #2777642 is on universe master and the Go SDK / .codegen/_openapi_sha are bumped past it.

Provenance of the committed cli.json: built with genkit update-sdk from universe e4c1445cc07c302f22726b5c84854e4ab661ad18 = current master (004d86d968ec4) + #2777642's genkit commit, using the spec built from that same tree. .codegen/_openapi_sha is deliberately left at the SDK's value (e70a2223…): TestConsistentDatabricksSdkVersion requires it to match the SHA the pinned Go SDK was generated from, and no SDK release exists for the simulated SHA yet. That is the one place this branch is knowingly inconsistent.

What changes for users

cli.json gains is_immutable (826) and is_crud_update (193) keys. With #7309's template, 15 flags disappear from 11 update-* commands across 6 services — fields the API refuses to change after create, so these flags never worked. No create flag changes; lakeview is untouched (its parent_path is still computed, see #5983).

Command Flags removed
account disaster-recovery update-failover-group --name
agent-kit update-memory --session-id, --source-type
agent-kit update-memory-store --display-name
agent-kit update-session --parent-session-id
ai-gateway update-mcp-service / update-model-provider-service / update-model-service / update-skill --name
domains update-domain --name, --parent-domain-id
environments update-default-workspace-base-environment --name
feature-engineering update-feature --filter-condition
feature-engineering update-materialization-set --materialization-set-id
feature-engineering update-materialized-feature --materialized-feature-id

The changelog fragment for this user-visible change lives here (moved out of #7309, which on its own changes nothing).

Spec drift, not part of this change

Because the simulated spec is newer than the SDK's, the regeneration also picks up unrelated upstream drift that a real bump would carry anyway: instance-pools node_type_id doc text, and bundle/schema/jsonschema.json launch-stage/description updates (ai_classify fields moving PRIVATE_PREVIEW → PUBLIC_BETA). They are kept so the committed generated outputs stay consistent with the committed cli.json (CI's generate-check regenerates from it). Expect these lines to differ in the real regen.

Why the changes are safe

  • Generated end-to-end through the real pipeline: genkit update-sdk → generate-clijson post-steps → generate-cligen, generate-refschema, generate-schema, generate-validation, generate-direct. pydabs-codegen could not run on the generating machine (PyPI host blocked); if the schema drift touches PyDABs output, CI's validate-generated will flag it and it gets regenerated there.
  • go build ./...; go test ./internal/cligen ./internal/clijson ./bundle/direct/dresources ./bundle/internal/schema pass.
  • Control run (keys stripped from this cli.json with jq, stubs re-rendered) differs from main only by the instance-pools doc string — the flag removals are attributable solely to the new keys.
  • No acceptance golden references the affected commands or flags.

Tests

Unit tests above. Stacked on #7309 (template) which is stacked on main; depends on databricks-eng/universe#2777642 for the real regen.

This pull request and its description were written by Isaac.

… (preview)

cli.json generated by genkit from universe e4c1445cc07c302f22726b5c84854e4ab661ad18 (master + the deco/genkit change that emits is_immutable and is_crud_update), then generate-cligen, generate-refschema, generate-schema, generate-validation and generate-direct. With the template change below this, 15 flags for immutable fields disappear from 11 update commands across 6 services; no create flag changes.

.codegen/_openapi_sha is intentionally left at the SDK's SHA so TestConsistentDatabricksSdkVersion holds; this branch is a preview to be regenerated once the genkit change is on master and the SDK is bumped past it. The instance-pools doc text and jsonschema.json launch-stage changes are unrelated spec drift carried by the newer spec.

Co-authored-by: Isaac <no-reply@databricks.com>
@janniklasrose
janniklasrose added this pull request to stack #7319 November 3, 2026 13:57
@janniklasrose janniklasrose changed the title janniklasrose/cligen immutable regen Regenerate cli.json and command stubs for immutable create-only flags (preview) Nov 3, 2026
Co-authored-by: Isaac <no-reply@databricks.com>
@github-actions github-actions Bot added the DABs DABs related issues label Nov 3, 2026
@janniklasrose
janniklasrose marked this pull request as ready for review November 3, 2026 14:01
@janniklasrose
janniklasrose requested review from a team as code owners November 3, 2026 14:01
@eng-dev-ecosystem-bot

Copy link
Copy Markdown
Collaborator

Integration test report

Commit: 6279755

Run: 41649344614

Env ✅​pass 🙈​skip Time
✅​ aws linux-2core-8gb 271 15 11:03
✅​ aws-windows-latest-4core-16gb 273 13 7:52
✅​ azure linux-2core-8gb 270 15 8:57
✅​ azure-windows-latest-4core-16gb 272 13 7:36
✅​ gcp linux-2core-8gb 271 15 9:30
✅​ gcp-windows-latest-4core-16gb 273 13 7:18
Top 9 slowest tests (at least 2 minutes):
duration env testname
7:29 azure-windows-latest-4core-16gb TestAccept
7:11 gcp-windows-latest-4core-16gb TestAccept
7:03 aws-windows-latest-4core-16gb TestAccept
4:22 aws linux-2core-8gb TestAccept
4:14 gcp linux-2core-8gb TestAccept
4:11 azure linux-2core-8gb TestAccept
3:18 gcp linux-2core-8gb TestFilerWorkspaceFilesExtensionsStat
2:36 aws linux-2core-8gb TestFilerReadWrite/workspace_files_extensions
2:31 aws-windows-latest-4core-16gb TestFilerRecursiveDelete/workspace_files

This branch has not been deployed

No deployments
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

DABs DABs related issues

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants