[jgrodziski]

Second step of the word cloud / glossary (#6), milestone M19a in PLAN.md §20. Stacked on #26: review that one first; this PR's diff is the four commits after it.

It adds a new package, @codegraph/vocabulary, that turns one name into the words it is made of, tags each word, and says how much a word weighs given what carries the name. Pure computation over the model's names (never source), depending on @codegraph/core alone. Nothing calls it yet: PR 3 aggregates over a model with it, PR 4 adds the CLI command.

Splitting a name

splitIdentifier(name, kind, lexicon) → {tokens, numeric, conventional}.

• A name the language dictates (toString, __init__, handle_call) gives no word, and says so.
• A kind in the lexicon's fileKinds loses its extension (order_service.rb → order_service); a leading dot (.eslintrc) is not one.
• C#'s interfacePrefix drops the I of IOrderService, never of IO or IOError.
• Every character that is not a letter, mark or digit breaks a word, so <=>, this[], :: and / need no per-language separator list.
• Camel-case boundaries on Unicode categories: lower → Upper, digit → Upper, and HTTPServer → http, server. Digits stay with their word (utf8, i18n); a piece of digits only is dropped and counted in numeric. A caseless letter (注, 𠀀) counts as lower; a combining mark never splits.

Tests: a hand table per language (all eleven), the fixtures/unicode corpus (no U+FFFD, no lone surrogate), and fast-check properties (words only, lowercase, slices of the lowered name, deterministic, a + sep + b splits as a then b, conventional names give nothing). Removing the acronym rule fails 8 tests, removing the interface prefix fails 10.

Classifying a word

createClassifier(lexicon, technical?) tags each word, in this order:

1. keyword: the lexicon reserves it. A keyword that is not a word (Ruby __FILE__) can never match, so the file of upload_file stays a domain word.
2. short: one letter or digit, counted in code points. id, io, db are words.
3. technical: the shared DEFAULT_TECHNICAL list (125 words, the PLAN seed included) ∪ the profile's own technical.
4. domain: everything else.

Nothing is filtered: a consumer decides what to show (PLAN §20 principle 3). The shared list is overridable whole; the profile's own words still apply.

Shared words moved out of the profiles. Eleven words some profiles listed are plumbing in every language: args, async, callback, ctx, err, json, mixin, mutex, opts, repo, str. They now live once in DEFAULT_TECHNICAL, and a test keeps it disjoint from every profile's own list. Without the move, a Java corpus would count args and json as domain words. (repo was Elixir's alone; it moved because repository is already shared. The commit body of 60c3148 says otherwise, wrongly.) The website profiles page is regenerated.

Roles and weights

roleOf(entity, slots) reads the role from traits, never the kind, first match wins: TModule → module, TType → type, TInvocable → operation, TStructural → parameter / local / attribute (by whether some entity's parameters or localVariables lists it), else other. A property test pins that the kind is never read.

role	module	type	attribute	operation	parameter	local	other
weight	8	8	4	3	1	1	1

• A seventh role, other. Five shipped kinds have no role trait: clj:implBlock, php:codeFile, python:decorator, rust:impl, ts:namespace. Three of them are named, and every name's words count, so they weigh 1. One consequence: a PHP code file weighs 1, while Ruby and Elixir files weigh 8 as modules, because that is what their traits say.
• A gap in the C# model. The parameter of the indexer this[int index] is a child of its property, and the C# profile gives a property no TWithParameters, so no list names it and it weighs as an attribute. The fixture test pins that one id rather than guessing from the kind; the fix belongs in the C# profile and extractor.

Also

• eslint.config.js: the package is inside the no-DOM boundary; CLAUDE.md lists it with core, analyzer, city, navigator.
• PLAN §20.1 and §20.4 describe what was built; the M19a checklist splits off aggregate.ts, artifact.ts and drift.ts as still to do.

Verification

• pnpm -r build and pnpm -r typecheck green; lint clean on touched files; pnpm run gen:schemas leaves schemas/ unchanged.
• vocabulary 183 tests, core 539, cli 907, every other package passes, except the two local-machine failures noted on feat(core): language lexicons on profiles (M19a) #26 (Node 26 no longer warns on node:sqlite; the explain no-key test with OPENROUTER_API_KEY set).

Part of #6.

🤖 Generated with Claude Code

[cloudflare-workers-and-pages]

Deploying with    Cloudflare Workers

The latest updates on your project. Learn more about integrating Git with Workers.

Status	Name	Latest Commit	Preview URL	Updated (UTC)
✅ Deployment successful! View logs	codegraph	c5bfa7a	Commit Preview URL Branch Preview URL	Oct 23 2026, 10:54 PM