2025-05-03

hierarchical clustering of chinese characters for chunked learning

this document describes a tree-building procedure for organizing simplified chinese characters into semantically meaningful, size-balanced clusters suitable for incremental learning.

the method combines fixed parent-child relationships with dynamic structural adjustments to preserve subgroup integrity while managing group size. techniques include priority-based root selection, demotion of overloaded components, fan-out of large subtrees, and optional merging of small groups.

1. introduction

chunked character learning benefits from groupings that are:

  • semantically coherent
  • reasonably bounded in size
  • distinct and non-overlapping this algorithm builds a directed tree over a character set using component data to generate such groupings, emphasizing:
  • cohesion: prioritizing complete subtrees under shared components
  • distinctiveness: avoiding semantic flattening under common radicals
  • distribution: balancing group sizes for manageable learning sessions

2. algorithm structure

2.1 data ingestion

input data consists of (parent, character, pronunciation) triples. the ingestion phase constructs:

  • children: direct parent → child proposals
  • pinyin: character → pronunciation
  • cand: character → candidate parent list
  • pot: parent → all characters listing it as candidate

2.2 parent assignment

phase 1: subtree claiming

  • priority forms and sufficiently connected parents claim all of their unassigned children at once
  • a group is only claimed if:

    • the parent is in a priority set
    • or the candidate group meets a minimum size and is not over capacity
    • and the parent is not on a demotion list (unless prioritized)

phase 2: greedy assignment

  • remaining characters are assigned to the best available parent based on:

    • avoiding demoted components
    • minimizing existing cluster size
    • favoring phonetic or semantic coherence

2.3 cluster adjustment

2.3.1 merging small roots

  • roots with fewer than a minimum threshold of children are absorbed into compatible larger parents
  • this avoids fragmentation and aligns residual characters with meaningful groupings

2.3.2 fan-out of large roots

  • any root with size > max_size is scanned for direct children that form large enough subtrees
  • these children are promoted to root status
  • this avoids excessive cluster size while maintaining structural clarity

2.4 output structure

after normalization, the system outputs:

  • children_map: parent → list of assigned children
  • pinyin_map: character → pronunciation
  • roots: characters not assigned as children (top-level groups)
  • size_map: subtree size for each node

3. results

run on a corpus of 8141 simplified characters, the system produced:

  • total root groups: 378
  • mean cluster size: ~22
  • median size: ~16
  • largest cluster: 69
  • priority roots retained complete subtrees
  • demoted radicals avoided dominance
  • small phonetic subgroups were preserved where appropriate
  • wildcard bucket was disabled; all nodes placed meaningfully

4. promoted and demoted characters

example character selections for promotion as root and demotion.

promoted components

朵 殳 圣 吴 召 奈 青 齐 步 𢀖 咅 否 音 至 亲 吉 㕛 台 另 古 去 妾 辛 尗 责 育 幸 舌 君 支 亘 旦 瓜

these characters were prioritized during parent selection. when eligible, they were allowed to form their own root groups and claim all their candidate children. the selection includes:

  • commonly reused semantic or phonetic bicomponents
  • visually distinct forms that support chunked recognition
  • characters suitable as mnemonic anchors for subtrees

demoted components

氵 忄 讠 饣 扌 刂 阝 扌 犭 纟 钅 忄 彳 衤 灬 罒 亻 冫 月 牜 礻 𧾷 口 土 人 木

these components were penalized or excluded from root status unless explicitly prioritized. demotion was applied to:

  • small graphical affixes whose presence might obscure rather than reveal structure for learners
  • highly frequent radicals prone to producing oversized, semantically diffuse groups

demoted forms were still permitted as internal components and as part of subtrees, but they were disfavored in root selection to preserve semantic coherence and manage group size.

5. notes

  • the method does not guarantee minimal depth or uniqueness of internal structure; it emphasizes semantic group utility over strict hierarchy.
  • component demotion and prioritization are customizable.
  • grouping choices balance pedagogical value with structural constraints rather than linguistic etymology.