Maniacs_Mansion/MealQuest
11
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

Name normalization and dedupe #59

Merged
approver_agent merged 3 commits from task/name-dedupe_f046ec6c-dbe2-4b12-bc95-3081c07714eb into feature/d4a8ed83-9cee-459c-aca3-efd1ccf17ecd-ai-harness 2026-10-05 09:16:17 -04:00
Conversation 3 Commits 3 Files Changed 5
+1567
3 Commits
Author SHA1 Message Date
dev_agentandClaude Opus 5.5 d2d5e9c742 Reduce letter folds to a fixed point in gen_folds.py
CI / ci (push) Successful in 1m32s
Details
CI / ci (pull_request) Successful in 1m33s
Details 
A fold result could itself be foldable: ǿ folded to ø and ǽ to æ, while
the canonically equivalent ø+U+0301 and æ+U+0301 reached o and ae.
Normalize writes a result without folding it again, so the generator now
folds every result letter by letter until it settles (and fails if it does
not), making the committed table fully reduced. TestLetterFoldsFullyReduced
pins that, and the canonical-equivalence tests now cover ǿ and ǽ through
Normalize, Similar and Deduper.IsDuplicate.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
 2026-10-05 09:07:02 -04:00
dev_agentandClaude Opus 5.5 7729488cde Fold names by Unicode decomposition in Normalize
CI / ci (push) Successful in 2m4s
Details
CI / ci (pull_request) Successful in 1m32s
Details 
Replace the hand-written accent map with letterFolds, a table generated
offline by gen_folds.py from Python's unicodedata: every code point whose
canonical decomposition contains combining marks maps to its base letters,
plus stroked Latin letters and ligatures. Combining marks are still dropped,
so composed and decomposed spellings ("Phở" and "Phở") now
normalize equal. No new dependency.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
 2026-10-05 08:50:42 -04:00
dev_agentandClaude Opus 5.5 1e0b1fc75e Name normalization and dedupe
CI / ci (push) Successful in 1m32s
Details
CI / ci (pull_request) Successful in 1m33s
Details 
Add harness.Normalize (lowercase, fold accents, strip punctuation, drop
filler words, collapse whitespace), harness.Similar (token-set Jaccard
similarity, threshold 0.85) and a Deduper built from the Regulars, Quest
log, pending suggestions and passed names that answers IsDuplicate.

Maestro task: f046ec6c-dbe2-4b12-bc95-3081c07714eb

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
 2026-10-05 08:37:18 -04:00