Repository navigation
Conversation
…dlers - Streamline inditrans.cpp to coordinate streaming tokenization, lookahead, and output emission - Extract preservation policy (XML tags, skip blocks, marker filtering) into preservation_policy.h - Extract shared contextual rules (anuswara assimilation, ASCII numerals, Tamil traditional replacements) into contextual_handlers.h - Extract Gurmukhi adhak gemination logic into gurmukhi_handler.h - Extract Brahmic and Latin cluster assembly and grapheme emission into indic_handler.h and latin_handler.h - Extract Tamil phonology, allophones, superscripts, prefixes, and orthography into tamil_handler.h - Introduce token_stream.h for zero-overhead token discriminated union and streaming adapters - Add comprehensive handler unit tests in test-handlers.cpp - Update ARCHITECTURE.md to document the modular handler architecture and static dispatch - Rebuild WebAssembly, native shared library, and distribution artifacts
…dlers - Streamline inditrans.cpp to coordinate streaming tokenization, lookahead, and output emission - Extract preservation policy (XML tags, skip blocks, marker filtering) into preservation_policy.h - Extract shared contextual rules (anuswara assimilation, ASCII numerals, Tamil traditional replacements) into contextual_handlers.h - Extract Gurmukhi adhak gemination logic into gurmukhi_handler.h - Extract Brahmic and Latin cluster assembly and grapheme emission into indic_handler.h and latin_handler.h - Extract Tamil phonology, allophones, superscripts, prefixes, and orthography into tamil_handler.h - Introduce token_stream.h for zero-overhead token discriminated union and streaming adapters - Add comprehensive handler unit tests in test-handlers.cpp - Update ARCHITECTURE.md to document the modular handler architecture and static dispatch - Rebuild WebAssembly, native shared library, and distribution artifacts
- Revert benchmark default sweeps to 5 runs everywhere while retaining median aggregation - Add 10 Tamil workloads, Gurmukhi adhak, and ITRANS phonemic vowels to throughput and short-call benchmarks - Support per-case TranslitOptions in benchmark and short-call harnesses - Add cold-start benchmarks for Tamil to ISO and Devanagari - Add allocation probe modes for Tamil to ISO, Tamil to Devanagari, and Tamil superscript output - Add representative Tamil workloads to standalone WASM benchmarks - Add comprehensive feature tests covering Tamil contextual voicing, pulli, prefixes, numerals, and mixed Indic scripts
…ness in run-perf.py - Measure historical tags using persistent sparse worktrees under out/perf/worktrees/ - Compile historical engines against the current benchmark harness without modifying primary checkout - Remove workspace stash, checkout, and restore logic from tool/run-perf.py - Support optional source and output path overrides in standalone WASM builds - Track engine vs harness metadata and content fingerprint in perf_metadata.py - Add regression tests in tool/test_perf_worktree.py and update performance documentation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
1 participant
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
…dlers