Add anonymizer tool

[sfraczek]

Introduces etradeAnonymizer — a Rust binary and anonymizer module for anonymizing E*TRADE / Morgan Stanley PDF statements while preserving data needed for tax calculations.

Subcommands

• list <input.pdf> — lists all text tokens from FlateDecode/uncompressed streams (debugging/inspection).
• anonymize <input.pdf> [output.pdf] — replaces PII with stable numeric tokens; output defaults to anonymous_<input>.pdf.

How it works

• Operates directly on PDF streams (FlateDecode and uncompressed with an explicit /Length, PDF 1.3).
• Preserves calculation-relevant text: strings containing CLIENT STATEMENT / For the Period, and everything between CASH FLOW ACTIVITY BY DATE and NET CREDITS/(DEBITS) (inclusive).
• In-place replacement that keeps the exact original stream size (recompression + null-byte padding), so the PDF XREF table stays valid without full re-parsing.

Module layout

• list.rs, replace.rs (engine: replace_pii_smart), path.rs, pdf.rs. No separate detect module/mode.

Testing

• Unit tests run in CI (PDF token scanning, escape/unescape, output path handling).
• 5 integration tests are marked #[ignore] — they require local plain PDF fixtures in anonymizer_data/ (git-ignored) and do not run in CI.

Notes

• No openssl dependency, no bundled encrypted fixtures, no ANONYMIZER_TEST_KEY in CI.
• Not a guarantee of complete PII removal — output should be reviewed manually before sharing.

[Copilot]

Pull request overview

This PR introduces a new Rust-based “etradeAnonymizer” tool within the existing crate, aimed at detecting and replacing PII in (a constrained subset of) PDF statement streams while preserving original stream byte lengths to avoid rebuilding XREF offsets.

Changes:

• Adds a new etradeAnonymizer binary with list and anonymize subcommands.
• Implements PDF stream scanning/text token extraction plus “smart” token-preserving replacement with size-fitting recompression and padding.
• Updates project metadata and dependencies to support the new functionality (e.g., flate2, sha2) and ignores local PDF fixtures.

Reviewed changes

Copilot reviewed 10 out of 12 changed files in this pull request and generated 8 comments.

Show a summary per file

File	Description
src/lib.rs	Exports the new anonymizer module from the crate root for library/tests/binary access.
src/anonymizer/mod.rs	Defines the anonymizer module structure and re-exports submodules.
src/anonymizer/anonymizer.rs	Adds the new CLI binary entry point and subcommand routing.
src/anonymizer/pdf.rs	Implements strict PDF header validation, stream scanning, and token extraction/unescaping utilities.
src/anonymizer/replace.rs	Implements smart anonymization by token replacement with recompression-to-fit and padding.
src/anonymizer/list.rs	Adds a “list tokens” mode for inspecting extracted text tokens per stream.
src/anonymizer/path.rs	Adds helper for generating default anonymized output filenames.
src/anonymizer/README.md	Documents usage, strategy, limitations, and local-only testing workflow.
README.md	Updates SPDX copyright year range.
Cargo.toml	Registers the new binary and adds required dependencies.
Cargo.lock	Updates the lockfile to include new/updated dependency versions.
.gitignore	Ignores local PDF fixtures for offline integration testing.

---

💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

[Copilot]

Pull request overview

Copilot reviewed 10 out of 12 changed files in this pull request and generated 3 comments.