Skip to content

feat(algebraic): add dynamic projections and adaptive HLL cardinality - #509

Merged
ajroetker merged 14 commits into
mainfrom
feature/algebraic-core
Aug 20, 2026
Merged

ajroetker merged 14 commits into
mainfrom
feature/algebraic-core

Conversation

@ajroetker

@ajroetker ajroetker commented Aug 18, 2026 •

Copy link
Copy Markdown
Contributor

What changed

  • uses hash-set membership and single-pass evaluation for exact cardinality constraints
  • projects bounded dynamic-template fields into typed algebraic docfacts
  • gates dynamic-field acceleration and static projection changes until replacement projections are durably ready
  • adds HLL sketches with exact, approximate, and automatic cardinality selection
  • supports array-valued grouping/value fields with set semantics
  • adds bounded, durable adaptive HLL promotion and resumable backfill
  • hardens sketch decoding, estimate saturation, configuration validation, lifecycle ownership, and missing-sketch behavior
  • registers the HLL test module in the authoritative storage test manifest
  • regenerates the OpenAPI and Go, TypeScript, and Python SDK contracts

Why

This keeps the independently extracted algebraic performance, dynamic projection, and HLL work from the larger #145 branch in one reviewable PR. It remains separate from memory-backend snapshots, relational storage, SQL, and graph metrics.

Impact

Exact cardinality evaluation performs less allocation and repeated traversal. Eligible dynamic-template fields participate in typed algebraic projection, while cardinality queries can use maintained HLL sketches without exposing partial or stale adaptive backfills.

Validation

  • dynamic projection/cardinality safety target — 40/40 passed
  • focused HLL tests — 9/9 passed
  • storage test-shard audit passed
  • root suites — 229/229 and 36/36 passed
  • Go, TypeScript, and Python SDK checks passed
  • HLL benchmark smoke completed successfully
  • git diff --check passed

@ajroetker
ajroetker force-pushed the feature/algebraic-core branch 2 times, most recently from 030c2b3 to 9ef1920 Compare August 19, 2026 06:25
@ajroetker
ajroetker force-pushed the feature/algebraic-core branch from 9ef1920 to 04a5a85 Compare August 19, 2026 16:45
@ajroetker ajroetker changed the title feat(algebraic): optimize cardinality and project dynamic templates feat(algebraic): add dynamic projections and adaptive HLL cardinality Aug 19, 2026
@ajroetker
ajroetker marked this pull request as ready for review August 20, 2026 00:07
@ajroetker
ajroetker merged commit 6982dc3 into main Aug 20, 2026
17 of 18 checks passed
@ajroetker
ajroetker deleted the feature/algebraic-core branch August 20, 2026 01:53
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant