Skip to content

feat: parallel scatter, composite keys, LIST prune, plan-cache redistribute - #61

Merged
renecannao merged 3 commits into
fix/shard-prune-pg-docsfrom
feat/shard-parallel-composite-move
Aug 20, 2026
Merged

feat: parallel scatter, composite keys, LIST prune, plan-cache redistribute#61
renecannao merged 3 commits into
fix/shard-prune-pg-docsfrom
feat/shard-parallel-composite-move

Conversation

@renecannao

Copy link
Copy Markdown
Collaborator

Summary

  • Flatten UNION ALL remotes so N shards open in parallel, not just the innermost pair.
  • Composite HASH keys (col1+col2), fail-closed unknown tables, and shard-key UPDATE that moves the row.
  • LIST misses no longer route to shard 0; BETWEEN/IN prune mapped values. Composite colocated joins push when every key part is equated.
  • Plan cache stores the logical plan and re-distributes on each hit so a later ShardMap change is not stale.

Stacked on #60 (fix/shard-prune-pg-docs).

Test plan

  • ./run_tests --gtest_brief=1 — 1341 passed, 39 skipped
  • New coverage: n-ary UNION ALL, composite INSERT/SELECT/join, LIST miss + BETWEEN, plan-cache remap

…ribute

Flatten UNION ALL remotes so N shards open together. Route composite HASH
keys, fail unknown tables, and move rows on shard-key UPDATE. LIST misses
fail closed and BETWEEN/IN prune; composite colocated joins push when every
key part is equated. Cache the logical plan and re-distribute on each hit.
@coderabbitai

coderabbitai Bot commented Aug 19, 2026

Copy link
Copy Markdown

Important

Review skipped

Auto reviews are disabled on base/target branches other than the default branch.

Please check the settings in the CodeRabbit UI or the .coderabbit.yaml file in this repository. To trigger a single review, invoke the @coderabbitai review command.

⚙️ Run configuration

Configuration used: Organization UI

Review profile: CHILL

Plan: Pro Plus

Run ID: c68b3bf3-4c0d-4e2c-93cf-9e93fdfa2200

You can disable this status message by setting the reviews.review_status to false in the CodeRabbit configuration file.

Use the checkbox below for a quick retry:

  • 🔍 Trigger review

Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out.

❤️ Share

Comment @coderabbitai help to get the list of available commands.

- Composite RANGE now routes and prunes on the first key component
  (LIST still rejects composites; HASH uses all parts).
- Semi-join prune: when one side of a join is sharded and the other is
  not, the engine materializes the small side and pushes an IN-list
  onto the sharded probe side.
- New demo scripts for PostgreSQL shards (16432/16433) exercising
  RANGE + LIST + cross-shard 2PC with DistributedTransactionManager
  in POSTGRESQL mode.
- sqlengine now auto-selects PostgreSQL 2PC dialect when all backends
  are pgsql://.
- Added planner and live-backend tests; full suite now 1344 passed.

Stacked on PR #61.
…range

feat: composite RANGE, semi-join prune, PG LIST/RANGE + 2PC demo
@renecannao
renecannao merged commit ff941ac into fix/shard-prune-pg-docs Aug 20, 2026
1 check passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant