Repository navigation

feat(engine): Batch trigger reloaded - #2779

Merged

ericallam merged 35 commits into

mainfrom

feat/batch-trigger-v2

Dec 16, 2025

Merged

feat(engine): Batch trigger reloaded#2779
ericallam merged 35 commits into
mainfrom
feat/batch-trigger-v2

Commits on Dec 15, 2025
- WIP
  ericallam
  committed
  0550658
- some fixes
  ericallam
  committed
  7b5056b
- fair queue baby
  ericallam
  committed
  ceddba0
- wip of the streaming batch trigger stuff
  ericallam
  committed
  c1743bb
- new async iterable version of batch trigger
  ericallam
  committed
  8a9532d
- pnpm lock changes
  ericallam
  committed
  fdbed14
- add new batch status to api schema
  ericallam
  committed
  98a5709
- Handle large payloads and correct the trace ID propogation to child runs
  ericallam
  committed
  f066ae5
- record when the batch processing is completed
  ericallam
  committed
  8552b3d
- more batch processing work
  ericallam
  committed
  d72068c
- better dequeuing from fair queue
  ericallam
  committed
  d55dbb4
- fixed tests and removed the run number incrementor from the run engine trigger pipeline
  ericallam
  committed
  08eb6dd
- restructure the batch queue callbacks to prevent circular import
  ericallam
  committed
  7c85267
- handle batch failures more reliably
  ericallam
  committed
  f3354b1
- Better handling of batches when sealed = false
  ericallam
  committed
  00d5428
- improve completion tracker callback calling and cleanup
  ericallam
  committed
  4d76367
- Add unique index to batch task run errors on the index field and more efficiently create errors in the completion callback
  ericallam
  committed
  6c6de84
- batch task run seal update is atomic
  ericallam
  committed
  d69cfa5
- better ndjson parsing with bounded memory usage
  ericallam
  committed
  5b8ec88
- release concurrency slot when moving to the DLQ
  ericallam
  committed
  5211ba6
- Fix fair queue heartbeat
  ericallam
  committed
  f592aac
- fixed batch payload handling
  ericallam
  committed
  1610766
- capture and pass the planType through to triggering
  ericallam
  committed
  da247bf
- should preserve runFriendlyId across retries when RunDuplicateIdempotencyKeyError is thrown
  ericallam
  committed
  b77c910
- better handling streaming ndjson retries
  ericallam
  committed
  02eec34
- Better batch friendly ID parsing errors
  ericallam
  committed
  8f1619b
- only parse payloads when they are application/json
  ericallam
  committed
  82da484
- fix batch queue redis config
  ericallam
  committed
  7e073b4
- cancel read stream before releasing lock
  ericallam
  committed
  a5791a0
- Add changeset
  ericallam
  committed
  628a7d2
- Fix stream batch items test
  ericallam
  committed
  fce7874
- all tests should use root vitest
  ericallam
  committed
  e78b619
- fix issue with swallowing batch completion error in the callback
  ericallam
  committed
  8d67a4b
Commits on Dec 16, 2025
- fix batch list page navigation
  ericallam
  committed
  0ee90f7
- a couple tweaks
  ericallam
  committed
  a0d0d19

Commits

Commits on Dec 15, 2025

Commits on Dec 16, 2025