Support for stream processing tools such as Kafka and NSQ - #112

Merged

d-Rickyy-b merged 30 commits into

devfrom

Jul 13, 2026

Commits on Jul 6, 2026

docs: fix typo in docker-compose config
d-Rickyy-b
committed
bcfc0af
feat: first implementation for streaming proessors such as kafka
d-Rickyy-b
committed
6865b6b
chore: surround yaml strings by quotes
d-Rickyy-b
committed
8e7e430
docs: add missing options to sample config
d-Rickyy-b
committed
0fdcb45
fix: add missing imports and sort them
d-Rickyy-b
committed
6703a32
docs: add comments for config
d-Rickyy-b
committed
28bfc2a
feat: add certprocessor interface
d-Rickyy-b
committed
92d983a
feat: implement NSQ client
d-Rickyy-b
committed
e422401
refactor: remove unnecessary log
d-Rickyy-b
committed
66ba556
refactor: change "kafka" in comments to "nsq"
d-Rickyy-b
committed
38c53a1
fix: broken code due to rebase
d-Rickyy-b
committed
543b98b
refactor: multiple code fixes after rebase
d-Rickyy-b
committed
dea5349
refactor: fix typo
d-Rickyy-b
committed
d214a0c
refactor: fix config to use mapstructure
d-Rickyy-b
committed
52a5c91

Commits on Jul 7, 2026

feat: add compression options for kafka
d-Rickyy-b
committed
c178128
feat: batch kafka messages for efficiency
d-Rickyy-b
committed
0f96e59

Commits on Jul 10, 2026

refactor: split config into multiple individual files
d-Rickyy-b
committed
d66529c

Commits on Jul 12, 2026

refactor: rename config variable to cfg
d-Rickyy-b
committed
8fc04de
refactor: make stream type configurable for stream processing
d-Rickyy-b
committed
4d005db
refactor(nsqclient): improve formatting and error handling
d-Rickyy-b
committed
258a6c5
refactor(nsqclient): minor logic fixes
d-Rickyy-b
committed
4cd6c16
feat(nsqclient): add batch processing feature
d-Rickyy-b
committed
fec2d29
refactor(config.sample.yml): add new options to sample config
d-Rickyy-b
committed
f8ca66e
refactor: improve streamprocessing struct and methods
d-Rickyy-b
committed
0c52b42

Commits on Jul 13, 2026

feat: implement custom exponential backoff handler
d-Rickyy-b
committed
4cf6d25
feat(kafkaclient): improve error handling and logging
d-Rickyy-b
committed
4cbf903
chore: add task to run the server
d-Rickyy-b
committed
748cf7e
refactor: set default kafka batch size to 50
d-Rickyy-b
committed
8120312
docs: reformat and update changelog for 1.10.0
d-Rickyy-b
committed
0ddf935
refactor: rename broadcastmanager to dispatcher
d-Rickyy-b
committed
b5b5d11