Skip to content

Merging node seems to not forward records into transformer node #424

@maciejniepokoj

Description

@maciejniepokoj

I found out, that merging node passes record through only if next node is an IProcessor. In hypothetical topology:

SOURCE 1 SOURCE 2
| |
\ /
MERGE
|
TRANSFORMER

All records will be ignored, nothing will reach the ITransformer. I believe it results directly from how AbstractProcessor<K, V> is implemented? My workaround is to add a mapper, that returns records without changing them, between merge and transformer.

I wrote and run a test using test driver:

test.txt
Unfortunately it passes without a problem.

I'm also attaching topology on which I observed this behavior:

topology.txt

And logs, from which I understand a record was forwarded from merge node (KSTREAM-MERGE-0000000014) to next node, but next node never received it:

logs.txt

Metadata

Metadata

Assignees

No one assigned

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions