I’m facing an issue with a Data Flow where the source is a Kafka Data Set. The data flow runs through three components: Source, Filter, and Destination (Activity).

Each component shows success when I run the data flow. However, the issue is that the Activity configured in the Destination is not actually getting executed.

Here’s the detailed setup and observations:

The source Kafka data set is working fine and filtering is also happening correctly.

The Destination is configured to call an Activity.

In the first step of the activity, I have added a logger (to verify if the activity runs), but nothing appears in the logs.

I also tried calling a Data Transform instead of the activity and added logging there too — but again, no logs were generated.

It seems like the execution part (Activity / Data Transform) is not being triggered, even though the data flow execution shows success across all components.

There are no errors in the data flow run details or in the logs.

I also ensured that:

The class of all rules (data flow, data set, activity, and data transform) is the same (Work- class). The ruleset is the same for all rules.

I also plan to enable the logger specifically for the data flow to capture more details, but as of now, there’s no visible error or log entry related to this issue.

Has anyone faced a similar situation where the data flow runs fine but the activity or data transform at the destination doesn’t execute?

Any pointers or suggestions would be appreciated....