Question
LTIMindtree
IN
Last activity: 18 May 2023 4:24 EDT
How to verify data flow is fetching kafka message from topic where can we see the message details
Hi All, I have configured a data flow which executes a dataset to fetch the kafka message in the start shape of data flow, and in the end shape of the data flow I have configured an activity to create a work object based on the data received on start shape data set.
Here the issue is I am unable see the kafka message data whether data flow fetch the message or not, I am unable to trace the either dataflow or activity.
Is there a way to to check kafka message whether dataflow fetching the data or not?
Accepted Solution
Updated: 18 May 2023 4:22 EDT
Bits in Glass
IN
@VeerendraC Configure-> Decisioning-> Decisions-> Data flows-> Real time processing.
You will see your real time data flow here and whenever a message in the topic is consumed you will see the count getting increased.
If you want the message data to debug-> you can extract the message in your activity and log that entry.
But you can run your data set standalone if you just want to check the data which is consumed.
LTIMindtree
IN
Yes logging the message is one approach for testing the message structure in lower environment and in higher environmetn we are not supposed to expose the critical data into log files.