Hi , We have a requirement for Realtime event processing where for each transaction event we need to create case and call subsequent API call based on data we received from Source system. 

We implemented that via Kafka topic and created Data flow  where we configured Kafka data set as our source , Then used Convert shape for mapping data elements and then finally used Activity as our destination shape to create case and further API processing.

 While running the data flow in real time  we see no failures and all steps returned success , but the case creation not happening. Also we tried just to see if logs getting printed or not, that even not happening. When stand alone running case creation activity - it successfully creating cases. 

Stand alone ran the data set and saw values are returned in proper format which we implemented in convert shape , but through DDF its not processing data.

Can someone suggest an approach to trace this real time data flow for any particular/single Transaction event ?  stand alone DDF run also not helped to debug as its same as real time trace events.

Attached the Doc for my processes and its configurations. Please let me know how to debug further to know why case not getting created via DDF .

Thank you

JB.