Hi,

We have encountered a scenario where kafka messages are not processed anymore through the real-time data flow. When we cleared the queue, the newly entered messages stated flowing into pega data flow as expected.

Now, i have 2 questions to understand the Kafka data set and data flow behavior.

1. How does the offset number move. Once a message is read by data-set, shouldn't the offset counter move to next message and skip the erroneous message automatically?
2. Is there a possibility that the data flow can move a message to dead letter queue in case it encounters an error in processing them message?

Regards

Saurabh Mittal