Question
HCL Technologies
NL
Last activity: 20 Oct 2021 1:14 EDT
External KAFKA
We have KAFKA Dataset to publish message in KAFKA topic. Now how do we get the offset number after publishing message.
We need this for reconcilitaion. We do have issue, subscriber claims that message not available in kafka but we dont see any exception in pega as well. How do we investigate these type of issue without offset.
Ernst & Young LLP
MT
@BalamuraliKrishnan There was one enhancement request submitted for v 7.4 (FDBK-24065) 3 years back.
Look at this thread: https://collaborate.pega.com/idea/how-get-offset-and-partition-key-after-publishing-message-kafka-topic
HCL Technologies
NL
@Nirmalya.SenSharma yes i went through. not sure any update on the enhancement from pega.
But we have problem now that subscriber claims that message not available they do report within the message expiry time.
Without offset and partition which is being difficult to confirm that message posted successfully to KAFKA. am not even able to find any class to enable debug logging to see further from pega.
Ernst & Young LLP
MT
Steps to get Partition and Offset values on DataSet-Execute Step page -
- Look for this OOTB DSS dataset/execute/save/statusFailOnError
- Set it's value to true
Attached is the result of a quick POC.
Make sure you read this article[1] to understand why this DSS is needed and the possible impact on your application performance if you set it to true.
Ernst & Young LLP
MT
My bad, I just realized that you are on 8.2.4, while this DSS is available starting from 8.3.4.
:(
HCL Technologies
NL
@Nirmalya.SenSharma Thanks Nirmalya. Let me also check with Pega, how to address this in Pega 8.2