Question

ANZ Banking Group Ltd
ANZ Banking Group Ltd
AU
ANZ Banking Group Ltd
Posted: 2 days ago
Last activity: 2 days ago
Last activity: 27 May 2025 1:50 EDT
How to Skip Acknowledgement in Real-Time Data Flow for Validation Failures (Google Pub/Sub)
Hi All,
We are currently using a Google Pub/Sub data set integrated with a Real-Time Data Flow (RTDF) in Pega to process streaming data. Our use case involves validating each incoming record, and if a record fails validation, we want to prevent acknowledging the message so that:
- Google Pub/Sub retries the message based on the configured retry policy.
- If the message exceeds the retry limit, it is forwarded to a Dead Letter Queue (DLQ).
We are looking for guidance on the following:
- How can we skip or delay the acknowledgement of a message in Pega RTDF when a validation failure occurs?
- Is there a way to explicitly control the acknowledgement from within the data flow logic?
- How does Pega handle Pub/Sub retry and DLQ behavior in case of processing failures?
- Are there any best practices or configuration patterns to ensure failed messages are retried or routed to DLQ correctly?
Any insights or examples from similar implementations would be greatly appreciated!
Thanks in advance!