Question
Macquarie
AU
Last activity: 15 May 2025 10:40 EDT
Not able to send a message to Kafka topic using Avro schema in Pega 24.1
We are using Pega 24.1 and trying to connect to external Kafka using the Kafka Dataset directly in pega.
We have already established the connection with Kafka successfully, we are able to send the JSON messages to the Kafka topic.
Our requirement is to send using Avro schema from Pega to Kafka. For that we have defined the Avro schema with necessary schema registry and also the relevant certificates and the json that has the avro schema.
written a test activity to set the message in the same format on a page and using that same page while calling the Dataset-Execute method in activity, we are getting the following exception:
(@baseclass)Page failed to save with message: org.apache.kafka.common.errors.SerializationException: Error serializing Avro message
Do you know if Pega would serialize the JSON into avro all by itself before sending to Kafka or do we need do that explicitly?
Is there something I am missing here ?
Rabo Bank
NL
@AdityaK2715 - We had similar issue and later we found that key value was not populated.
After setting the key value in the test activty, dataset-execute Save method was sucessful.
We were able to post message on to Kafka.