Question

CH
Last activity: 12 Aug 2025 11:44 EDT
Need information on Kafka serialization mechanism
From our pega installation, we produce and consume Kafka streams. There is a guideline from our organization that we should encrypt/decrypt the messages sent via Kafka, and this should be done a third party software called SecuPi. SecuPi uses the following standard serialization/deserialization methods: • org.apache.kafka.common.serialization.StringSerializer • org.apache.kafka.connect.json.JsonSerializer • io.confluent.kafka.serializers.KafkaAvroSerializer • io.confluent.kafka.serializers.KafkaJsonSerializer • io.confluent.kafka.serializers.json.KafkaJsonSchemaSerializer • io.confluent.connect.avro.AvroConverter • io.confluent.kafka.streams.serdes.avro.SpecificAvroSerializer • org.apache.kafka.connect.json.JsonConverter While in our application we are using the following serialization methods which Pega supports: • com.pega.platform.kafka.serde.PegaSerde (this is Pega product internal implementation) • com.pega.integration.kafka.DataTransformSerde (implements com.pega.platform.kafka.serde.PegaSerde)********* • com.pega.integration.kafka.AvroSchemaRegistrySerde (implements com.pega.platform.kafka.serde.PegaSerde **********
From our pega installation, we produce and consume Kafka streams. There is a guideline from our organization that we should encrypt/decrypt the messages sent via Kafka, and this should be done a third party software called SecuPi. SecuPi uses the following standard serialization/deserialization methods: • org.apache.kafka.common.serialization.StringSerializer • org.apache.kafka.connect.json.JsonSerializer • io.confluent.kafka.serializers.KafkaAvroSerializer • io.confluent.kafka.serializers.KafkaJsonSerializer • io.confluent.kafka.serializers.json.KafkaJsonSchemaSerializer • io.confluent.connect.avro.AvroConverter • io.confluent.kafka.streams.serdes.avro.SpecificAvroSerializer • org.apache.kafka.connect.json.JsonConverter While in our application we are using the following serialization methods which Pega supports: • com.pega.platform.kafka.serde.PegaSerde (this is Pega product internal implementation) • com.pega.integration.kafka.DataTransformSerde (implements com.pega.platform.kafka.serde.PegaSerde)********* • com.pega.integration.kafka.AvroSchemaRegistrySerde (implements com.pega.platform.kafka.serde.PegaSerde **********
We have two questions - 1. Can pega provide us with JAR files of custom serializers so that SecuPi can implement them? 2. If not then does pega support any of the standard serialization method mentioned above?