Pega Kafka Topics
Team,
As we are upgrading our Pega platform from VM base to Container (Private Cloud) , we need to understand on the Kafka topics created by pega for what purpose, so that we have to create our topics readily with our enterprise team. Is there a list of topics that pega needed for Pega Infinity 24 with UI, Agents, & some stream services.
I appreciate if anybody have gone through this journey and their experience.
Thanks & Regards,
bharath
Pegasystems Inc.
GB
@BHARATHB Please see the info provided in this question.
In Pega Infinity, Kafka is used for advanced background processing, such as Queue processors and Job Schedulers. It is also used for storing Stream data sets. However, the specific Kafka topics created by Pega are recreated in the cloned environment on first use, and are not copied during the cloning operation. Therefore, it's not necessary to create these topics in advance. When upgrading to a containerized deployment, you can use the Pega Helm chart to configure communication between your Kafka service and your containerized deployment. Please note that starting from Pega Platform version 8.7, the use of embedded Kafka is deprecated and it's recommended to use an externally managed Kafka service.
⚠ This is a GenAI-powered tool. All generated answers require validation against the provided references.
Is Kafka essential to Pega platform?
Pega Cloud cloning limitations for stream data sets and environment stream tier
@BHARATHB Please see the info provided in this question.
In Pega Infinity, Kafka is used for advanced background processing, such as Queue processors and Job Schedulers. It is also used for storing Stream data sets. However, the specific Kafka topics created by Pega are recreated in the cloned environment on first use, and are not copied during the cloning operation. Therefore, it's not necessary to create these topics in advance. When upgrading to a containerized deployment, you can use the Pega Helm chart to configure communication between your Kafka service and your containerized deployment. Please note that starting from Pega Platform version 8.7, the use of embedded Kafka is deprecated and it's recommended to use an externally managed Kafka service.
⚠ This is a GenAI-powered tool. All generated answers require validation against the provided references.
Is Kafka essential to Pega platform?
Pega Cloud cloning limitations for stream data sets and environment stream tier
Connecting a Pega Platform virtual machine deployment to use a streaming service
Configuring a containerized deployment to use a Kafka service
Platform Support Guide > Kafka
Third-party externalized services Deployment Changes FAQs
8.7 Embedded Kafka Deprecation
Externalising Kafka for Pega Platform