Configure External Kafka as a stream service
Starting from Pega Platform 8.4.0, it is possible to configure external Kafka as a stream service provider. This allows customers to use their own managed Kafka infrastructure.
Pegasystems Inc.
NL
As of 8.4.2, we allow configuring topic name pattern, so that you can customize topic names per environment.
By default, topics originating from the Pega Platform have pega- prefix, so that it is easy to distinguish them from topics created by other applications.
<env name="services/stream/name/pattern" value="pega-dev-{stream.name}"/>
It is extremely important to make sure that every Pega node is configured with the same pattern. We recommend setting this value via Dynamic System Settings. See How to compose the key of a PRCONFIG dynamic system setting
Virtusa Systems Pvt LTD
AE
@adama Hi , is there a way we can do Kafka externalization in Pega 8.5.3 for on premise servers. Really appreciate your response on this matter.
Updated: 17 Mar 2021 12:59 EDT
Procom
SV
@adamaHi,
I have followed the instructions in the PDF, is there a way I can make sure that my configuration is working properly ?
the Stream service status says that it is Unreachable.
the guide suggests to configure the prconfig entry as "services/stream/provider/url", and on this post https://community.pega.com/knowledgebase/articles/decision-management-overview/externally-managed-stream-service, it is suggested as "services/stream/broker/url", these are either different properties for different purposes or one of them is invalid, can you please confirm ?
Knowledge Expert
FR
@MiguelH5 It is definitely a documentation error. Setting has to be "services/stream/broker/url", otherwise node with never will be up and running with exception :
Caused by: com.pega.platform.stream.StreamServiceException: 'services/stream/broker/url' isn't provided.