Question
IP Australia
AU
Last activity: 7 Aug 2023 10:35 EDT
How to configure stream node and kafka instance in 8.4
Hi,
We have upgrade our pega application from 7.3.1 to 8.4, in upgrade guide it is mentioned that we need to open ports 9092 and 7003 to support stream node.
Do we have to explicitly setup any kafka cluster to connect to stream node of pega? or Pega internally is going to take care of it?
To open and configure the ports, what should be the source and destination for these ports?
Pegasystems Inc.
US
If you use embedded stream service (which is the default for 8.4.x), Pega should take care of this. For Pega 8.4.x, you can also configure external stream service, see this link for details: https://community.pega.com/knowledgebase/articles/decision-management-overview/externally-managed-stream-service.
IP Australia
AU
Thanks for the reply Kevin, we are using default pega one only.
To open and configure the ports, what should be the source and destination for these ports? should we open these ports between stream node and webuser nodes for communication?
Labb Ltd
GB
As per the the Pega articles
By default the broker is set to 9092, the keeper is set to 2181, and JMX is set to 9999. If you need to change the default ports, you can do it in one of the following ways:
- Add the <
env name="dsm/services/stream/<property_name>" value="<port_number>"> entry in the prconfig.xml file.- Create a dynamic system setting with the following options:
- Owning Ruleset - Pega-Engine
- Setting Purpose - prconfig/dsm/services/stream/<property_name>/default
- Value - Port number. For example, 1111
Where the <property_name> is:
- pyBrokerPort for the broker.
- pyKeeperPort for the keeper.
- pyJmxPort for the JMX.
IP Australia
AU
As pega use these ports, we have to open these ports from network for pega communication. Can we please get some information on "for what communication pega is using these ports?"
Is it between webnodes and stream node only or for any other communication pega is going to use it?
Labb Ltd
GB
If I am not wrong all nodes should have access to these ports. Because any node can queue to Kafka stream but only QPs associated with the node types will process it. To avoid any unexpected behaviour, ensure all nodes have access to these ports.