Question
Evonsys
US
Last activity: 28 Feb 2019 3:28 EST
Kafka Integration with Pega 8.1
Hi All,
can someone explain the steps to integrate/listen the messages from a KAFKA topic in localhost
the steps which i did
1)Installed Kafka in Personal machine (localhost)
2)Started Zookeper and kafka servers
3)created a topic
4)in pega created kafka configuration instance --did not give SASL authentication
5)created a kafka dataset
6)created a dataflow
7)created a real-time dataflow, after that in dataflow run it says
Hi All,
can someone explain the steps to integrate/listen the messages from a KAFKA topic in localhost
the steps which i did
1)Installed Kafka in Personal machine (localhost)
2)Started Zookeper and kafka servers
3)created a topic
4)in pega created kafka configuration instance --did not give SASL authentication
5)created a kafka dataset
6)created a dataflow
7)created a real-time dataflow, after that in dataflow run it says
8)on stream services landing page under "STREAM" tab i saw an alert "Not enough nodes to achieve replication factor 2" and also the the node status is "JOINING_FAILED"
9)then i selected the item to see the error message as "ChannelException: Failed to bind to: / Proprietary information hidden:2181"
10)in Pega log file
Cognizant Technology Limited
IN
Hi Mani,
I could see the below exception in the log, On prpc startup we attempt to start an embedded netty server on the configured port. In case the port is already in use the embedded server startup will fail, but not prpc startup. Please check the port / Proprietary information hidden:2181 if it's being utilized by other services.
Log :
Hi Mani,
I could see the below exception in the log, On prpc startup we attempt to start an embedded netty server on the configured port. In case the port is already in use the embedded server startup will fail, but not prpc startup. Please check the port / Proprietary information hidden:2181 if it's being utilized by other services.
Log :
Caused by: org.jboss.netty.channel.ChannelException: Failed to bind to: / Proprietary information hidden:2181
at org.jboss.netty.bootstrap.ServerBootstrap.bind(ServerBootstrap.java:272) ~[netty-3.10.6.Final.jar:?]
at com.pega.charlatan.server.CharlatanNettyServer.start(CharlatanNettyServer.java:112) ~[charlatan-server-8.1.0-192.jar:?]
at com.pega.dsm.dnode.api.server.StreamServerService$StreamServiceStartOperation$3.emit(StreamServerService.java:377) ~[d-node-8.1.0-192.jar:?]
at com.pega.dsm.dnode.impl.stream.DataObservableImpl$SafeDataSubscriber.subscribe(DataObservableImpl.java:338) ~[d-node-8.1.0-192.jar:?]
at com.pega.dsm.dnode.impl.stream.DataObservableImpl.subscribe(DataObservableImpl.java:40) ~[d-node-8.1.0-192.jar:?] .
Pegasystems Inc.
US
This is a multi node env. The customer says that the port is being utilized by 1 JVM but when they start the other JVMs, they see the same error. Could you please assist?
USU GmbH
DE
I have the same error by trying to configure a stream node in pega 8.1
As the pyKeeperPort 2181 was already in use I have changed it to a free port 9061.
Than I got the error described in
https://collaborate.pega.com/question/port-out-range65536-exepction-adding-stream-node
So I adjusted the /etc/hosts file like stated below:
Proprietary information hidden localhost
Proprietary information hidden pegadev
::1 localhost ip6-localhost ip6-loopback
fe00::0 ip6-localnet
ff00::0 ip6-mcastprefix
ff02::1 ip6-allnodes
ff02::2 ip6-allrouters
Proprietary information hidden pegadev
After changing the hosts file I have got the following execption by adding a stream node in the Decisioning: Services - Stream landingpage.
Any suggestions on how to deal with that issue?
I have the same error by trying to configure a stream node in pega 8.1
As the pyKeeperPort 2181 was already in use I have changed it to a free port 9061.
Than I got the error described in
https://collaborate.pega.com/question/port-out-range65536-exepction-adding-stream-node
So I adjusted the /etc/hosts file like stated below:
Proprietary information hidden localhost
Proprietary information hidden pegadev
::1 localhost ip6-localhost ip6-loopback
fe00::0 ip6-localnet
ff00::0 ip6-mcastprefix
ff02::1 ip6-allnodes
ff02::2 ip6-allrouters
Proprietary information hidden pegadev
After changing the hosts file I have got the following execption by adding a stream node in the Decisioning: Services - Stream landingpage.
Any suggestions on how to deal with that issue?
org.jboss.netty.channel.ChannelException: Failed to bind to: / Proprietary information hidden:9061
at org.jboss.netty.bootstrap.ServerBootstrap.bind(ServerBootstrap.java:272)
at com.pega.charlatan.server.CharlatanNettyServer.start(CharlatanNettyServer.java:83)
at com.pega.dsm.dnode.api.server.StreamServerService$StreamServiceStartOperation$3.emit(StreamServerService.java:380)
USU GmbH
DE
The problme got solved.
As my pega instance is running on a docker container I assumed that the "identification/cluster/public/address" should be set in the prconfic to the host which I thought is the host IP on wich docker is running. But this was a wrong assumtion.
If you are running pega in a docker container, this setting "identification/cluster/public/address" needs to be set to the IP of the docker container on wich the pega instance is running.
Changes on /ect/hosts file and other settings were not needed after this correction