Question
Sun Life Financial Company
CA
Posted: Aug 23, 2019
Last activity: Aug 25, 2019
Last activity: 25 Aug 2019 8:12 EDT
Closed
org.apache.kafka.common.errors.InterruptException in logs
Hi,
We are seeing lot of kafka exceptions in the log even though we are not using Kafka broker. Does it affect the system? How can it be suppressed?
Show More
Hi,
We are seeing lot of kafka exceptions in the log even though we are not using Kafka broker. Does it affect the system? How can it be suppressed?
BrokerSession[brokerId=1047,broker=Broker[endpoints=PLAINTEXT://159.208.196.160:1090,jmxPort=1092,rack=null,version=4],startTime=1566404266237,lastSeen=1566576587280,prpcNode=1c8d9f67b38cf47d7e997388979e6f60]BrokerSession[brokerId=1046,broker=Broker[endpoints=PLAINTEXT://159.208.196.159:1190,jmxPort=1192,rack=null,version=4],startTime=1566532851976,lastSeen=1566576578292,prpcNode=df8e69d3ba0e660dac458184e4f12564]BrokerSession[brokerId=1045,broker=Broker[endpoints=PLAINTEXT://159.208.196.159:1090,jmxPort=1092,rack=null,version=4],startTime=1566418645832,lastSeen=1566576580343,prpcNode=47bd5bcb5d4cfd54214b202b6ff24d2a]BrokerSession[brokerId=1042,broker=Broker[endpoints=PLAINTEXT://159.208.196.18:7010,jmxPort=7030,rack=null,version=4],startTime=1566317575507,lastSeen=1566576584022,prpcNode=aadfc5717fb3d7eade65be28f187b33f]BrokerSession[brokerId=1044,broker=Broker[endpoints=PLAINTEXT://159.208.196.18:8010,jmxPort=8030,rack=null,version=4],startTime=1566505764889,lastSeen=1566576582165,prpcNode=22fbb468ae8fae964110a730a819bdde]]org.apache.kafka.common.errors.InterruptException: java.lang.InterruptedExceptionat org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient.maybeThrowInterruptException(ConsumerNetworkClient.java:428) ~[kafka-clients-0.11.0.3.jar:?]at org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient.poll(ConsumerNetworkClient.java:248) ~[kafka-clients-0.11.0.3.jar:?]at org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient.poll(ConsumerNetworkClient.java:208) ~[kafka-clients-0.11.0.3.jar:?]at org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient.poll(ConsumerNetworkClient.java:199) ~[kafka-clients-0.11.0.3.jar:?]at org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient.awaitMetadataUpdate(ConsumerNetworkClient.java:134) ~[kafka-clients-0.11.0.3.jar:?]at org.apache.kafka.clients.consumer.internals.Fetcher.retrieveOffsetsByTimes(Fetcher.java:470) ~[kafka-clients-0.11.0.3.jar:?]at org.apache.kafka.clients.consumer.internals.Fetcher.beginningOrEndOffset(Fetcher.java:500) ~[kafka-clients-0.11.0.3.jar:?]at org.apache.kafka.clients.consumer.internals.Fetcher.endOffsets(Fetcher.java:485) ~[kafka-clients-0.11.0.3.jar:?]at org.apache.kafka.clients.consumer.KafkaConsumer.endOffsets(KafkaConsumer.java:1536) ~[kafka-clients-0.11.0.3.jar:?]at com.pega.dsm.dnode.impl.dataset.kafka.features.KafkaResumableFeature$KafkaLagDetector.compute(KafkaResumableFeature.java:184) ~[d-node-8.2.2-354.jar:?]at com.pega.dsm.dnode.impl.dataset.kafka.features.KafkaResumableFeature$KafkaLagDetector.compute(KafkaResumableFeature.java:153) ~[d-node-8.2.2-354.jar:?]at com.pega.dsm.dnode.impl.dataflow.asyncexecutor.QueueProcessorDataSetOperationsImpl.getLag(QueueProcessorDataSetOperationsImpl.java:266) ~[d-node-8.2.2-354.jar:?]at com.pega.platform.executor.queueprocessor.internal.QueueProcessorManagementOperationsImpl$LagCalculator.execute(QueueProcessorManagementOperationsImpl.java:279) ~[pega-executor.jar:?]at com.pega.platform.executor.queueprocessor.internal.BatchTask.lambda$executeInBorrowedRequestor$0(BatchTask.java:69) ~[pega-executor.jar:?]at com.pega.platform.executor.queueprocessor.internal.BatchTask$$Lambda$2017.0000000068732A00.run(Unknown Source) ~[?:?]at com.pega.pegarules.session.internal.PRSessionProviderImpl.performTargetActionWithLock(PRSessionProviderImpl.java:1371) ~[prprivate.jar:?]at com.pega.pegarules.session.internal.PRSessionProviderImpl.doWithRequestorLocked(PRSessionProviderImpl.java:1114) ~[prprivate.jar:?]at com.pega.pegarules.session.internal.PRSessionProviderImpl.doWithRequestorLocked(PRSessionProviderImpl.java:995) ~[prprivate.jar:?]at com.pega.pegarules.session.internal.PRSessionProviderImplForModules.doWithRequestorLocked(PRSessionProviderImplForModules.java:55) ~[prprivate.jar:?]at com.pega.platform.executor.queueprocessor.internal.BatchTask.executeInBorrowedRequestor(BatchTask.java:65) ~[pega-executor.jar:?]at com.pega.platform.executor.queueprocessor.internal.BatchTask.run(BatchTask.java:40) ~[pega-executor.jar:?]at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:522) ~[?:1.8.0]at java.util.concurrent.FutureTask.run(FutureTask.java:277) ~[?:1.8.0]at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1160) [?:1.8.0]at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) [?:1.8.0]at java.lang.Thread.run(Thread.java:811) [?:2.9 (07-31-2018)]Caused by: java.lang.InterruptedException... 26 more
Show Less
Posted: 4 years ago
Pegasystems Inc.
US
Pega OOTB uses kafka (hosted on stream nodes, i.e., nodetype of Stream) for queue processing in pega 8.x (you are running 8.2.2?), see this link
https://community.pega.com/knowledgebase/queue-processor-faq.
We recommend specific node type for different nodes (i.e., for Foreground node, use -DNodeType=WebUser).
What exactly is your NodeType? Are you using 'Universal' node type?
Posted: 4 years ago
Sun Life Financial Company
CA
@KevinZheng_GCS It's not set. And this is the development environment and has one node only. Won't setting up a node type to "WebUser" suppress BackgroundProcessing queue processors (since there is only one node)?
Posted: 4 years ago
Pegasystems Inc.
US
It would. You can set -DNodeType=WebUser,BackgroundProcessing,Stream. In Pega Infinity, Stream is required for queue processing. What is your exact version (including patch version)? If this is happening consistently, please attach the entire log file.