Question
Maantic Inc
US
Last activity: 6 Apr 2022 15:10 EDT
Queue processor concurrent thread
Hi, Queue processor configured to run in background processor node with thread count 5.
background processor nodes are 10.
question about the thread count, does it create 50 threads in total or only 20 threads
per BG node 1*5 thread = 5 threads
ten BG node 10*5 = 50 threads.
We do see message in queue processor thread config box "the maximum number of threads that process messages across all the nodes in cluster is 20"
Lventur
IN
Concurrent Thread - No.of nodes * No. Of threads provided in queue processor rule...
With the configuration which you have mentioned, system can process parallely 50 records...
Please refer below article for reference.
https://onestoppega.com/background-processing/queue-processor-in-pega/
Maantic Inc
US
@Gunasekaran Baskaran we do see this message in queue processor "the maximum number of threads that process messages across all the nodes in cluster is 20". could you please check this
Infosys Limited
IN
@JohnPaulRaja,C. It can process only upto to the 20 instances at once. The remaining 30 threads are of no use. If you want to process 50 at once, i think you need to change Kafka partition count which can be achieved by DSS. But this is a global dss. It applies to all queueprocessors. Be careful if you are modifying the partion count.
Maantic Inc
US
@P.Siva.Praveen thank you, do you know the Kafka DSS name
Mindtree Ltd
US
@JohnPaulRaja,C Please refer this. https://docs-previous.pega.com/decision-management-reference-materials/kafka-operations#number_partitions