Question
PNC
US
Last activity: 4 Oct 2017 12:14 EDT
Pega 7.1.9 Processing many records over multiple nodes
Good Evening, We have a 10 node setup and need to allow our xml parsing to occur for a million records. Because this occurs in sequence this obviously limits the speed in which we can accomplish this task. I am trying to find out if we can setup up a Master Agent which would control the flow to child agents where we could have multiple child agents per node. Ideally lets say the Master Agent picks up 100,000 (1/10) of these records. Could the Master agent distribute that load to 5 child agents on node 1 through node 10 for a total of 50 child agent getting 2000 records a piece. Once the child agents on Node 1 as an example finishes processing the 10,000 records across its 5 child nodes could the Master Agent have ready the next 100,000 and give that node its next 10,000 (2000 per child) to process? Apologies for my ignorance but I am trying to understand the capabilities better here. Thank you very much!