Increase data flow records threshold
I'm receiving this error message on a data flow execution:
Caused by: com.pega.dsm.dnode.api.dataflow.DataFlowTooManyRecordsException: Too many records retrieved for keys [LookupKeys{values={pxHistoryForReference=ABC-CAMBIO-WORK P-102098-1,pyFlowName=LiquidarOperacaoBacen,pyTaskID=Wait1}}]. Number of records retrieved is 48539 while the threshold is 375 ... 54 more
How I increase this threshold?
ai4process ltd
GB
There is no configurable setting or DSS in Pega to increase the max records per key threshold for Data Flow execution.
I believe the exception indicates that the source component or any import Data Set is returning a large number of records for a single key — likely because the key isn’t truly unique or is too broad.
Can you verify the look up keys used in the Data flow, ad also check whether the underlying dataset is returning non unique results for the keys defined in them.
more information on the DAta flow/ Data set could help analyse and provide response.