Question
General Motors
US
Last activity: 9 Jun 2020 10:31 EDT
Compose Shape threshold error " Too many records retrieved for keys" in Batch process
When we run a batch process, the Compose shape has alerts that causes it to fail because the threshold is set to 375. The error we get is below. We searched the community and saw that this could be a DSS, but that didn't have any affect. How can we raise this limit?
The DSS we tried changing was "prconfig/alerts/dataflowmaxrowsincomposethreshold/default"
Too many records retrieved for keys [LookupKeys{values={VEH_QUALFCTN_ID=5,VEH_QUALFCTN_TYPE_CD=transctrl}}]. Number of records retrieved is 2525 while the threshold is 375 at com.pega.dsm.dnode.api.dataflow.BrowseByKeyLimits
Thanks, Mike
Pegasystems Inc.
US
@MichaelG7231 You should be careful about just adjusting this DSS. This DSS is there to limit the read of too many embedded objects that cause performance issues. Consider if you should really be loading this data or looking for ways to flatten it into some sort of aggregated result so that you do not need to iterate over so many embedded record (nor read them in the first place)