Question
Booz Allen Hamilton
US
Last activity: 6 Feb 2020 12:25 EST
Maximum number of Data pages
We are supporting a pega application where we manually add organizations to an existing org tree like the following:
- Grandparent Org
- Parent Org
- Child Org
- etc (at least 10 levels deep)
We have approximately 8300 organization records which span approximately 9 levels deep. When you update an existing record, the system also needs to update all children (to update the org path). The previous developer maintains the path for each org record (i.e. /GranparentOrg/ParentOrg/ChildOrg/ ... etc.)
The problem we run into is that if we update a lower level organization, the system updates correctly; however if we update a higher level org (at level 1,2,3) which could have more than 1000 records to recursively update, we get an error. We noticed that on the successful transactions, the temporary data pages clean up successfully from the clipboard; however, for the ones that fail, we noticed that we get the following errors in the clipboard (see attached).
We also tried (unsuccessfully) updating the Dynamic System Setting for:
prconfig/datapages/mrucapacity/default
to 2000 (instead of 1000), but that didn't work either ...
Is there a limit on the number of Data Pages you can have opened?
I am running Pega 8.3 (personal edition) on a Windows 10 Professional laptop.
Any help and/or assistance will be greatly appreciated.
Thanks!
***Moderator Edit-Vidyaranjan: Updated Platform Capability***
Pegasystems Inc.
US
What is the error message? Does the error message complain about any size or limits?
Can you try setting the higher values for the below DSS setting and confirm after server restart.
Pega-Engine • prconfig/declaratives/declarepages/instancecountlimit/default (set to 50000)
Booz Allen Hamilton
US
I increased to 2000, then 5000, then 500000 and all got the same error
From the java console:
2020-01-23 09:46:53,788 [ C0153] [ STANDARD] [ ] [ ] (tmosphere.AtmospherePushEngine) INFO - Async support implementation used by framework: org.atmosphere.container.JSR356AsyncSupport
23-Jan-2020 09:46:53.859 SEVERE [C0153] org.apache.catalina.session.StandardManager.startInternal Exception loading sessions from persistent storage
java.lang.ClassNotFoundException: com.pega.pegarules.session.internal.authorization.ContextMapDiagCallback
at org.apache.catalina.loader.WebappClassLoaderBase.loadClass(WebappClassLoaderBase.java:1285)
at org.apache.catalina.loader.WebappClassLoaderBase.loadClass(WebappClassLoaderBase.java:1119)
at java.lang.Class.forName0(Native Method)
at java.lang.Class.forName(Class.java:348)
at org.apache.catalina.util.CustomObjectInputStream.resolveClass(CustomObjectInputStream.java:160)
at java.io.ObjectInputStream.readNonProxyDesc(ObjectInputStream.java:1819)
at java.io.ObjectInputStream.readClassDesc(ObjectInputStream.java:1713)
at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1986)
at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1535)
I increased to 2000, then 5000, then 500000 and all got the same error
From the java console:
2020-01-23 09:46:53,788 [ C0153] [ STANDARD] [ ] [ ] (tmosphere.AtmospherePushEngine) INFO - Async support implementation used by framework: org.atmosphere.container.JSR356AsyncSupport
23-Jan-2020 09:46:53.859 SEVERE [C0153] org.apache.catalina.session.StandardManager.startInternal Exception loading sessions from persistent storage
java.lang.ClassNotFoundException: com.pega.pegarules.session.internal.authorization.ContextMapDiagCallback
at org.apache.catalina.loader.WebappClassLoaderBase.loadClass(WebappClassLoaderBase.java:1285)
at org.apache.catalina.loader.WebappClassLoaderBase.loadClass(WebappClassLoaderBase.java:1119)
at java.lang.Class.forName0(Native Method)
at java.lang.Class.forName(Class.java:348)
at org.apache.catalina.util.CustomObjectInputStream.resolveClass(CustomObjectInputStream.java:160)
at java.io.ObjectInputStream.readNonProxyDesc(ObjectInputStream.java:1819)
at java.io.ObjectInputStream.readClassDesc(ObjectInputStream.java:1713)
at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1986)
at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1535)
When I click on any of the three Data pages (it appears to have between 800 to 1000 data pages), three of them at the bottom have the same errors:
Error loading D_OUMSubOrgUnits using activity {pxObjClass=Rule-Obj-Activity, pyClassName=Code-Pega-List, pyActivityName=pxCallRetrieveReportData}
Pegasystems Inc.
US
The Java console error is not related to the loading of data pages.
It is not clearly evident from the clipboard message reg why the data page failed to load. Did you get any useful info when you run the data page standalone and trace it?
Booz Allen Hamilton
US
sorry for the delay ... I have added debug messages into the java console.
The first error message that appears in the java console is the following:
Exception caught when evaluating when
java.lang.RuntimeException: Scalar query .pyUI.pyQueryTimeoutValue on page 'pegaInternalReportTempPage' of type 'Rule-Obj-Report-Definition' using 0 parameter(s)
The problem is very intermittent. It currently seems to bomb right around 60 seconds; however, yesterday and previous days it would bomb much quicker.
From above, the logic is recursive within a tree (parent / child relationships). I have varied the number of records it processes (258, 603, and 691 records) succeeded; 872 and 1302 records succeeded today (but in previous days they did not succeed). I am getting it to fail on 7554 records after about 60 seconds currently.