out of memory error while Tomcat Server Startup
Hi,
I just installed Pega and the installation was successful, but when starting Tomcat I get out of memory error. I have 6GB in DB server and 6GB in the app server.
The memory setting in JAVA_OPTS are :
set JAVA_OPTS=-Xms4096m –Xmx8192m
set JAVA_OPTS=-Djava.awt.headless=true
set JAVA_OPTS=-DNodeType=Universal
set JAVA_OPTS=-Dcom.sun.xml.bind.v2.bytecode.ClassTailor.noOptimize=true
Following is the error :
Hi,
I just installed Pega and the installation was successful, but when starting Tomcat I get out of memory error. I have 6GB in DB server and 6GB in the app server.
The memory setting in JAVA_OPTS are :
set JAVA_OPTS=-Xms4096m –Xmx8192m
set JAVA_OPTS=-Djava.awt.headless=true
set JAVA_OPTS=-DNodeType=Universal
set JAVA_OPTS=-Dcom.sun.xml.bind.v2.bytecode.ClassTailor.noOptimize=true
Following is the error :
Exception in thread "StartupTaskUtil LOAD_PEGACONCLUSIONS" java.lang.OutOfMemoryError: Java heap space
at com.microsoft.sqlserver.jdbc.TDSPacket.<init>(IOBuffer.java:6458)
at com.microsoft.sqlserver.jdbc.TDSReader.readPacket(IOBuffer.java:6637)
at com.microsoft.sqlserver.jdbc.TDSCommand.detach(IOBuffer.java:7571)
at com.microsoft.sqlserver.jdbc.SQLServerConnection.executeCommand(SQLServerConnection.java:2434)
at com.microsoft.sqlserver.jdbc.SQLServerStatement.executeCommand(SQLServerStatement.java:191)
at com.microsoft.sqlserver.jdbc.SQLServerResultSet.closeServerCursor(SQLServerResultSet.java:6573)
at com.microsoft.sqlserver.jdbc.SQLServerResultSet.closeInternal(SQLServerResultSet.java:596)
at com.microsoft.sqlserver.jdbc.SQLServerResultSet.close(SQLServerResultSet.java:612)
at com.pega.pegarules.data.internal.store.rdbms.DatabaseResultSet.close(DatabaseResultSet.java:556)
at com.pega.pegarules.data.internal.access.ResultIteratorResultPackagerImpl.close(ResultIteratorResultPackagerImpl.java:214)
at com.pega.pegarules.exec.internal.basic.dictionary.ConclusionCachePreLoader.batchLoadConclusionsWithNameList(ConclusionCachePreLoader.java:182)
at com.pega.pegarules.exec.internal.basic.dictionary.ConclusionCachePreLoader.loadAccessInfoConclusion(ConclusionCachePreLoader.java:479)
at com.pega.pegarules.exec.internal.basic.dictionary.ConclusionCacheImpl.loadPegaConclusions(ConclusionCacheImpl.java:1252)
at com.pega.pegarules.session.internal.async.startup.ConclusionsTask.runTask(ConclusionsTask.java:21)
at com.pega.pegarules.session.internal.async.startup.StartupTask$1.run(StartupTask.java:35)
at com.pega.pegarules.session.internal.PRSessionProviderImpl.performTargetActionWithLock(PRSessionProviderImpl.java:1382)
at com.pega.pegarules.session.internal.PRSessionProviderImpl.doWithRequestorLocked(PRSessionProviderImpl.java:1125)
at com.pega.pegarules.session.internal.PRSessionProviderImpl.doWithRequestorLocked(PRSessionProviderImpl.java:932)
at com.pega.pegarules.session.internal.PRSessionProviderImpl.doWithRequestorLocked(PRSessionProviderImpl.java:898)
at com.pega.pegarules.session.internal.async.startup.StartupTask.run(StartupTask.java:30)
at java.lang.Thread.run(Unknown Source)
2019-09-11 14:44:54,038 [ervice-registry-task] [ STANDARD] [ ] [ ] (.tasks.TopologyChangedDetector) INFO - Services topology has changed. Current topology:
This node ==> pega 996ed8bffda84e3c7d68e9395215397e Proprietary information hidden startingUp (new node)
Exception in thread "StartupTaskUtil INITIALIZE_SEARCH" java.lang.OutOfMemoryError: Java heap space
2019-09-11 14:47:50,972 [ TRVUSTCVDW0536] [ STANDARD] [ ] [ ] ( external.async.IStartupTask) INFO - All registered 'StartupTasks' (parallel cache loading) have finished.
Exception in thread "StartupTaskUtil LOAD_GLOBALDECLARATIVECLASSES" java.lang.OutOfMemoryError: Java heap space
2019-09-11 14:47:50,972 [ TRVUSTCVDW0536] [ STANDARD] [ ] [ ] ( internal.mgmt.PREnvironment) ERROR - com.pega.pegarules.pub.PRRuntimeException: Method Invocation exception
2019-09-11 14:47:50,972 [ TRVUSTCVDW0536] [ STANDARD] [ ] [ ] ( etier.impl.EngineStartup) ERROR - PegaRULES initialization failed. Server: TRVUSTCVDW0536
com.pega.pegarules.pub.context.InitializationFailedError: PRNodeImpl init failed
at com.pega.pegarules.session.internal.mgmt.PREnvironment.getThreadAndInitialize(PREnvironment.java:397) ~[prprivate-session.jar:?]
at com.pega.pegarules.session.internal.PRSessionProviderImpl.getThreadAndInitialize(PRSessionProviderImpl.java:2170) ~[prprivate-session.jar:?]
at com.pega.pegarules.session.internal.engineinterface.etier.impl.EngineStartup.initEngine(EngineStartup.java:661) ~[prprivate-session.jar:?]
at com.pega.pegarules.session.internal.engineinterface.etier.impl.EngineImpl._initEngine_privact(EngineImpl.java:172) ~[prprivate-session.jar:?]
at com.pega.pegarules.session.internal.engineinterface.etier.impl.EngineImpl.doStartup(EngineImpl.java:145) ~[prprivate-session.jar:?]
at com.pega.pegarules.web.servlet.WebAppLifeCycleListener._contextInitialized_privact(WebAppLifeCycleListener.java:216) ~[prwebj2ee.jar:?]
at com.pega.pegarules.web.servlet.AbstractLifeCycleListener._contextInitialized_privact(AbstractLifeCycleListener.java:159) ~[prwebj2ee.jar:?]
at com.pega.pegarules.web.servlet.AbstractLifeCycleListener.contextInitialized(AbstractLifeCycleListener.java:73) ~[prwebj2ee.jar:?]
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:1.8.0_221]
at sun.reflect.NativeMethodAccessorImpl.invoke(Unknown Source) ~[?:1.8.0_221]
at sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) ~[?:1.8.0_221]
at java.lang.reflect.Method.invoke(Unknown Source) ~[?:1.8.0_221]
at com.pega.pegarules.internal.bootstrap.PRBootstrap.invokeMethod(PRBootstrap.java:380) ~[prbootstrap-8.3.0-225.jar:8.3.0-225]
at com.pega.pegarules.internal.bootstrap.PRBootstrap.invokeMethodPropagatingThrowable(PRBootstrap.java:422) ~[prbootstrap-8.3.0-225.jar:8.3.0-225]
at com.pega.pegarules.boot.internal.extbridge.AppServerBridgeToPega.invokeMethodPropagatingThrowable(AppServerBridgeToPega.java:224) ~[prbootstrap-api-8.3.0-225.jar:8.3.0-225]
at com.pega.pegarules.boot.internal.extbridge.AppServerBridgeToPega.invokeMethod(AppServerBridgeToPega.java:273) ~[prbootstrap-api-8.3.0-225.jar:8.3.0-225]
at com.pega.pegarules.internal.web.servlet.WebAppLifeCycleListenerBoot.contextInitialized(WebAppLifeCycleListenerBoot.java:92) ~[prbootstrap-api-8.3.0-225.jar:8.3.0-225]
at org.apache.catalina.core.StandardContext.listenerStart(StandardContext.java:4685) ~[catalina.jar:9.0.24]
at org.apache.catalina.core.StandardContext.startInternal(StandardContext.java:5146) ~[catalina.jar:9.0.24]
at org.apache.catalina.util.LifecycleBase.start(LifecycleBase.java:183) ~[catalina.jar:9.0.24]
at org.apache.catalina.core.ContainerBase.addChildInternal(ContainerBase.java:717) ~[catalina.jar:9.0.24]
at org.apache.catalina.core.ContainerBase.addChild(ContainerBase.java:690) ~[catalina.jar:9.0.24]
at org.apache.catalina.core.StandardHost.addChild(StandardHost.java:705) ~[catalina.jar:9.0.24]
at org.apache.catalina.startup.HostConfig.deployWAR(HostConfig.java:978) ~[catalina.jar:9.0.24]
at org.apache.catalina.startup.HostConfig$DeployWar.run(HostConfig.java:1849) ~[catalina.jar:9.0.24]
at java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[?:1.8.0_221]
at java.util.concurrent.FutureTask.run(Unknown Source) ~[?:1.8.0_221]
at org.apache.tomcat.util.threads.InlineExecutorService.execute(InlineExecutorService.java:75) ~[tomcat-util.jar:9.0.24]
at java.util.concurrent.AbstractExecutorService.submit(Unknown Source) ~[?:1.8.0_221]
at org.apache.catalina.startup.HostConfig.deployWARs(HostConfig.java:773) ~[catalina.jar:9.0.24]
at org.apache.catalina.startup.HostConfig.deployApps(HostConfig.java:427) ~[catalina.jar:9.0.24]
at org.apache.catalina.startup.HostConfig.start(HostConfig.java:1576) ~[catalina.jar:9.0.24]
at org.apache.catalina.startup.HostConfig.lifecycleEvent(HostConfig.java:309) ~[catalina.jar:9.0.24]
at org.apache.catalina.util.LifecycleBase.fireLifecycleEvent(LifecycleBase.java:123) ~[catalina.jar:9.0.24]
at org.apache.catalina.util.LifecycleBase.setStateInternal(LifecycleBase.java:423) ~[catalina.jar:9.0.24]
at org.apache.catalina.util.LifecycleBase.setState(LifecycleBase.java:366) ~[catalina.jar:9.0.24]
at org.apache.catalina.core.ContainerBase.startInternal(ContainerBase.java:936) ~[catalina.jar:9.0.24]
at org.apache.catalina.core.StandardHost.startInternal(StandardHost.java:841) ~[catalina.jar:9.0.24]
at org.apache.catalina.util.LifecycleBase.start(LifecycleBase.java:183) ~[catalina.jar:9.0.24]
at org.apache.catalina.core.ContainerBase$StartChild.call(ContainerBase.java:1384) ~[catalina.jar:9.0.24]
at org.apache.catalina.core.ContainerBase$StartChild.call(ContainerBase.java:1374) ~[catalina.jar:9.0.24]
at java.util.concurrent.FutureTask.run(Unknown Source) ~[?:1.8.0_221]
at org.apache.tomcat.util.threads.InlineExecutorService.execute(InlineExecutorService.java:75) ~[tomcat-util.jar:9.0.24]
at java.util.concurrent.AbstractExecutorService.submit(Unknown Source) ~[?:1.8.0_221]
at org.apache.catalina.core.ContainerBase.startInternal(ContainerBase.java:909) ~[catalina.jar:9.0.24]
at org.apache.catalina.core.StandardEngine.startInternal(StandardEngine.java:262) ~[catalina.jar:
Accepted Solution
UST Global
IN
This issue is resolved. The issue was to do with java version that I have installed and the java runtime settings. I have downloaded fresh version of JDK 8 and installed and its working fine now. Thanks to each of you in helping to narrow down to the problem.
Pegasystems Inc.
US
What version of the sqlserver jdbc driver you are using (use the latest sqljdbc42.jar)? Also can you attach your context.xml? Also be aware of using nodetype of universal will start embedded java processes (Cassandra and Kafka) which requires more memory in addition to the parent engine process.
Pegasystems Inc.
IN
Apart from Kevin has suggested, memory allocated to app server is mentioned is 6 GB ,and java argument mentioned it as 8 GB set JAVA_OPTS=-Xms4096m –Xmx8192m,which needs to be changed.
Pegasystems Inc.
IN
Hi,
It should not throw OOM during startup as heap is configured as 8 GB.Are you using pega 8?Can you try to increase heap size for testing purpose and let me know the result.
Thanks,
Abhinav
Pegasystems Inc.
US
if you haven't tried this yet, you can change the jvm setting -DnodeType=Universal to -DNodeType=BackgroundProcessing,Search,Stream,WebUser which will result in 5 queue processor nodes starting vs. the 12 that start with the universal setting, this setting will require less memory
UST Global
IN
The problem persists after the following suggested changes,
I have changed the following in the JAVA_OPTS:
set JAVA_OPTS=-Xms4096m –Xmx5120m
set JAVA_OPTS=-DNodeType=BackgroundProcessing,Search,Stream,WebUser
I am using JAVA 8, Tomcat 9,0, Pega 8.3
Please see mycontext.xml
<Resource name="jdbc/PegaRULES"
auth="Container"
type="javax.sql.DataSource"
factory="org.apache.tomcat.jdbc.pool.DataSourceFactory"
driverClassName="com.microsoft.sqlserver.jdbc.SQLServerDriver"
url="jdbc:sqlserver://10.10.114.126:1433;
databaseName=PegaDB3;
selectMethod=cursor;
sendStringParametersAsUnicode=false"
username="pegaadminuser"
password="xxxxx"
/>
maxTotal="100"
maxIdle="30"
maxWaitMillis="10000"
<Environment name="prconfig/database/databases/PegaRULES/defaultSchema"
value="PegaRULES1" type="java.lang.String"/>
<Environment name="prconfig/database/databases/PegaDATA/defaultSchema"
value="PegaDATA1" type="java.lang.String"/>
<Environment name="url/initialization/explicittempdir"
value="D:\Apache Software Foundation\Tomcat 9.0\temp" type="java.lang.String"/>
BlueRose Technologies pvt ltd
IN
Try to check java environment variables whether they are configured correctly or not and test with removing -DNodetype and let us know the result.
Accepted Solution
UST Global
IN
This issue is resolved. The issue was to do with java version that I have installed and the java runtime settings. I have downloaded fresh version of JDK 8 and installed and its working fine now. Thanks to each of you in helping to narrow down to the problem.