Skip to main content

This content is closed to future replies and is no longer being maintained or updated.
Links may no longer function. If you have a similar request, please write a new post.

Question

 Bharat Bhushan Soma (BharatBhushanSoma)
Accenture

Accenture
US
BharatBhushanSoma Member since 2016 1 post
Accenture
Posted: Oct 19, 2017
Last activity: Oct 20, 2017
Posted: 19 Oct 2017 16:32 EDT
Last activity: 20 Oct 2017 4:26 EDT
Closed

File Listener Always tries to recover the processed File

We have a file listener "B" configured in our DEV environment and hosted on our own network. The file listener is used pick a file in the configured folder and process it and move to completed folder which is working as expected. There is listener "A" that has a activity which splits the files into n number of csv files and places the files in a seperate "TEMP" folder to be picked. So the listener "B" (running on 4 concurrent threads) now tries to pick up file from "TEMP" folder and process it. Even this works as expected. But once the listener completes the processing for all files in this "TEMP" folder, it tries to recover the last file that has already been processed always and stops the further process and gets errored out.

Also please find attached listener configurations for process and error tabs if needed. Please help me out if anyone has encountered it or aware of this issue

Below is the error in Log file. B is listener described above. Listener user id is the operator id though which the B listener operates

Show More

We have a file listener "B" configured in our DEV environment and hosted on our own network. The file listener is used pick a file in the configured folder and process it and move to completed folder which is working as expected. There is listener "A" that has a activity which splits the files into n number of csv files and places the files in a seperate "TEMP" folder to be picked. So the listener "B" (running on 4 concurrent threads) now tries to pick up file from "TEMP" folder and process it. Even this works as expected. But once the listener completes the processing for all files in this "TEMP" folder, it tries to recover the last file that has already been processed always and stops the further process and gets errored out.

Also please find attached listener configurations for process and error tabs if needed. Please help me out if anyone has encountered it or aware of this issue

Below is the error in Log file. B is listener described above. Listener user id is the operator id though which the B listener operates

ERROR File."B"|recover|X_Part00.1508435027698000.csv|Y/Services/"B" ListenerUserID- Exception caught while evaluating when 
com.pega.pegarules.pub.clipboard.InvalidValueException: PropertyValueInvalid	null	.pegaToBigDecimal()	Invalid number format (was sysuser) 
	at com.pega.pegarules.pub.clipboard.PRStringFormat.pegaToBigDecimal(PRStringFormat.java:479) 
	at com.pega.pegarules.pub.clipboard.PRStringFormat.pegaToAny(PRStringFormat.java:842) 
	at com.pega.pegarules.data.internal.clipboard.ClipboardPageBase.getValue(ClipboardPageBase.java:1908) 
	at com.pega.pegarules.data.internal.clipboard.ClipboardPageBase.getBigDecimal(ClipboardPageBase.java:1868) 
	at com.pega.pegarules.data.internal.clipboard.ClipboardPageImpl.getBigDecimal(ClipboardPageImpl.java:484) 
	at com.pega.pegarules.data.internal.clipboard.ClipboardPageBase.getBigDecimal(ClipboardPageBase.java:1864) 
	at com.pega.pegarules.data.internal.clipboard.ClipboardPageImpl.getBigDecimal(ClipboardPageImpl.java:484) 
	at com.pegarules.generated.model.ra_model_cleanserealsampledata_6da378aff22bb30ed2912ddf4353be4d.whenCondition_1(ra_model_cleanserealsampledata_6da378aff22bb30ed2912ddf4353be4d.java:123) 
	at com.pegarules.generated.model.ra_model_cleanserealsampledata_6da378aff22bb30ed2912ddf4353be4d.perform(ra_model_cleanserealsampledata_6da378aff22bb30ed2912ddf4353be4d.java:94) 
	at com.pega.pegarules.session.internal.mgmt.Executable.applyModel(Executable.java:4475) 
	at com.pegarules.generated.activity.ra_action_saverealsampledata_ac0200741af85b05f459f4aa02c44d9a.step3_circum0(ra_action_saverealsampledata_ac0200741af85b05f459f4aa02c44d9a.java:502) 
	at com.pegarules.generated.activity.ra_action_saverealsampledata_ac0200741af85b05f459f4aa02c44d9a.perform(ra_action_saverealsampledata_ac0200741af85b05f459f4aa02c44d9a.java:104) 
	at com.pega.pegarules.session.internal.mgmt.Executable.doActivity(Executable.java:3527) 
	at com.pega.pegarules.integration.engine.internal.RuleExecutionUtils.runActivity(RuleExecutionUtils.java:375) 
	at com.pega.pegarules.integration.engine.internal.services.file.RuleServiceFile.parseRecordAtTime(RuleServiceFile.java:1039) 
	at com.pega.pegarules.integration.engine.internal.services.file.RuleServiceFile.process(RuleServiceFile.java:1756) 
	at com.pega.pegarules.integration.engine.internal.services.file.FileListener.recoverOne(FileListener.java:1522) 
	at com.pega.pegarules.integration.engine.internal.services.file.FileListener.recovery(FileListener.java:1729) 
	at com.pega.pegarules.integration.engine.internal.services.file.FileListener.run_(FileListener.java:1901) 
	at com.pega.pegarules.integration.engine.internal.services.listener.ServiceListenerBaseImpl.run(ServiceListenerBaseImpl.java:454) 
	at com.pega.pegarules.session.internal.engineinterface.etier.impl.AsyncServant.processAsyncTask(AsyncServant.java:213) 
	at com.pega.pegarules.session.internal.engineinterface.etier.impl.AsyncServant.invoke(AsyncServant.java:167) 
	at com.pega.pegarules.session.internal.engineinterface.etier.impl.EngineImpl._invokeEngine_privact(EngineImpl.java:327) 
	at com.pega.pegarules.session.internal.engineinterface.etier.impl.EngineImpl.invokeEngine(EngineImpl.java:270) 
	at com.pega.pegarules.session.internal.engineinterface.etier.ejb.EngineBean.invokeEngine(EngineBean.java:225) 
	at sun.reflect.GeneratedMethodAccessor44.invoke(Unknown Source) 
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) 
	at java.lang.reflect.Method.invoke(Method.java:498) 
	at com.pega.pegarules.internal.bootstrap.PRBootstrap.invokeMethod(PRBootstrap.java:370) 
	at com.pega.pegarules.internal.bootstrap.PRBootstrap.invokeMethodPropagatingThrowable(PRBootstrap.java:411) 
	at com.pega.pegarules.boot.internal.extbridge.AppServerBridgeToPega.invokeMethodPropagatingThrowable(AppServerBridgeToPega.java:224) 
	at com.pega.pegarules.boot.internal.extbridge.AppServerBridgeToPega.invokeMethodPropagatingException(AppServerBridgeToPega.java:246) 
	at com.pega.pegarules.internal.etier.ejb.EngineBeanBoot.invokeEngine(EngineBeanBoot.java:168) 
	at sun.reflect.GeneratedMethodAccessor43.invoke(Unknown Source) 
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) 
	at java.lang.reflect.Method.invoke(Method.java:498) 
	at org.jboss.as.ee.component.ManagedReferenceMethodInterceptor.processInvocation(ManagedReferenceMethodInterceptor.java:52) 
	at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) 
	at org.jboss.invocation.WeavedInterceptor.processInvocation(WeavedInterceptor.java:53) 
	at org.jboss.as.ee.component.interceptors.UserInterceptorFactory$1.processInvocation(UserInterceptorFactory.java:63) 
	at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) 
	at org.jboss.invocation.WeavedInterceptor.processInvocation(WeavedInterceptor.java:53) 
	at org.jboss.as.ee.component.interceptors.UserInterceptorFactory$1.processInvocation(UserInterceptorFactory.java:63) 
	at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) 
	at org.jboss.as.ejb3.component.invocationmetrics.ExecutionTimeInterceptor.processInvocation(ExecutionTimeInterceptor.java:43) 
	at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) 
	at org.jboss.as.jpa.interceptor.SBInvocationInterceptor.processInvocation(SBInvocationInterceptor.java:47) 
	at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) 
	at org.jboss.as.ejb3.tx.EjbBMTInterceptor.handleInvocation(EjbBMTInterceptor.java:104) 
	at org.jboss.as.ejb3.tx.BMTInterceptor.processInvocation(BMTInterceptor.java:60) 
	at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) 
	at org.jboss.invocation.InitialInterceptor.processInvocation(InitialInterceptor.java:21) 
	at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) 
	at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) 
	at org.jboss.as.ee.component.interceptors.ComponentDispatcherInterceptor.processInvocation(ComponentDispatcherInterceptor.java:53) 
	at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) 
	at org.jboss.as.ejb3.component.pool.PooledInstanceInterceptor.processInvocation(PooledInstanceInterceptor.java:51) 
	at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) 
	at org.jboss.as.ejb3.component.interceptors.CurrentInvocationContextInterceptor.processInvocation(CurrentInvocationContextInterceptor.java:41) 
	at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) 
	at org.jboss.as.ejb3.component.invocationmetrics.WaitTimeInterceptor.processInvocation(WaitTimeInterceptor.java:43) 
	at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) 
	at org.jboss.as.ejb3.security.AuthorizationInterceptor.processInvocation(AuthorizationInterceptor.java:116) 
	at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) 
	at org.jboss.as.ejb3.security.SecurityContextInterceptor.processInvocation(SecurityContextInterceptor.java:86) 
	at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) 
	at org.jboss.as.ejb3.component.interceptors.ShutDownInterceptorFactory$1.processInvocation(ShutDownInterceptorFactory.java:64) 
	at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) 
	at org.jboss.as.ejb3.component.interceptors.LoggingInterceptor.processInvocation(LoggingInterceptor.java:59) 
	at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) 
	at org.jboss.as.ejb3.component.interceptors.EjbExceptionTransformingInterceptorFactories$2.processInvocation(EjbExceptionTransformingInterceptorFactories.java:103) 
	at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) 
	at org.jboss.as.ee.component.NamespaceContextInterceptor.processInvocation(NamespaceContextInterceptor.java:50) 
	at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) 
	at org.jboss.as.ejb3.component.interceptors.AdditionalSetupInterceptor.processInvocation(AdditionalSetupInterceptor.java:55) 
	at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) 
	at org.jboss.as.ee.component.TCCLInterceptor.processInvocation(TCCLInterceptor.java:45) 
	at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) 
	at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) 
	at org.jboss.as.ee.component.ViewService$View.invoke(ViewService.java:185) 
	at org.jboss.as.ee.component.ViewDescription$1.processInvocation(ViewDescription.java:185) 
	at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) 
	at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) 
	at org.jboss.as.ee.component.ProxyInvocationHandler.invoke(ProxyInvocationHandler.java:73) 
	at com.pega.pegarules.internal.etier.interfaces.EngineLocal$$$view21.invokeEngine(Unknown Source) 
	at com.pega.pegarules.session.internal.engineinterface.etier.mdb.PRAsync.processRequest(PRAsync.java:155) 
	at com.pega.pegarules.session.internal.engineinterface.etier.mdb.PRAsync.onMessage(PRAsync.java:112) 
	at sun.reflect.GeneratedMethodAccessor42.invoke(Unknown Source) 
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) 
	at java.lang.reflect.Method.invoke(Method.java:498) 
	at com.pega.pegarules.internal.bootstrap.PRBootstrap.invokeMethod(PRBootstrap.java:370) 
	at com.pega.pegarules.internal.bootstrap.PRBootstrap.invokeMethodPropagatingThrowable(PRBootstrap.java:411) 
	at com.pega.pegarules.boot.internal.extbridge.AppServerBridgeToPega.invokeMethodPropagatingThrowable(AppServerBridgeToPega.java:224) 
	at com.pega.pegarules.boot.internal.extbridge.AppServerBridgeToPega.invokeMethod(AppServerBridgeToPega.java:273) 
	at com.pega.pegarules.internal.etier.mdb.PRAsyncBoot.onMessage(PRAsyncBoot.java:91) 
	at sun.reflect.GeneratedMethodAccessor41.invoke(Unknown Source) 
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) 
	at java.lang.reflect.Method.invoke(Method.java:498) 
	at org.jboss.as.ee.component.ManagedReferenceMethodInterceptor.processInvocation(ManagedReferenceMethodInterceptor.java:52) 
	at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) 
	at org.jboss.invocation.WeavedInterceptor.processInvocation(WeavedInterceptor.java:53) 
	at org.jboss.as.ee.component.interceptors.UserInterceptorFactory$1.processInvocation(UserInterceptorFactory.java:63) 
	at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) 
	at org.jboss.invocation.WeavedInterceptor.processInvocation(WeavedInterceptor.java:53) 
	at org.jboss.as.ee.component.interceptors.UserInterceptorFactory$1.processInvocation(UserInterceptorFactory.java:63) 
	at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) 
	at org.jboss.as.ejb3.component.invocationmetrics.ExecutionTimeInterceptor.processInvocation(ExecutionTimeInterceptor.java:43) 
	at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) 
	at org.jboss.as.ejb3.tx.EjbBMTInterceptor.handleInvocation(EjbBMTInterceptor.java:104) 
	at org.jboss.as.ejb3.tx.BMTInterceptor.processInvocation(BMTInterceptor.java:60) 
	at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) 
	at org.jboss.invocation.InitialInterceptor.processInvocation(InitialInterceptor.java:21) 
	at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) 
	at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) 
	at org.jboss.as.ee.component.interceptors.ComponentDispatcherInterceptor.processInvocation(ComponentDispatcherInterceptor.java:53) 
	at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) 
	at org.jboss.as.ejb3.component.pool.PooledInstanceInterceptor.processInvocation(PooledInstanceInterceptor.java:51) 
	at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) 
	at org.jboss.as.ejb3.component.interceptors.CurrentInvocationContextInterceptor.processInvocation(CurrentInvocationContextInterceptor.java:41) 
	at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) 
	at org.jboss.as.ejb3.component.invocationmetrics.WaitTimeInterceptor.processInvocation(WaitTimeInterceptor.java:43) 
	at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) 
	at org.jboss.as.ejb3.security.SecurityContextInterceptor.processInvocation(SecurityContextInterceptor.java:86) 
	at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) 
	at org.jboss.as.ejb3.component.interceptors.ShutDownInterceptorFactory$1.processInvocation(ShutDownInterceptorFactory.java:64) 
	at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) 
	at org.jboss.as.ejb3.component.interceptors.LoggingInterceptor.processInvocation(LoggingInterceptor.java:59) 
	at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) 
	at org.jboss.as.ee.component.NamespaceContextInterceptor.processInvocation(NamespaceContextInterceptor.java:50) 
	at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) 
	at org.jboss.as.ejb3.component.interceptors.AdditionalSetupInterceptor.processInvocation(AdditionalSetupInterceptor.java:55) 
	at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) 
	at org.jboss.as.ejb3.component.messagedriven.MessageDrivenComponentDescription$5$1.processInvocation(MessageDrivenComponentDescription.java:203) 
	at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) 
	at org.jboss.as.ee.component.TCCLInterceptor.processInvocation(TCCLInterceptor.java:45) 
	at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) 
	at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) 
	at org.jboss.as.ee.component.ViewService$View.invoke(ViewService.java:185) 
	at org.jboss.as.ee.component.ViewDescription$1.processInvocation(ViewDescription.java:185) 
	at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) 
	at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) 
	at org.jboss.as.ee.component.ProxyInvocationHandler.invoke(ProxyInvocationHandler.java:73) 
	at javax.jms.MessageListener$$$view11.onMessage(Unknown Source) 
	at sun.reflect.GeneratedMethodAccessor40.invoke(Unknown Source) 
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) 
	at java.lang.reflect.Method.invoke(Method.java:498) 
	at org.jboss.as.ejb3.inflow.MessageEndpointInvocationHandler.doInvoke(MessageEndpointInvocationHandler.java:140) 
	at org.jboss.as.ejb3.inflow.AbstractInvocationHandler.invoke(AbstractInvocationHandler.java:73) 
	at com.sun.proxy.$Proxy22.onMessage(Unknown Source) 
	at org.hornetq.ra.inflow.HornetQMessageHandler.onMessage(HornetQMessageHandler.java:330) 
	at org.hornetq.core.client.impl.ClientConsumerImpl.callOnMessage(ClientConsumerImpl.java:1117) 
	at org.hornetq.core.client.impl.ClientConsumerImpl.access$500(ClientConsumerImpl.java:57) 
	at org.hornetq.core.client.impl.ClientConsumerImpl$Runner.run(ClientConsumerImpl.java:1252) 
	at org.hornetq.utils.OrderedExecutorFactory$OrderedExecutor$1.run(OrderedExecutorFactory.java:105) 
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) 
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) 
	at java.lang.Thread.run(Thread.java:748) 
2017-10-19 14:13:54,378 [l-threads-736802151)] [  STANDARD] [                    ] [                    ] (    se

Show Less
To see attachments, please log in.
Low-Code App Development
Data Integration
System Administration

Posted: 7 years ago
Posted: 20 Oct 2017 4:26 EDT
Bharat Bhushan Soma (BharatBhushanSoma)
Accenture

Accenture
US

Hello Sudhakar, 

I have attached the log file as requested. 

Lines 233-280 is valid for one file that has been picked by listener and processed by two listeners successfully

Lines 305-2552 is valid for other file that has been picked by listeners.(Error starts at line 365 for recovery of file by listener B. But this same file has been processed(line-352) and deleted from completed folder after processing[Since we have the cleanup File operation as "Delete" in process tab and this works correctly]. At Line 365 , listener B tries to recover the file that has already been processed and deleted and it is unable to find it probably  )

Attached the process tab cleanup File operation.

For your comment for "PropertyValueInvalid", I assume it is not because of property because listener is trying to recover a file that has already been deleted from completed folder and might have recovered only a part of it and chance of missing the full property value here .I am unable to come to a conclusion though.

Can we trace File Listener?

Let me know if anything is needed additionally from my end.

To see attachments, please log in.

We'd prefer it if you saw us at our best.

Pega Collaboration Center has detected you are using a browser which may prevent you from experiencing the site as intended. To improve your experience, please update your browser.

Close Deprecation Notice