Question
Senior Consultant
CH
Last activity: 26 Sep 2019 10:51 EDT
Error in the Data flow "DF_ProcessResponse" while storing Actuals
Summary:
After changing the Customer Spine from "PegaMKT-Data-Customer", in Pega Marketing 7.31, the campaign execution is getting failed.
All the steps present in the Installation guide was followed while configuring the Customer spine.
Analysis:
1) After configuring Multichannel campaign, seed list is performed. This test will be successful.
2) But when this Campaign is scheduled to run then it fails.
Error Message:
Primary error message in Batch Processing Data flow landing page is:
"The run failed, because it exceeds the maximum number of failed record, which is currently set to 0"
Summary:
After changing the Customer Spine from "PegaMKT-Data-Customer", in Pega Marketing 7.31, the campaign execution is getting failed.
All the steps present in the Installation guide was followed while configuring the Customer spine.
Analysis:
1) After configuring Multichannel campaign, seed list is performed. This test will be successful.
2) But when this Campaign is scheduled to run then it fails.
Error Message:
Primary error message in Batch Processing Data flow landing page is:
"The run failed, because it exceeds the maximum number of failed record, which is currently set to 0"
"com.pega.dsm.dnode.api.dataflow.StageException: Exception in stage: Actuals at com.pega.dsm.dnode.api.dataflow.StageException.create(StageException.java:37) at com.pega.dsm.dnode.api.dataflow.DataFlowStage$StageInputSubscriber.onCompleted(DataFlowStage.java:385) at com.pega.dsm.dnode.api.dataflow.DataFlowExecutor$QueueBasedDataFlowExecutor$5.process(DataFlowExecutor.java:325) at com.pega.dsm.dnode.api.dataflow.DataFlowExecutor$QueueBasedDataFlowExecutor.runEventLoop(DataFlowExecutor.java:194) at com.pega.dsm.dnode.api.dataflow.DataFlow$1.emit(DataFlow.java:284) at com.pega.dsm.dnode.impl.stream.DataObservableImpl.subscribe(DataObservableImpl.java:57) at com.pega.dsm.dnode.impl.dataflow.task.strategy.ExecutionStrategy.executeDataFlow(ExecutionStrategy.java:90) at com.pega.dsm.dnode.impl.dataflow.task.strategy.SinglePartitionExecution.executePartitions(SinglePartitionExecution.java:56) at com.pega.dsm.dnode.impl.dataflow.task.ExecutePartitionsTask.execute(ExecutePartitionsTask.java:11) at com.pega.dsm.dnode.impl.dataflow.task.PickupRunTask$ExecutePartitionsRunnable$1.run(PickupRunTask.java:148) at com.pega.dsm.dnode.impl.dataflow.task.PickupRunTask$ExecutePartitionsRunnable$1.run(PickupRunTask.java:145) at com.pega.dsm.dnode.util.PrpcRunnable.execute(PrpcRunnable.java:52) at com.pega.dsm.dnode.impl.prpc.service.ServiceHelper.executeInPrpcContextInternal(ServiceHelper.java:212) at com.pega.dsm.dnode.impl.prpc.service.ServiceHelper.executeInPrpcContext(ServiceHelper.java:87) at com.pega.dsm.dnode.impl.dataflow.task.PickupRunTask$ExecutePartitionsRunnable.run(PickupRunTask.java:145) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at com.google.common.util.concurrent.TrustedListenableFutureTask$TrustedFutureInterruptibleTask.runInterruptibly(TrustedListenableFutureTask.java:108) at com.google.common.util.concurrent.InterruptibleTask.run(InterruptibleTask.java:41) at com.google.common.util.concurrent.TrustedListenableFutureTask.run(TrustedListenableFutureTask.java:77) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at com.pega.dsm.dnode.util.PrpcRunnable$1.run(PrpcRunnable.java:44) at com.pega.dsm.dnode.util.PrpcRunnable$1.run(PrpcRunnable.java:41) at com.pega.dsm.dnode.util.PrpcRunnable.execute(PrpcRunnable.java:52) at com.pega.dsm.dnode.impl.prpc.PrpcThreadFactory$PrpcThread.run(PrpcThreadFactory.java:109) Caused by: java.lang.NullPointerException at com.pegarules.generated.pxGetCollectionConfigurationFromCa_071031_VzZYnZEJ1tdpLRaymHUsWg.pxGetCollectionConfigurationFromCache07_10_31(pxGetCollectionConfigurationFromCa_071031_VzZYnZEJ1tdpLRaymHUsWg.java:121) at com.pegarules.generated.pxGetCollectionConfigurationFromCa_071031_VzZYnZEJ1tdpLRaymHUsWg.invoke(pxGetCollectionConfigurationFromCa_071031_VzZYnZEJ1tdpLRaymHUsWg.java:96) at com.pega.pegarules.generation.internal.library.LibraryRuntime.resolveAndinvokeFunctionViaReflection(LibraryRuntime.java:222) at com.pega.pegarules.generation.internal.library.LibraryRuntime.invokeLibraryRuntime(LibraryRuntime.java:119) at com.pega.pegarules.session.internal.mgmt.Executable.invokeLibraryRuntime(Executable.java:9201) at com.pega.pegarules.priv.generator.LibrarySupport.resolveAndInvokeFunctionViaReflectionWithException(LibrarySupport.java:275) at com.pegarules.generated.pxInsertRecordsFromPages_071033_KOU023XMs_v3_xgnS5Bl_A.pxInsertRecordsFromPages07_10_33(pxInsertRecordsFromPages_071033_KOU023XMs_v3_xgnS5Bl_A.java:198) at com.pegarules.generated.pxInsertRecordsFromPages_071033_KOU023XMs_v3_xgnS5Bl_A.invoke(pxInsertRecordsFromPages_071033_KOU023XMs_v3_xgnS5Bl_A.java:95) at com.pega.pegarules.generation.internal.library.LibraryRuntime.resolveAndinvokeFunctionViaReflection(LibraryRuntime.java:222) at com.pega.pegarules.generation.internal.library.LibraryRuntime.invokeLibraryRuntime(LibraryRuntime.java:119) at com.pega.pegarules.session.internal.mgmt.Executable.invokeLibraryRuntime(Executable.java:9201) at com.pega.pegarules.priv.generator.LibrarySupport.resolveAndInvokeFunctionViaReflectionWithException(LibrarySupport.java:275) at com.pegarules.generated.dataset.ra_action_actuals_04d6ae038c229fb0310373e5cdb3e87a$2$1.emit(ra_action_actuals_04d6ae038c229fb0310373e5cdb3e87a.java:177) at com.pega.dsm.dnode.impl.stream.DataObservableImpl$SafeDataSubscriber.subscribe(DataObservableImpl.java:335) at com.pega.dsm.dnode.impl.stream.DataObservableImpl.subscribe(DataObservableImpl.java:53) at com.pega.dsm.dnode.impl.stream.DataObservableImpl.await(DataObservableImpl.java:99) at com.pega.dsm.dnode.impl.stream.DataObservableImpl.await(DataObservableImpl.java:88) at com.pega.dsm.dnode.impl.dataflow.SaveStageProcessor.onNext(SaveStageProcessor.java:107) at com.pega.dsm.dnode.api.dataflow.DataFlowStageBatchProcessor.commitBatchInternal(DataFlowStageBatchProcessor.java:120) at com.pega.dsm.dnode.api.dataflow.DataFlowStageBatchProcessor.commitBatch(DataFlowStageBatchProcessor.java:104) at com.pega.dsm.dnode.api.dataflow.DataFlowStageBatchProcessor.onCompleted(DataFlowStageBatchProcessor.java:90) at com.pega.dsm.dnode.api.dataflow.DataFlowStage$StageInputSubscriber.onCompleted(DataFlowStage.java:381) ... 23 more"
Step to Reproduce:
1) Create new customer spine and modify in application settings
2) Create an email or SMS multichannel campaign with single proposition.
3) Optional: Perform seedlist test in campaign level, which will work.
4) Run the campaign
5) Check the data flow landing page
6) Failed Data flow along with Campaign id (P-XX) will be listed.
7) Try to restart the data flow and it will fail in DF_ProcessResponse at step where "Actuals" is getting updated.
Option Tried
1) Reconfigured the DNode and made sure Node are Normal/online.
2) All campaign-related Agents are running
Please let me know if there any solution for fixing the "Actuals" VBD.
Hi,
Are the DDS and Real-Time Data Grid Node showing as Normal status?
Did we look at the logs to see what was the real reason of the Data flow failures? If not then I suggest you look at the logs as it will provide more details.
Also on the data flow work item, Please click on the number under the Failed column and then click on View Details in the popup that gets launched to see the real exception.