Skip to main content

This content is closed to future replies and is no longer being maintained or updated.
Links may no longer function. If you have a similar request, please write a new post.

Question

 Naveen Kumar Gattupally (Naveen Naanu) Vodafone Senior Manger
Vodafone
IN
Naveen Naanu Member since 2019 6 posts
Vodafone
Posted: Apr 21, 2019
Last activity: Apr 22, 2019
Posted: 21 Apr 2019 21:30 EDT
Last activity: 22 Apr 2019 8:50 EDT
Closed

Data flow pause/resume feature

We have a requirement to process 7L+ of records from external DB. Considering the performance, we have chosen the Dataflow - Dataset to read the external DB records with thread count as 20 records per sec with multinode batch processing. the feature is absolutely working fine.

Since there are no filter options in a dataset like RD, if the Agent in data flow has read 3Lakhs record and due to natural calamity the system got down for a period of time and when it gets back to the stable state, the data set in the dataflow is reading the records from 1. However it already read and processed 3 Lakhs of record, our expectations are to read from 3Lakh+ record.

Is there any way to resolve this issue? We are using Pega 7.3 version.

To see attachments, please log in.
Pega Platform Data Integration Decision Management

Posted: 5 years ago
Posted: 22 Apr 2019 8:50 EDT
Naveen Kumar Gattupally (Naveen Naanu) Vodafone Senior Manger
Vodafone
IN

Hello YashwanthBabu, 

Thanks for your response, we are using data set type: Database Table. 

Is there any way to see batch processing node information in the clipboard? 

 

Regards,
Naveen

To see attachments, please log in.

We'd prefer it if you saw us at our best.

Pega Collaboration Center has detected you are using a browser which may prevent you from experiencing the site as intended. To improve your experience, please update your browser.

Close Deprecation Notice