Error Handling in File Listener
I have a Listener and it should process 1 million records every day by saving them to a DB and how to handle errors if there is any issue after process say 1005 record .
My main questions are
1.How to roll back already processed records.
2. How to re run this after error
Thanks in advance
Coforge Technologies (Erstwhile Incessant Technologies)
GB
could you please provide more info on whether it is on a single listener event only need to process all 1 million records at a time. Do you want to rollback all the transactions even if 1 transaction fails?
Pegasystems Inc.
IN
Ideally we are trying to commit for every 100 records, so for eg: if 1010 record is failed we will roll back only 10 records, next time will reading the records again it will read all the first 1000 records, so this is my problem.. how to skip the records that are already processed (we can check for duplicate but dont want to do this for all the million records if the failure is some where near 5 lakh record )
Coforge Technologies (Erstwhile Incessant Technologies)
GB
- The cleanup option under error tab would keep the file with err as file extension.
- would it make sense to have one more file listener to process *.err files...
- otherwise on exception/error ...
- we could capture all the data and save/write the data back to a dedicated error database table
- initiate the data sync process to original table using agent rule to process data...
Pegasystems Inc.
IN
This also works fine...if you have alrady worked on this kind scenario, can you provide the design what you have followed in any of the real time implementations
