Reprocessing failed records in batch data flow runs
We need to rerun a data flow for failed records from batch processing. And we found in the article below that when you reprocess failures, you resubmit all the partitions that contain failed records to reprocess all the records that are on these partitions, whether the records failed or not during the run.
Is there any way to avoid processing success records from failed partitions and only rerun the failure records? Could someone please provide insights about this? Thank you.