Recommended frequency for data migration data sets refresh in CDH
Hi,
We have configured data migration pipeline and are getting sampled customers and scenario planner actuals data into BOE from Prod. We had faced an issue earlier wherein if we run pipeline every day the sampled customers data set will update, resulting in issues with value finder tool (eg data mismatch). We have noticed DataMigrationIntervalsInDays decision table where we can set when this data set should get exported/imported. This has been updated to set sampled customers interval as 7 days and others as 0 (whenever pipeline is executed).
Data migration pipeline has been changed from weekly once to every day since we need action performance tracker to get latest data. I would like to understand how often we should refresh sampled customers? Is there any recommedations how often value finder tool should be run?