I would like to understand one design question related to ADM model updates. Lets say I have 2 ADM nodes and the volume of my ADM responses is 50k/day(Example). What is the best number of responses I can use as the model update frequency?
Ex: If I give model update frequency as 500, then the models gets updated around 100 times/day.
But if give model update frequency as 5000(Default), then the models gets updated around 10 times/day.
I would like to understand what is the ideal count of model updates with 2 ADM nodes.
***Edited by Moderator Marissa to add Capability tags***
From a functional perspective you would want each model instance to be updated several times per day, let's say every 2 hours. It doesn't need to be updated every minute as the customer behaviour (concept drift) isn't expected to change rapidly. If you then know the average frequency of responses for a model instance you can calculate back what a good value for this setting would be. For example, if a typical call center offer receives 1000 responses per hour, you could choose a setting of 2000, aiming for an update to happen approximately every 2 hours.
From a technical perspective you can monitor the ADM nodes, whose task it is to update the models, to check if there are many updates pending, and if the average waiting time to update a model is long. Those would be a sign to add an additional ADM worker node.