Question
Lloyds Banking Group
GB
Last activity: 5 Nov 2021 11:57 EDT
Regarding PEGA MLOPs
Hi All,
I was trying to implement the the latest feature provided by PEGA in the prediction studio , where we can based on the performance of the current model, replace it with a new model in a shadow mode. While going through the process to do this, I came across a portion where it says , that once we submit a request for replacing the model, a change request automatically gets created in the Operation Manager's worklist, from where he can approve and deploy the package in production.
However, I haven't been able to to find, where and how this case/change request gets created and was wondering ,if anyone could explain this?
Regards
Pujayita
-
Like (0)
-
Share this page Facebook Twitter LinkedIn Email Copying... Copied!
Updated: 5 Nov 2021 1:15 EDT
Pegasystems Inc.
IN
@pujayitac The change request is visible as part of the 1:1 Operations Manager offering. The ops manager application needs to be added to see those change requests
Pegasystems Inc.
IN
@pujayitac You need to be on Ops manager overlay where we can trigger the model update process. Once , we have replaced / shadowed the model -> We create the a CR which get auto resolved ( Can be verified through Team lead). This is where we take the necessary rules and put it as part of the Revision overlay.
Lloyds Banking Group
GB
@achas1 The Ops Manager overlay application is present. From the prediction model, I have tried to replace an existing model with a new model. Once the model is in place, it is in a status, "Ready to review". At this stage, according to PEGA, there a change request automatically created at the ops manager end and once he/she verifies and approves it, it can be deployed into production as a revision package and the model starts shadowing.
Hope I could explain the issue.
Now , my trouble is, I don't see any case getting created in the operations manager. The model is in "Ready to Review" state and that is it. I don't know how to approve it and proceed? Could you please guide me through that.
Regards
Pujayita
Pegasystems Inc.
NL
@pujayitac On Pega Academy, we have some content (a module and a challenge) on MLOps that may be of use to you.
Updated: 5 Nov 2021 6:26 EDT
Pegasystems Inc.
IN
@pujayitac if the data scientist performs the Model update process inside the ops manager overlay where he/she should approve the the model in "Ready for review" . Post approval , the new model would replace or start shadowing the active model . ( You would see the model status as "Shadow").
In the mean time , the Ops cr case should get created and auto-resolved as it doesn't need any further intervention from Team lead.
if you are still not able to visualize the case object , it could be because of 1) Revision has passed the due date hence we are not accepting any further CR.
2) any genuine exception where the issue could be in terms of the meta data parsing/processing. Do you see anything in the logs ?
@dhimn Can you help here.
Pegasystems Inc.
IN
@pujayitac just to confirm the problem, is the issue that the model approval is not happening on Click of the Evaluate button below after Ready for review. Check image below. What is happening after click of Save here. Is there any log messages generated.
Lloyds Banking Group
GB
@mitra2Thanks for the screenshot.
i have clicked evaluate button.
still it stays in ready to review mode
any thoughts on that??
Pegasystems Inc.
IN
@pujayitac Need to investigate this more. Please open a support ticket and we can take a look at the system.
Pegasystems Inc.
US
Hi @pujayitac, there are some pre-requisite steps for setting up 1:1 Operations Manager. Have you completed those steps? https://community.pega.com/knowledgebase/articles/pega-customer-decision-hub-implementation-guide/86/implementing-pega-11-operations-manager .
If you have configured 1:1 Operations Manager per the implementation guide, do you have an active Revision? This is the parent case that contains all change requests. The change request for the model prediction will not be automatically created if the Revision is missing or inactive.