Question
Lloyds Banking Group
GB
Last activity: 2 Jul 2021 4:16 EDT
Scenario testing using Deployment Manager not giving correct results.
We are trying to use Run Pega Scenario Test step in Deployment manager and using CrossBrowserTesting as the service provider. If we run the Test Suite manually from Dev studio it fails (as some of the test cases are failing and Pass percentage is not 100%) but when we are running the same test suite from deployment manager its passing everytime. Also, the test suite is running in CrossBrowser Testing tool but returning a Pass result always. We are expecting it to fail when the test cases included in the suite don't pass and result is not 100%. So, we are not getting correct results for run Pega Scenario test when used in Deployment manager. Can anyone help with this please.
Here is the step config in Deployment manager:
Vodafone India Ltd
IN
Thanks for the detailed info, we are able to reproduce this issue in our internal systems. We are actively working on this and the fix will be available in upcoming version (1.3) of PegaTestAutomationKit.
The tentative release date for next release is July 2nd week and it will be available at below link.
https://community.pega.com/marketplace/components/pega-test-automation-kit
Thanks,
Srikanth
Vodafone India Ltd
IN
This needs fixes in both applications PegaTestAutomationKit and DeploymentManager, so this would be available once PegaTestAutomationKit (1.3) and Deployment Manager (5.4) are available.
Hope this answers your question.