While trying to upgrade from PEGA 7.1.8 to 7.3.1,we are facing the below mentioned error message and the upgrade fails.
[java] Caused by: com.pega.pegarules.data.ddl.DatabaseException: com.microsoft.sqlserver.jdbc.SQLServerException: The dependencies reported for entity "dbo.sp_PEGA_ALERTCODES_DATA" might not include references to all columns. This is either because the entity references an object that does not exist or because of an error in one or more statements in the entity. Before rerunning the query, ensure that there are no errors in the entity and that all objects referenced by the entity exist.

Planning to do an “In-place upgrade” on the Rules and Data schema to upgrade from PRPC 718 to 731.On a side note, do you recommend UPGRADE or UPDATE from the version 718 to 731 ?

I have tried “generate DDL” option set to TRUE and FALSE as well in the upgrade.bat script.In either case, same DB error has been reported in the SR has been observed.

PFA for the setupDatabase.properties file.

Command used to start the upgrade script : upgrade.bat

Please find the complete error stack below.

Buildfile: C:\Softwares\115631_Pega7.31\scripts\setupDatabase.xml

upgrade:

startover_or_resume:
[pega:propertyparser] Reading Properties from: C:\Softwares\115631_Pega7.31\scripts/setupDatabase.properties
[pega:compareconnectiondetails] resume props file path = C:\Softwares\115631_Pega7.31\scripts/resume.properties
[echo] Detected resume.properties, but found mismatch in db configuration between setupDatabase.properties and resume.properties
[echo] Starting over upgrade...
[echo] Performing upgrade...

Initialization:
[echo] Performing Upgrade Finalization
[echo] Using logging configuration from: ./config/deploylogging.properties
[delete] Deleting: C:\Softwares\115631_Pega7.31\scripts\resume.properties
[delete] Deleting directory C:\Softwares\115631_Pega7.31\scripts\taskRuntimes
[mkdir] Created dir: C:\Softwares\115631_Pega7.31\scripts\taskRuntimes
[delete] Deleting: C:\Softwares\115631_Pega7.31\scripts\logs\Warnings.log
[pega:propertyparser] Reading Properties from: C:\Softwares\115631_Pega7.31\scripts/setupDatabase.properties
[pega:propertyparser] pega.jdbc.driver.class=com.microsoft.sqlserver.jdbc.SQLServerDriver
[pega:propertyparser] update.existing.applications=false
[pega:propertyparser] bypass.udf.generation=true
[pega:propertyparser] pega.jdbc.password=*****
[pega:propertyparser] update.applications.schema=false
[pega:propertyparser] automatic.resume=true
[pega:propertyparser] pega.jdbc.driver.jar=C:\Compass\sqljdbc4.jar
[pega:propertyparser] rules.schema.name=PEGA_RULES
[pega:propertyparser] rebuild.indexes=false
[pega:propertyparser] run.ruleset.cleanup=false
[pega:propertyparser] pega.jdbc.url=jdbc:sqlserver://DBD_PEGA.CORP.AGP.ADS\PEGA1D;databaseName=CSX3D;SelectMethod=cursor;SendStringParametersAsUnicode=false
[pega:propertyparser] pega.database.type=mssql
[pega:propertyparser] user.temp.dir=
[pega:propertyparser] pega.platform.userids.issecure=false
[pega:propertyparser] production.level=2
[pega:propertyparser] pega.zos.properties=
[pega:propertyparser] pega.jdbc.username=pegadevuser
[pega:propertyparser] bypass.pega.schema=true
[pega:propertyparser] multitenant.system=false
[pega:propertyparser] system.name=pega
[pega:propertyparser] data.schema.name=dbo
[echo] *** JVM Arguments -XX:MaxHeapSize=1280m ***
[propertyfile] Creating new property file: C:\Softwares\115631_Pega7.31\scripts\resume.properties
[propertyfile] Updating property file: C:\Softwares\115631_Pega7.31\scripts\resume.properties
[pega:hasenoughspace] Found 7033720KB of free space on 'C:\Users\AD4256~1.AGP\AppData\Local\Temp\'
[echo] setting to generated ddl
[echo] Driver Path: C:\Compass\sqljdbc4.jar
[mkdir] Created dir: C:\Users\AD4256~1.AGP\AppData\Local\Temp\PegaInstallTemp-28-November-2017-17.15.02\load
[mkdir] Created dir: C:\Users\AD4256~1.AGP\AppData\Local\Temp\PegaInstallTemp-28-November-2017-17.15.02\pr_temp
[touch] Creating C:\Softwares\115631_Pega7.31\scripts\logs\Warnings.log
[echo] Using C:\Users\AD4256~1.AGP\AppData\Local\Temp\/PegaInstallTemp-28-November-2017-17.15.02 for install scratch space...
[unzip] Expanding: C:\Softwares\115631_Pega7.31\archives\prweb.war into C:\Users\AD4256~1.AGP\AppData\Local\Temp\PegaInstallTemp-28-November-2017-17.15.02\load
[unzip] Expanding: C:\Softwares\115631_Pega7.31\archives\pegadbinstall-classes.zip into C:\Users\AD4256~1.AGP\AppData\Local\Temp\PegaInstallTemp-28-November-2017-17.15.02\load
[copy] Copying 1 file to C:\Users\AD4256~1.AGP\AppData\Local\Temp\PegaInstallTemp-28-November-2017-17.15.02\load\WEB-INF\classes
[copy] Copying 1 file to C:\Users\AD4256~1.AGP\AppData\Local\Temp\PegaInstallTemp-28-November-2017-17.15.02

Checking Configuration Files:
[echo] Rules schema has been set to 'PEGA_RULES'
[echo] ***writing resume property upgrade.from.version=07-10-18 to file***
[propertyfile] Updating property file: C:\Softwares\115631_Pega7.31\scripts\resume.properties
[echo] Upgrading from Pega-RULES product version 07-10-18

Processing Configuration Files:
[propertyfile] Creating new property file: C:\Users\AD4256~1.AGP\AppData\Local\Temp\PegaInstallTemp-28-November-2017-17.15.02\prbootstrap.properties

Configuration:
[echo] Database Type: mssql
[echo] JDBC Driver JAR: C:\Compass\sqljdbc4.jar
[echo] Bootstrap Config: C:\Users\AD4256~1.AGP\AppData\Local\Temp\/PegaInstallTemp-28-November-2017-17.15.02/prbootstrap.properties
[echo] PegaRULES Config: C:\Users\AD4256~1.AGP\AppData\Local\Temp\/PegaInstallTemp-28-November-2017-17.15.02/prconfig.xml
[echo] PegaRULES Logging Config: C:\Users\AD4256~1.AGP\AppData\Local\Temp\/PegaInstallTemp-28-November-2017-17.15.02/prlog4j2.xml
[echo] Deployment Logging Config: ./config/deploylogging.properties

Generate Upgrade DDL:
[mkdir] Created dir: C:\Softwares\115631_Pega7.31\schema\generated\mssql\upgrade
[mkdir] Created dir: C:\Softwares\115631_Pega7.31\schema\generated\mssql\util
[pega:executesqlintransaction] Execute SQL In Transaction:false

_clean:
[echo] Cleaning up previous invocation...
[delete] Deleting directory C:\Softwares\115631_Pega7.31\schema\generated\mssql
[echo] Cleaning up previous invocation...(Complete)

_createOutputDirs:
[echo] Creating output directory at C:\Softwares\115631_Pega7.31\scripts/../schema/generated/mssql
[mkdir] Created dir: C:\Softwares\115631_Pega7.31\schema\generated\mssql

_callDDLUtilityUpgrade:
[echo] Call DDL Generation Upgrade Utility...
[echo] C:\Softwares\115631_Pega7.31\scripts/lib/xercesImpl.jar;C:\Softwares\115631_Pega7.31\scripts/lib/xml-apis.jar;C:\Softwares\115631_Pega7.31\scripts/lib/resolver.jar;
[echo] archive_dir: C:\Softwares\115631_Pega7.31\scripts/lib
[java] 2017-11-28 17:15:27,160 ( install) INFO - Initializing properties with default values
[java] 2017-11-28 17:15:27,191 ( install) INFO - Setting default Entity Value for pega_enable_nologging = true
[java] 2017-11-28 17:15:27,191 ( install) INFO - Getting database metadata
[java] 2017-11-28 17:15:36,738 ( install) INFO - Reading views from schema "dbo"
[java] 2017-11-28 17:15:36,832 ( install) INFO - Reading procedures from schema "dbo"
[java] Exception in thread "main" java.lang.RuntimeException: Error during execution of upgrade on platform mssql using schemas PEGA_RULES, dbo
[java] at com.pega.pegarules.data.ddl.SchemaGenerator.main(SchemaGenerator.java:1654)
[java] Caused by: com.pega.pegarules.data.ddl.DatabaseException: com.microsoft.sqlserver.jdbc.SQLServerException: The dependencies reported for entity "dbo.sp_PEGA_ALERTCODES_DATA" might not include references to all columns. This is either because the entity references an object that does not exist or because of an error in one or more statements in the entity. Before rerunning the query, ensure that there are no errors in the entity and that all objects referenced by the entity exist.
[java] at com.pega.pegarules.data.ddl.SchemaManager.<init>(SchemaManager.java:437)
[java] at com.pega.pegarules.data.ddl.SchemaManager.<init>(SchemaManager.java:477)
[java] at com.pega.pegarules.data.ddl.SchemaGenerator.saveCurrentSchemaState(SchemaGenerator.java:571)
[java] at com.pega.pegarules.data.ddl.SchemaGenerator.main(SchemaGenerator.java:1476)
[java] Caused by: com.microsoft.sqlserver.jdbc.SQLServerException: The dependencies reported for entity "dbo.sp_PEGA_ALERTCODES_DATA" might not include references to all columns. This is either because the entity references an object that does not exist or because of an error in one or more statements in the entity. Before rerunning the query, ensure that there are no errors in the entity and that all objects referenced by the entity exist.
[java] at com.microsoft.sqlserver.jdbc.SQLServerException.makeFromDatabaseError(SQLServerException.java:197)
[java] at com.microsoft.sqlserver.jdbc.TDSTokenHandler.onEOF(tdsparser.java:246)
[java] at com.microsoft.sqlserver.jdbc.TDSParser.parse(tdsparser.java:83)
[java] at com.microsoft.sqlserver.jdbc.SQLServerResultSet.<init>(SQLServerResultSet.java:284)
[java] at com.microsoft.sqlserver.jdbc.SQLServerStatement.getNextResult(SQLServerStatement.java:1504)
[java] at com.microsoft.sqlserver.jdbc.SQLServerPreparedStatement.doExecutePreparedStatement(SQLServerPreparedStatement.java:390)
[java] at com.microsoft.sqlserver.jdbc.SQLServerPreparedStatement$PrepStmtExecCmd.doExecute(SQLServerPreparedStatement.java:340)
[java] at com.microsoft.sqlserver.jdbc.TDSCommand.execute(IOBuffer.java:4575)
[java] at com.microsoft.sqlserver.jdbc.SQLServerConnection.executeCommand(SQLServerConnection.java:1400)
[java] at com.microsoft.sqlserver.jdbc.SQLServerStatement.executeCommand(SQLServerStatement.java:179)
[java] at com.microsoft.sqlserver.jdbc.SQLServerStatement.executeStatement(SQLServerStatement.java:154)
[java] at com.microsoft.sqlserver.jdbc.SQLServerPreparedStatement.executeQuery(SQLServerPreparedStatement.java:283)
[java] at com.pega.pegarules.data.ddl.JDBCIntrospector.getDependentTableforRoutines(JDBCIntrospector.java:352)
[java] at com.pega.pegarules.data.ddl.JDBCIntrospector.readProcedures(JDBCIntrospector.java:291)
[java] at com.pega.pegarules.data.ddl.JDBCIntrospector.createDatabaseJaxbObjectByIntrospection(JDBCIntrospector.java:125)
[java] at com.pega.pegarules.data.ddl.SchemaManager.createDomDocumentFromDbIntrospection(SchemaManager.java:2026)
[java] at com.pega.pegarules.data.ddl.SchemaManager.<init>(SchemaManager.java:433)
[java] ... 3 more

BUILD FAILED
C:\Softwares\115631_Pega7.31\scripts\setupDatabase.xml:358: The following error occurred while executing this line:
C:\Softwares\115631_Pega7.31\scripts\setupDatabase.xml:2025: The following error occurred while executing this line:
C:\Softwares\115631_Pega7.31\scripts\setupDDL.xml:170: Java returned: 1

Total time: 34 seconds
2017-11-28 17:15:22,724 ( UpgradeDataModelImpl) INFO - Installed Product Versions:
2017-11-28 17:15:22,724 ( UpgradeDataModelImpl) INFO - {Instance: PEGARULES PROCESS COMMANDER!07-10 ML8, version: 06-01-25, build name: coreAssemblyCached_718_675} (current version)
2017-11-28 17:15:22,724 ( UpgradeDataModelImpl) INFO - {Instance: PEGARULES PROCESS COMMANDER!06-01 SP2, version: null, build name: coreBuild_060120_0161}
Exiting with Error