Question
TheHartford
CA
Last activity: 11 Sep 2023 11:44 EDT
How to generate AWS External table definition JSON for loading data
we are migrating data from oracle onprem to postgres on pegacloud.
we have the DDLs and data to load to pega cloud but AWS expects a JSON definition file like below to load the data, it is all manual json file creation for each table and the order of the columns must match from the DDLs. Has anyone done this with any tool or automated way, manual way is time taking and risky to errors. This is just a sample, we have 100s of tables with lot of columns in each.
we are migrating data from oracle onprem to postgres on pegacloud.
we have the DDLs and data to load to pega cloud but AWS expects a JSON definition file like below to load the data, it is all manual json file creation for each table and the order of the columns must match from the DDLs. Has anyone done this with any tool or automated way, manual way is time taking and risky to errors. This is just a sample, we have 100s of tables with lot of columns in each.
{ "TableCount": "1", "Tables": [ { "TableName": "pr_other", "TablePath": "pegadata/pr_other", "TableOwner": "pegadata", "TableColumns": [ { "ColumnName": "pxcommitdatetime", "ColumnType": "DATETIME" }, { "ColumnName": "pxsavedatetime", "ColumnType": "DATETIME" }, { "ColumnName": "pxupdateopname", "ColumnType": "STRING", "ColumnLength": "128" }, { "ColumnName": "pxupdateoperator", "ColumnType": "STRING", "ColumnLength": "128" }, { "ColumnName": "pxupdatesystemid", "ColumnType": "STRING", "ColumnLength": "32" }, { "ColumnName": "pylabel", "ColumnType": "STRING", "ColumnLength": "64" }, { "ColumnName": "pzinskey", "ColumnType": "STRING", "ColumnLength": "255" }, { "ColumnName": "pzpvstream", "ColumnType": "BLOB", } ], "TableColumnsTotal": "8" } ] }