Methods of Programatically Updating Dataset Rules
Our client has created around 1350 datasets that need to have their Repo and File Path changed as part of a applictation migration. All of the sets of changes are the same: Changing the FilePath and the Repo. I'm looking for a programatic solution, preferably a detailed one. I know that general structure is likely something along the lines of "Obj-Open, Property-Set, Obj-Save" but given that this is manipulation of a actual pega rule and not a instance of a created class, I have reservations and a non-perfect understanding of anything else that might need to happen. (IE, any validation, any special rules around creating a new instance of Data-Admin-DataSet-File)
Our client has created around 1350 datasets that need to have their Repo and File Path changed as part of a applictation migration. All of the sets of changes are the same: Changing the FilePath and the Repo. I'm looking for a programatic solution, preferably a detailed one. I know that general structure is likely something along the lines of "Obj-Open, Property-Set, Obj-Save" but given that this is manipulation of a actual pega rule and not a instance of a created class, I have reservations and a non-perfect understanding of anything else that might need to happen. (IE, any validation, any special rules around creating a new instance of Data-Admin-DataSet-File)
To shortcut a few questions that will likely be asked, in an attempt to come up with a better solution then updating a thousand data sets: 1. Can't we update the Repo the current Datasets are pointing at? No. This is a Pega Cloud Env. The new repo to be used needs to be the default S3 repo, and we were informed that we cannot update a non-default repo to point to that location. 2. Is it necessary to update all of these data sets? We do not have a "short list" of important ones, or any other criteria to identify which ones need to be updated and which don't. We do not have the time to redesign the clients solution to use less data sets. We have tried to consider any clever/useful solutions that we would normally go with to avoid this level of effort, but I can say with a fair level of confidence that there is no magic bullet/redesign availible to us at this time, hence the need for manual/programatic updates. At a high level, I'm looking for a reference activity that does this. It doesn't matter if it's something OOB, or something that was custom made for similar purposes.
Pegasystems Inc.
GB
@wallj1 I am unable to find any references. Below a GenAI response.
You may want to discuss this internally with the PO of Decision Management team.
: "To programmatically change the repository and file path for multiple datasets in Pega, you can follow these steps. This approach involves using Pega's Repository API and automating the process through activities or data flows. Here is a detailed solution:
1. **Create a Data Transform or Activity**: This will be used to iterate over the datasets and update their repository and file path.
2. **Fetch the Datasets**: Use a Report Definition or a Data Page to fetch all the datasets that need to be updated.
3. **Update Repository and File Path**: For each dataset, use the `Property-Set` method to update the repository and file path properties.
4. **Save the Changes**: Use the `Obj-Save` method to save the changes to each dataset.
nHere is a sample activity that demonstrates this process:
```plaintext
Activity: UpdateDatasets
1. Step: Fetch Datasets
Method: Obj-Browse
Class: Your-Dataset-Class
Properties: [List of properties to fetch]
Where: [Conditions to filter the datasets]
2. Step: Loop through the results
Method: ForEachPage
PageList: .pxResults
3. Step: Update Repository and File Path
Method: Property-Set
@wallj1 I am unable to find any references. Below a GenAI response.
You may want to discuss this internally with the PO of Decision Management team.
: "To programmatically change the repository and file path for multiple datasets in Pega, you can follow these steps. This approach involves using Pega's Repository API and automating the process through activities or data flows. Here is a detailed solution:
1. **Create a Data Transform or Activity**: This will be used to iterate over the datasets and update their repository and file path.
2. **Fetch the Datasets**: Use a Report Definition or a Data Page to fetch all the datasets that need to be updated.
3. **Update Repository and File Path**: For each dataset, use the `Property-Set` method to update the repository and file path properties.
4. **Save the Changes**: Use the `Obj-Save` method to save the changes to each dataset.
nHere is a sample activity that demonstrates this process:
```plaintext
Activity: UpdateDatasets
1. Step: Fetch Datasets
Method: Obj-Browse
Class: Your-Dataset-Class
Properties: [List of properties to fetch]
Where: [Conditions to filter the datasets]
2. Step: Loop through the results
Method: ForEachPage
PageList: .pxResults
3. Step: Update Repository and File Path
Method: Property-Set
Properties:
.Repository = \"NewRepository\"
.FilePath = \"New/File/Path\"
4. Step: Save Changes
Method: Obj-Save
WriteNow: true
5. Step: Commit Changes\
Method: Commit
```
5. **Test the Activity**: Before running the activity in production, test it in a staging environment to ensure it works as expected
6. **Execute the Activity**: Run the activity to update all the datasets.
This approach ensures that all datasets are updated programmatically, reducing the risk of manual errors and saving time.
⚠ This is a GenAI-powered tool. All generated answers require validation against the provided references.
Can we set File Listener path dynamically ?
How to dynamically change attachments storage directory when using Repository
Preparing for data migration > 2 Configure data migration settings