@ProsunG  ⚠ This is a GenAI-powered tool. All generated answers require validation against the provided references.

Below some info on the process.

Understanding the Components

Before diving into testing, let's clarify what we're working with:

1. File Listeners monitor specific directories for incoming files that match defined patterns. When the files are detected, they trigger processing.
2. Types of Files:
   • Manifest Files: XML files with metadata about data files
   • Data Files: Contain the actual data to be ingested
   • Token Files: Serve as triggers for the data ingestion process
3. D_pxListFiles Data Page: This is a read-only API that lists files and folders in a repository folder.
4. Run Date Timestamps: Dates/times incorporated into file names, typically in formats like yyyy-MM-dd or yyyyMMdd.

Step-by-Step Guide for Testing

1. Access Dev Studio

First, log in to Dev Studio to access the data page functionality.

2. Identify the Repository Configuration

You need to know:

• The repository name (e.g., "pegacloudfilestorage" for Pega Cloud)
• The folder path where your file listener is fetching files from

3. Run the D_pxListFiles Data Page

1. In Dev Studio, navigate to Records > Data Model > Data Page
2. Search for and select D_pxListFiles
3. Click Actions > Run in the upper-right corner
4. Set the parameters:
   • repositoryName: Enter your repository name (e.g., "pegacloudfilestorage")
   • folderPath: Enter the folder path that contains your files
   • Check UsePagination if dealing with many files
5. Click Run

4. Examine the Results

The data page returns a list of files in the specified folder. Now you need to identify your manifest, data, and token files with run date timestamps.

5. Filtering for Files with Timestamps

To specifically test files with run date timestamps:

1. Examine the returned list for your files with timestamps in their names
2. Look for patterns like:
   • manifest_20250227.xml
   • data_20250227.csv
   • token_20250227.tok

6. Creating a Test Wrapper (Optional)

For more controlled testing, you can create a simple activity that:

1. Calls the D_pxListFiles data page
2. Extracts and filters files with timestamps
3. Performs specific tests on these files

7. Testing Specific Files

To test a specific file:

1. Once you've identified the files with timestamps, you can:
   • Use D_pxGetFile data page to retrieve the file contents
   • Pass the appropriate repository name and full file path (including timestamp)
   • Examine the file contents to verify they're correct

8. Testing with Dynamic Timestamps

If you need to test with today's or a specific date's timestamp:

1. Use Pega's date functions to generate the appropriate timestamp format
2. Concatenate it with your file name patterns
3. Then search for files matching this pattern

For example, to test today's files:

String todayFormatted = @Today.format("yyyyMMdd");

String manifestFileName = "manifest_" + todayFormatted + ".xml";

String dataFileName = "data_" + todayFormatted + ".csv";

String tokenFileName = "token_" + todayFormatted + ".tok";

9. Verifying the File Listener Processing

To verify that the file listener is correctly processing files with timestamps:

1. Check if the token file with the timestamp was processed
2. Verify that the corresponding manifest and data files were also processed
3. Look for any error logs related to file processing

Example Scenario

Let's say your file listener is set up to process files with this naming pattern:

• manifest_YYYYMMDD.xml
• data_YYYYMMDD.csv
• token_YYYYMMDD.tok

Where YYYYMMDD is the run date in format "20250227" for February 27, 2025.

To test these files using the D_pxListFiles data page:

1. Run D_pxListFiles with your repository name and folder path
2. From the results, filter the files containing today's date in the format YYYYMMDD
3. Verify that all three file types (manifest, data, token) exist for the same date
4. Use D_pxGetFile to retrieve and examine each file's contents

References:

• Using repository APIs in your application
• Using file listeners
• Configuring pagination parameters for file storage repositories