Effective Strategies for Consuming Millions of Records in Pega
How can Pega effectively consume millions of records while ensuring optimal performance and scalability? What are the different possible solutions and strategies that can be employed to handle large data volumes efficiently within the Pega application?
1. Data Intake from Message Queue
2. Data Intake from DB table
3. Data Intake from Kafka queues
4. Data Intake in file
DXC
AU
@AKSHAY You should use Data Flow to push the record from the external source whichever source you have be it MQ/Kafka/file.
Create DataFlow and through that, you can inject the data into the Pega database, if you design it effectively it will not have issues we are using it and its working fine.
Good design thing will be to use external Cassandra so that system will not perform good.