Question
Estes
US
Last activity: 26 Jul 2023 20:24 EDT
Creating 50K cases through Queue Processor
Hi All
I have a requirement to create 50K cases daily by reading the data from an external System of Records. I am currently queuing the items to a QP for case creation.
There are two stream nodes in the environment. I have observed that the current configuration is not providing the desired throughput and taking longer times in the creation of the 50K records.
Looking for any recommendations on improving the Queue Performance or any alternate ways to implement the solution.
Any recommendations for scaling out the stream nodes to add more nodes?
Regards
@AnandrajT7685
Performance has two dimensions: the time to process a message and the total message throughput. You can increase performance by completing one or both of the following actions:
Reference material - https://docs-previous.pega.com/system-administration/86/queue-processor-faq#6
Few more suggestions are -
Dedicated Queue: Use a dedicated queue for case creation to avoid contention with other processes, ensuring optimal performance.
Consider Asynchronous Architecture: Depending on the requirements and use case, consider building an asynchronous architecture where the case creation process is decoupled from the data reading process. This approach can provide better scalability and fault tolerance.
Hope this helps.