Kafka commit files across multiple directories to achieve better performance of the Stream service
Hello Team,
Could you help explain the benefits of having commit files across multiple directories to achieve better performance of the Stream service?
I'm working with a JVM which has 4gb of heap, just one location for kafka commit files and takes about 1.5 hours to complete reindexing of RULES consisting of almost 2800 items.
Thanks!
-Pawan
Pegasystems Inc.
NL
@pawann let me see if I understand the ask: 1. Indexing is slow - it takes 1.5 hours, but you would expect it to be much faster. 2. You suspect that it might be because of Kafka, and would like to understand whether splitting Kafka commit files into multiple directories would help to improve indexing time.
Do I have the right understanding?
Swedbank AB
SE
@adama Yes.
My understanding comes from https://community.pega.com/knowledgebase/articles/decision-management-reference-materials/advanced-configurations-stream-service
