How to confirm the sizing of stream node
Hi all. We are upgrading to Infinity 23 and we decide to use embedded kafka not kafka cluster. I just found recommend sizing of external kafka cluster in pega docs, and my question is how can we confirm the size of stream node if we use embedded kakfa?
Accepted Solution
Updated: 10 Sep 2024 1:27 EDT
Pegasystems Inc.
GB
To confirm the size of the stream node when using embedded Kafka in Pega Infinity 23 you should follow the best practices for managing an embedded Kafka cluster. This includes managing partitions nodes and topics to ensure optimal performance. Specifically you can refer to the guidelines for configuring the stream service to handle high volumes of data and the recommendations for scaling a Kafka cluster. Additionally you can monitor and adjust the number of partitions per topic to achieve high data consumption throughput and concurrency.
⚠ This is a GenAI-powered tool. All generated answers require validation against the provided references.