Is it safe to increase the thread count of a stream node or a custom node? How does it impact performance of the platform ? how to increase the number of threads and what should be the max limit for each queue processor?
You set the "number of threads per node" on the Queue Processor rule form. But keep in mind that this is the maximum number per node for this queue processor and only 20 total threads across the cluster can process messages.
Thank you for the information. I understand that the maximum thread count of a cluster should not be more than 20. Howvever, I do have a question around changing the value in Admin Studio. How do we permanently change the thread count for pyProcessNotification and pyFTSIncrementalIndexer? I can only see a private edit option while trying to increase the thread count (Screenshot Attached).
You can save a copy of the OOTB pyFTSIncrementalIndexer rule into an application ruleset with an increased number of threads. Then go to Configure -> General -> System Runtime Context. Add your application to the list. Then after the node restarts, it will use the customized rule.