Question
NTT DATA Italia
IT
Last activity: 16 Aug 2023 11:30 EDT
Kafka send bulk messages
Hi,
we are creating a Kafka configuration instance in order to send messages to Kafka. We want to customize "linger.ms" and "batch.size" producer properties, in order to send bulk messages, is this possible in Pega?
If not, what are "linger.ms" and "batch.size" default values?
As written in Pega documentation, in the "Configuration Properties" tab, we can upload a configuration file containing the following properties:
"metadata.max.age.ms",
"send.buffer.bytes",
"receive.buffer.bytes",
"client.id",
"reconnect.backoff.ms",
"reconnect.backoff.max.ms",
"retries",
"retry.backoff.ms",
"metrics.sample.window.ms",
"metrics.num.samples",
"metrics.recording.level",
"metric.reporters",
"security.protocol",
"connections.max.idle.ms",
"request.timeout.ms",
"ssl.protocol",
"ssl.provider",
"ssl.cipher.suites",
"ssl.enabled.protocols",
"ssl.keystore.type",
"ssl.keystore.location",
"ssl.keystore.password",
"ssl.key.password",
"ssl.truststore.type",
"ssl.truststore.location",
"ssl.truststore.password",
"ssl.keymanager.algorithm",
"ssl.trustmanager.algorithm",
"ssl.endpoint.identification.algorithm",
"ssl.secure.random.implementation",
"sasl.mechanism",
"sasl.jaas.config",
"sasl.kerberos.service.name",
Hi,
we are creating a Kafka configuration instance in order to send messages to Kafka. We want to customize "linger.ms" and "batch.size" producer properties, in order to send bulk messages, is this possible in Pega?
If not, what are "linger.ms" and "batch.size" default values?
As written in Pega documentation, in the "Configuration Properties" tab, we can upload a configuration file containing the following properties:
"metadata.max.age.ms",
"send.buffer.bytes",
"receive.buffer.bytes",
"client.id",
"reconnect.backoff.ms",
"reconnect.backoff.max.ms",
"retries",
"retry.backoff.ms",
"metrics.sample.window.ms",
"metrics.num.samples",
"metrics.recording.level",
"metric.reporters",
"security.protocol",
"connections.max.idle.ms",
"request.timeout.ms",
"ssl.protocol",
"ssl.provider",
"ssl.cipher.suites",
"ssl.enabled.protocols",
"ssl.keystore.type",
"ssl.keystore.location",
"ssl.keystore.password",
"ssl.key.password",
"ssl.truststore.type",
"ssl.truststore.location",
"ssl.truststore.password",
"ssl.keymanager.algorithm",
"ssl.trustmanager.algorithm",
"ssl.endpoint.identification.algorithm",
"ssl.secure.random.implementation",
"sasl.mechanism",
"sasl.jaas.config",
"sasl.kerberos.service.name",
"sasl.kerberos.kinit.cmd",
"sasl.kerberos.ticket.renew.window.factor",
"sasl.kerberos.ticket.renew.jitter",
"sasl.kerberos.min.time.before.relogin".
Is any of these useful to achieve our goal?
Pegasystems Inc.
GB
@Gianni Montevidoni In Pega, you cannot directly customize the "linger.ms" and "batch.size" producer properties. The list of properties you mentioned from the Pega documentation does not include these specific properties. However, you can still achieve efficient bulk messaging by tuning other available properties to optimize the performance of your Kafka configuration instance.
As a Support Center moderator, I reviewed the answer and references for accuracy