Question
Bank Frick
LI
Last activity: 2 Apr 2025 14:39 EDT
Creating a Kafka data set with JSON data transform (Refered another JSON datatransform for reusable objects/fields ) causing/throwing errors.
Hi Team,
We have created a kafka dataset referring JSON datatranform as mentioned in the below screenshot.
The main datatransform has referenced another JSON datatransform as it has the same object/fields.
When we configured the dataset in the dataflow(realtime) we are getting errors as mentioned below.
Hi Team,
We have created a kafka dataset referring JSON datatranform as mentioned in the below screenshot.
The main datatransform has referenced another JSON datatransform as it has the same object/fields.
When we configured the dataset in the dataflow(realtime) we are getting errors as mentioned below.
2025-03-31 16:01:10,072 [ STANDARD] ( dataset.kafka.KafkaBrowseOperation) ERROR - Error deserializing stream while reading from Kafka topic com.pega.dsm.dnode.api.dataset.kafka.KafkaDataSet$KafkaDataSetBuilder$$Lambda$5062/0x0000000801fae040@3befa329 com.pega.pegarules.pub.PRRuntimeException: LegacyModelAspectInvokableRuleContainer.invoke-Exception com.pega.pegarules.pub.PRRuntimeException: Could not find Rule-Obj-Model MapAttributeObjectData with applies to class in the database at com.pega.platform.executionengine.vtable.containers.internal.LegacyModelAspectInvokableRuleContainer.invoke(LegacyModelAspectInvokableRuleContainer.java:76) ~[execution-engine.jar:?] at com.pega.platform.executionengine.vtable.internal.RuleDispatcherImpl.invokeModel(RuleDispatcherImpl.java:165) ~[execution-engine.jar:?] at com.pega.decision.dsm.strategy.clipboard.DSMPegaAPI.applyModel(DSMPegaAPI.java:333) ~[prpublic.jar:?] at com.pega.decision.dsm.strategy.clipboard.DSMPegaAPI.applyModel(DSMPegaAPI.java:304) ~[prpublic.jar:?] at com.pega.dsm.kafka.api.serde.DataTransformSerde.deserializeWithUsageOfJsonDataTransform(DataTransformSerde.java:156) ~[d-node.jar:?] at com.pega.dsm.kafka.api.serde.DataTransformSerde.deserialize(DataTransformSerde.java:108) ~[d-node.jar:?] at com.pega.dsm.kafka.api.serde.LazyExceptionHandlingSerDe.deserialize(LazyExceptionHandlingSerDe.java:77) ~[d-node.jar:?] at com.pega.dsm.dnode.impl.dataset.kafka.KafkaBrowseOperation.deserializeMessage(KafkaBrowseOperation.java:347) ~[d-node.jar:?] at com.pega.dsm.dnode.impl.dataset.kafka.KafkaBrowseOperation.convertRecordToClipboardPage(KafkaBrowseOperation.java:302) ~[d-node.jar:?] at com.pega.dsm.dnode.impl.dataset.kafka.KafkaBrowseOperation.processRecords(KafkaBrowseOperation.java:210) ~[d-node.jar:?] at com.pega.dsm.dnode.impl.dataset.kafka.KafkaBrowseOperation.processRecords(KafkaBrowseOperation.java:167) ~[d-node.jar:?] at com.pega.dsm.dnode.impl.dataset.kafka.KafkaBrowseOperation.processRecords(KafkaBrowseOperation.java:157) ~[d-node.jar:?] at com.pega.dsm.dnode.impl.dataset.kafka.KafkaBrowseOperation.processRecordsAndComplete(KafkaBrowseOperation.java:149) ~[d-node.jar:?] at com.pega.dsm.dnode.impl.dataset.kafka.KafkaBrowseOperation.lambda$browse$0(KafkaBrowseOperation.java:145) ~[d-node.jar:?] at com.pega.dsm.dnode.impl.stream.DataObservableImpl$SafeDataSubscriber.subscribe(DataObservableImpl.java:353) ~[d-node.jar:?] at com.pega.dsm.dnode.impl.stream.DataObservableImpl.subscribe(DataObservableImpl.java:55) ~[d-node.jar:?] at com.pega.dsm.dnode.impl.dataflow.resilience.retry.RetryableBrowse$RetryableEmitter.produceRecords(RetryableBrowse.java:145) ~[d-node.jar:?] at com.pega.dsm.dnode.impl.dataflow.resilience.retry.RetryableBrowse$RetryableEmitter.emit(RetryableBrowse.java:111) ~[d-node.jar:?] at com.pega.dsm.dnode.impl.stream.DataObservableImpl$SafeDataSubscriber.subscribe(DataObservableImpl.java:353) ~[d-node.jar:?] at com.pega.dsm.dnode.impl.stream.DataObservableImpl.subscribe(DataObservableImpl.java:55) ~[d-node.jar:?] at com.pega.dsm.dnode.impl.stream.DataObservableImpl$3.emit(DataObservableImpl.java:176) ~[d-node.jar:?] at com.pega.dsm.dnode.impl.stream.DataObservableImpl$SafeDataSubscriber.subscribe(DataObservableImpl.java:353) ~[d-node.jar:?] at com.pega.dsm.dnode.impl.stream.DataObservableImpl.subscribe(DataObservableImpl.java:55) ~[d-node.jar:?] at com.pega.dsm.dnode.api.dataflow.DataFlow$3.run(DataFlow.java:446) ~[d-node.jar:?] at com.pega.dsm.dnode.api.dataflow.DataFlow$3.run(DataFlow.java:439) ~[d-node.jar:?] at com.pega.dsm.dnode.util.PrpcRunnable.execute(PrpcRunnable.java:77) ~[d-node.jar:?] at com.pega.dsm.dnode.impl.dataflow.DataFlowThreadContext.lambda$submitInput$8(DataFlowThreadContext.java:308) ~[d-node.jar:?] at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515) ~[?:?] at com.google.common.util.concurrent.TrustedListenableFutureTask$TrustedFutureInterruptibleTask.runInterruptibly(TrustedListenableFutureTask.java:125) ~[guava-25.1-jre.jar:?] at com.google.common.util.concurrent.InterruptibleTask.run(InterruptibleTask.java:57) ~[guava-25.1-jre.jar:?] at com.google.common.util.concurrent.TrustedListenableFutureTask.run(TrustedListenableFutureTask.java:78) ~[guava-25.1-jre.jar:?] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128) ~[?:?] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) ~[?:?] at com.pega.dsm.dnode.util.PrpcRunnable$1.run(PrpcRunnable.java:69) ~[d-node.jar:?] at com.pega.dsm.dnode.util.PrpcRunnable$1.run(PrpcRunnable.java:66) ~[d-node.jar:?] at com.pega.dsm.dnode.util.PrpcRunnable.execute(PrpcRunnable.java:77) ~[d-node.jar:?] at com.pega.dsm.dnode.impl.prpc.PrpcThreadFactory$PrpcThread.run(PrpcThreadFactory.java:164) ~[d-node.jar:?] Caused by: com.pega.pegarules.pub.PRRuntimeException: Could not find Rule-Obj-Model MapAttributeObjectData with applies to class in the database at com.pega.pegarules.data.internal.clipboard.mapping.ClipboardDataStreamMapAssembler.openRule(ClipboardDataStreamMapAssembler.java:183) ~[prprivate-data.jar:?] at com.pega.pegarules.data.internal.clipboard.mapping.ClipboardDataStreamMapAssembler.handleApplyDataTransform(ClipboardDataStreamMapAssembler.java:156) ~[prprivate-data.jar:?] at com.pega.pegarules.data.internal.clipboard.mapping.ClipboardDataStreamMapAssembler.handleMappingActions(ClipboardDataStreamMapAssembler.java:146) ~[prprivate-data.jar:?] at com.pega.pegarules.data.internal.clipboard.mapping.ClipboardDataStreamMapAssembler.handleUpdateContext(ClipboardDataStreamMapAssembler.java:237) ~[prprivate-data.jar:?] at com.pega.pegarules.data.internal.clipboard.mapping.ClipboardDataStreamMapAssembler.handleMappingActions(ClipboardDataStreamMapAssembler.java:140) ~[prprivate-data.jar:?] at com.pega.pegarules.data.internal.clipboard.mapping.ClipboardDataStreamMapAssembler.handleUpdateContext(ClipboardDataStreamMapAssembler.java:237) ~[prprivate-data.jar:?] at com.pega.pegarules.data.internal.clipboard.mapping.ClipboardDataStreamMapAssembler.handleMappingActions(ClipboardDataStreamMapAssembler.java:140) ~[prprivate-data.jar:?] at com.pega.pegarules.data.internal.clipboard.mapping.ClipboardDataStreamMapAssembler.handleUpdateContext(ClipboardDataStreamMapAssembler.java:237) ~[prprivate-data.jar:?] at com.pega.pegarules.data.internal.clipboard.mapping.ClipboardDataStreamMapAssembler.handleMappingActions(ClipboardDataStreamMapAssembler.java:140) ~[prprivate-data.jar:?] at com.pega.pegarules.data.internal.clipboard.mapping.ClipboardDataStreamMapAssembler.assembleMap(ClipboardDataStreamMapAssembler.java:103) ~[prprivate-data.jar:?] at com.pega.pegarules.data.internal.clipboard.mapping.json.ClipboardJSONMapAssembler.assembleMap(ClipboardJSONMapAssembler.java:77) ~[prprivate-data.jar:?] at com.pega.pegarules.data.internal.clipboard.mapping.EntityMapBuilderImpl.buildEntityMapFromModel(EntityMapBuilderImpl.java:147) ~[prprivate-data.jar:?] at com.pegarules.generated.model.ra_model_mapidnowwebhooknotificationkafkadatasettopega_84989e4bbf88193cc59b69e995f0cbd9.perform(ra_model_mapidnowwebhooknotificationkafkadatasettopega_84989e4bbf88193cc59b69e995f0cbd9.java:67) ~[?:?] at com.pega.platform.executionengine.vtable.containers.internal.LegacyModelAspectInvokableRuleContainer.invoke(LegacyModelAspectInvokableRuleContainer.java:67) ~[execution-engine.jar:?]
Quick response can be appreciated.
Thanks
Som Venkata Kumar
HCA Healthcare
US
@Som@BankFrick The error you're encountering suggests that the Rule-Obj-Model mapping for the transformation is missing or incorrectly configured. It seems the MapAttributeObjectData rule isn't found in the database for the class you're working with. To resolve this, check if the rule exists and is applied to the correct class in your dataset and Data Transform. Ensure the referenced Data Transform is correctly set up and that all fields and objects in the JSON are properly mapped. Additionally, verify that your Kafka data stream contains all the necessary fields expected by the Data Transform. Check the class and field mappings in both your main and referenced Data Transforms to ensure consistency, and review the real-time Data Flow configuration for any missing data or inputs during runtime.
Bank Frick
LI
@Sairohith : Thanks for your reply.
The datatransform "MapAttributeObjectData" is correctly configured and it has the access during the runtime.
when i executed the dataset independently for browsing the KAFKA messages there is no issues and it works fine.
when i executed this from the dataflow it is throwing the above error.
Thanks
Som Venkata Kumar
HCA Healthcare
US
@Som@BankFrick Since the MapAttributeObjectData Data Transform works independently but fails within the Data Flow, the issue could be related to how the Data Flow is configured or how it handles Kafka messages. Ensure the Data Flow is passing the correct context and parameters to the Data Transform, as some required data might be missing or incorrectly passed during execution. Double-check the Data Flow configuration to ensure the mappings between Kafka data and the class are consistent. There may also be a timing or data consistency issue when processing Kafka messages in batches through the Data Flow. Additionally, review error handling within the Data Flow to ensure any exceptions are properly logged for further insight into the issue.