Skip to main content

This content is closed to future replies and is no longer being maintained or updated.
Links may no longer function. If you have a similar request, please write a new post.

Question

 sharath potla (sharathp1914)
Anthem Blue Cross Blue Shield

Anthem Blue Cross Blue Shield
US
sharathp1914 Member since 2019 9 posts
Anthem Blue Cross Blue Shield
Posted: Sep 24, 2019
Last activity: Sep 25, 2019
Posted: 24 Sep 2019 22:50 EDT
Last activity: 25 Sep 2019 14:19 EDT
Closed

Kafka connection issue.

Hello all,

We are working on establishing the kafka connection in pega 7.3.1 version. When I am testing with the test connection in the kafka dataset I am able to connect.

But while I am ran the dataflow when the external team publishing data on the kafka topic I could not able to process data to the kafka dataset.

I am seeing following errors in the logs:

Show More

Hello all,

We are working on establishing the kafka connection in pega 7.3.1 version. When I am testing with the test connection in the kafka dataset I am able to connect.

But while I am ran the dataflow when the external team publishing data on the kafka topic I could not able to process data to the kafka dataset.

I am seeing following errors in the logs:

Caused by: com.pega.dsm.dnode.api.dataflow.StageException: Exception in stage: ProductUpdates_TS_Test
at com.pega.dsm.dnode.api.dataflow.StageException.create(StageException.java:39) ~[dnode-7.3.1.jar:?]
at com.pega.dsm.dnode.api.dataflow.DataFlowStage$StageOutputSubscriber.onError(DataFlowStage.java:486) ~[dnode-7.3.1.jar:?]
at com.pega.dsm.dnode.api.dataflow.DataFlowStage$StageInputSubscriber.onError(DataFlowStage.java:354) ~[dnode-7.3.1.jar:?]
at com.pega.dsm.dnode.impl.stream.DataObservableImpl$SafeDataSubscriber.onError(DataObservableImpl.java:302) ~[dnode-7.3.1.jar:?]
at com.pega.dsm.dnode.api.stream.DataSubscriber.onError(DataSubscriber.java:60) ~[dnode-7.3.1.jar:?]
at com.pega.dsm.dnode.impl.stream.DataObservableImpl$SafeDataSubscriber.onError(DataObservableImpl.java:302) ~[dnode-7.3.1.jar:?]
at com.pega.dsm.dnode.impl.dataset.kafka.KafkaBrowseOperation.processRecords(KafkaBrowseOperation.java:180) ~[dnode-7.3.1.jar:?]
at com.pega.dsm.dnode.impl.dataset.kafka.KafkaBrowseOperation.access$000(KafkaBrowseOperation.java:50) ~[dnode-7.3.1.jar:?]
at com.pega.dsm.dnode.impl.dataset.kafka.KafkaBrowseOperation$1.emit(KafkaBrowseOperation.java:99) ~[dnode-7.3.1.jar:?]
at com.pega.dsm.dnode.impl.stream.DataObservableImpl$SafeDataSubscriber.subscribe(DataObservableImpl.java:335) ~[dnode-7.3.1.jar:?]
at com.pega.dsm.dnode.impl.stream.DataObservableImpl.subscribe(DataObservableImpl.java:53) ~[dnode-7.3.1.jar:?]
at com.pega.dsm.dnode.impl.stream.DataObservableImpl$2.emit(DataObservableImpl.java:158) ~[dnode-7.3.1.jar:?]
at com.pega.dsm.dnode.impl.stream.DataObservableImpl$SafeDataSubscriber.subscribe(DataObservableImpl.java:335) ~[dnode-7.3.1.jar:?]
at com.pega.dsm.dnode.impl.stream.DataObservableImpl.subscribe(DataObservableImpl.java:53) ~[dnode-7.3.1.jar:?]
at com.pega.dsm.dnode.api.dataflow.DataFlow$2.run(DataFlow.java:405) ~[dnode-7.3.1.jar:?]
at com.pega.dsm.dnode.api.dataflow.DataFlow$2.run(DataFlow.java:399) ~[dnode-7.3.1.jar:?]
at com.pega.dsm.dnode.util.PrpcRunnable.execute(PrpcRunnable.java:52) ~[dnode-7.3.1.jar:?]
at com.pega.dsm.dnode.impl.dataflow.DataFlowThreadContext$1.run(DataFlowThreadContext.java:151) ~[dnode-7.3.1.jar:?]
... 10 more
Caused by: com.pega.dsm.dnode.api.ExceptionWithInputRecord: java.lang.IllegalStateException: Cannot parse json
at com.pega.dsm.dnode.impl.dataset.kafka.KafkaBrowseOperation.processRecords(KafkaBrowseOperation.java:180) ~[dnode-7.3.1.jar:?]
at com.pega.dsm.dnode.impl.dataset.kafka.KafkaBrowseOperation.access$000(KafkaBrowseOperation.java:50) ~[dnode-7.3.1.jar:?]
at com.pega.dsm.dnode.impl.dataset.kafka.KafkaBrowseOperation$1.emit(KafkaBrowseOperation.java:99) ~[dnode-7.3.1.jar:?]
at com.pega.dsm.dnode.impl.stream.DataObservableImpl$SafeDataSubscriber.subscribe(DataObservableImpl.java:335) ~[dnode-7.3.1.jar:?]
at com.pega.dsm.dnode.impl.stream.DataObservableImpl.subscribe(DataObservableImpl.java:53) ~[dnode-7.3.1.jar:?]
at com.pega.dsm.dnode.impl.stream.DataObservableImpl$2.emit(DataObservableImpl.java:158) ~[dnode-7.3.1.jar:?]
at com.pega.dsm.dnode.impl.stream.DataObservableImpl$SafeDataSubscriber.subscribe(DataObservableImpl.java:335) ~[dnode-7.3.1.jar:?]
at com.pega.dsm.dnode.impl.stream.DataObservableImpl.subscribe(DataObservableImpl.java:53) ~[dnode-7.3.1.jar:?]
at com.pega.dsm.dnode.api.dataflow.DataFlow$2.run(DataFlow.java:405) ~[dnode-7.3.1.jar:?]
at com.pega.dsm.dnode.api.dataflow.DataFlow$2.run(DataFlow.java:399) ~[dnode-7.3.1.jar:?]
at com.pega.dsm.dnode.util.PrpcRunnable.execute(PrpcRunnable.java:52) ~[dnode-7.3.1.jar:?]
at com.pega.dsm.dnode.impl.dataflow.DataFlowThreadContext$1.run(DataFlowThreadContext.java:151) ~[dnode-7.3.1.jar:?]
... 10 more
Caused by: java.lang.IllegalStateException: Cannot parse json
at com.pega.dsm.dnode.util.ClipboardPageJsonConverter.adoptJson(ClipboardPageJsonConverter.java:369) ~[dnode-7.3.1.jar:?]
at com.pega.dsm.dnode.util.ClipboardPageJsonConverter.adoptJson(ClipboardPageJsonConverter.java:198) ~[dnode-7.3.1.jar:?]
at com.pega.dsm.dnode.impl.dataset.kafka.KafkaBrowseOperation.convertRecordToClipboardPage(KafkaBrowseOperation.java:218) ~[dnode-7.3.1.jar:?]
at com.pega.dsm.dnode.impl.dataset.kafka.KafkaBrowseOperation.processRecords(KafkaBrowseOperation.java:167) ~[dnode-7.3.1.jar:?]
at com.pega.dsm.dnode.impl.dataset.kafka.KafkaBrowseOperation.access$000(KafkaBrowseOperation.java:50) ~[dnode-7.3.1.jar:?]
at com.pega.dsm.dnode.impl.dataset.kafka.KafkaBrowseOperation$1.emit(KafkaBrowseOperation.java:99) ~[dnode-7.3.1.jar:?]

Thanks.

***Edited by Moderator: Lochan to move post from Pega Academy to PSC***


Show Less
To see attachments, please log in.
Pega Customer Decision Hub
Decision Management

Posted: 5 years ago
Posted: 25 Sep 2019 2:58 EDT
Nishitha Chintala (chinn2)
PEGA
Principal Cloud Development Engineer, Management Plane Services
Pegasystems Inc.
IN

Hi,

Can you please attach the data flow configuration.

From the above logs I have observed that exception is coming at ' ProductUpdates_TS_Test' component.

What is that component? Is it a strategy or Dataflow.

I have also observed 'Caused by: java.lang.IllegalStateException: Cannot parse json' exception.

What is the data that you are trying to push to kafka dataset?

To see attachments, please log in.
Posted: 5 years ago
Posted: 25 Sep 2019 10:46 EDT
sharath potla (sharathp1914)
Anthem Blue Cross Blue Shield

Anthem Blue Cross Blue Shield
US

Hello,

Thanks for the response.

We are using Dataflow rule to load data. I have attached the dataflow configuration and the Json format. please help us to resolve this issue.

Thanks,

Sharath.

 

To see attachments, please log in.
Posted: 5 years ago
Posted: 25 Sep 2019 14:19 EDT
Kevin Zheng (KevinZheng_GCS)
PEGA
Director, Technical Support
Pegasystems Inc.
US

Looks like the ClipboardPageJsonConverter cannot handle the data used.  Later on we completely rewrote the deserializer, I wonder the outcome of a newer Pega release.  Do you have a Pega 8.x system to test with the same data?

To see attachments, please log in.

We'd prefer it if you saw us at our best.

Pega Collaboration Center has detected you are using a browser which may prevent you from experiencing the site as intended. To improve your experience, please update your browser.

Close Deprecation Notice