Skip to main content

This content is closed to future replies and is no longer being maintained or updated.
Links may no longer function. If you have a similar request, please write a new post.

Question

 Yining Lu (YiningL16940366)
Infosys
Yining Lu
Infosys
US
YiningL16940366 Member since 2023 16 posts
Infosys
Posted: Sep 5, 2019
Last activity: Sep 14, 2019
Posted: 5 Sep 2019 19:34 EDT
Last activity: 14 Sep 2019 8:03 EDT
Closed
Solved

how to use Hive to retrieve data from Hadoop Distributed File System (HDFS)

We have business data stored in Parquet files on Hadoop Distributed File System (HDFS). Our Data Solutions team asks us to use Hive (HiveQL) to retrieve data. Does PRPC support using HiveQL to retrieve data from HDFS? If yes, can you please provide related technical/help documents on how to do it? If not, what is the approach that Pega recommends? We are using Pega Platform 8.2.3

***Edited by Moderator: Lochan to tag SR***

To see attachments, please log in.
Data Integration
Support Case Exists

Accepted Solution

Posted: 5 years ago
Posted: 6 Sep 2019 11:00 EDT
Nithin Kamath (kaman) Product Manager, Decisioning Data
Pegasystems Inc.
NL

We dont support HiveQL. However if you have your data in the form of parquet files in HDFS , you can use the HDFS Dataset to map and access the data. Please refer to the links below for more information,

https://community.pega.com/knowledgebase/release-note/hdfs-data-sets-support-parquet-files

https://community.pega.com/sites/default/files/help_v81/procomhelpmain.htm#rule-/rule-decision-/rule-decision-dataset/dataset-hdfs-creating-tsk.htm

 

To see attachments, please log in.

Accepted Solution

Posted: 5 years ago
Posted: 6 Sep 2019 11:00 EDT
Nithin Kamath (kaman) Product Manager, Decisioning Data
Pegasystems Inc.
NL

We dont support HiveQL. However if you have your data in the form of parquet files in HDFS , you can use the HDFS Dataset to map and access the data. Please refer to the links below for more information,

https://community.pega.com/knowledgebase/release-note/hdfs-data-sets-support-parquet-files

https://community.pega.com/sites/default/files/help_v81/procomhelpmain.htm#rule-/rule-decision-/rule-decision-dataset/dataset-hdfs-creating-tsk.htm

 

To see attachments, please log in.

We'd prefer it if you saw us at our best.

Pega Collaboration Center has detected you are using a browser which may prevent you from experiencing the site as intended. To improve your experience, please update your browser.

Close Deprecation Notice