Skip to main content

This content is closed to future replies and is no longer being maintained or updated.
Links may no longer function. If you have a similar request, please write a new post.

Question

 Lanh NguyenTrung (LANH（ラン）)
Toyota System
Pega developer
Toyota System
JP
LANH（ラン） Member since 2018 15 posts
Toyota System
Posted: Dec 8, 2020
Last activity: Jan 4, 2021
Posted: 8 Dec 2020 0:38 EST
Last activity: 4 Jan 2021 10:48 EST
Closed

Download large data to excel file (max 500,000 records)

We have a requirement to download a large data from Postgres (max 500,000 records) to excel file. We using Export to Excel on Report Definition but performance too high, CPU 25% on AP server and 20% on DB server and it take 30min for one request. Any one can suggest me another way to improve the performance  

Thanks and regards,

LanhNT7 

***Edited by Moderator: Pooja Gadige to add platform capability tag***
To see attachments, please log in.
Pega Platform 8.4.2
Reporting
Data Integration
System Architect

Posted: 4 years ago
Updated: 4 years ago
Posted: 10 Dec 2020 21:31 EST
Updated: 11 Dec 2020 2:26 EST
Lanh NguyenTrung (LANH（ラン）)
Toyota System
Pega developer
Toyota System
JP

We use Connect-SQL to execute COPY SQL but don't know how to set export path to download, anyone can help me ?

Thanks and regards,

LanhNT7

To see attachments, please log in.
Posted: 4 years ago
Posted: 4 Jan 2021 10:48 EST
Prakash Deep Rai (PrakashDeep)
Aaseya IT Services Pvt LTD
Prakash Deep Rai
Aaseya IT Services Pvt LTD
IN

Have you done any data formatting on any columns. Also, are you directly doing download from Report definition or are you doing download from a grid  of displayed results.

To see attachments, please log in.

Related content:

Question

Import large Data file(1 Million Records) to Pega Table

Question Solved

How to handle large data (around 100,000 records) in a file using a file listener.Is there any best option to achieve the same?

Question

Export a large number of records (100,000+) to excel from OOTB report browser

Question

Issue in Opening downloaded CSV file with Japanese characters in Excel

Question

How to export workpage data to excel into "Files & documents" section?

Question Solved

How can a Report definition fetch 500 records if pagenation is disabled and even max records are also disabled.

Question Solved

Unable to search all the records in a view since default record count is 500

Question

Our Application is built on PRPC6.3 SP1. We are planning to Refactor -> Rename a class. Is it going to update the existing work objects in the table? Our application has more than 500,000 work cases.

Question

Table with large data support (about 600,000 rows in DB and pagination with 1,000 rows per page)

Question Solved

Workbasket Max out at 500

We'd prefer it if you saw us at our best.

Pega Collaboration Center has detected you are using a browser which may prevent you from experiencing the site as intended. To improve your experience, please update your browser.

Close Deprecation Notice