Question
CGI
IN
Last activity: 30 Dec 2016 5:27 EST
What is the capacity of Pega to store stream data in clipboard
Hi,
We are going to receive data into Pega through connector/listener. It can be of any size. Do we have limitation on size of stream we can receive and store in Pega clipboard.
What is the base or setting in Pega to say that this is the maximum capacity that Pega can receive & store stream data.
Thanks in Advance!
Best Reagrds
U Rajasekhar
***Updated by Moderator: Marissa. Removed user added Ask the Expert group tag. Apologies for confusion, shouldn't have been an end-user option; updated categories***
-
Likes (1)
Saptarshi Bera -
Share this page Facebook Twitter LinkedIn Email Copying... Copied!
Accepted Solution
Pegasystems Inc.
US
As has been stated previously, there is no hard limit on clipboard size. However, your system performance - in particular, memory usage - is the limiting factor when approaching this business problem with your proposed solution in mind.
You must consider that if you're storing the file on the clipboard, that means that it's being stored in memory, in the java heap. The associated alerts (50MB by default) are to assist you in determining if BLOBs loaded from the database are growing to unexpected sizes - you can use these to help determine the cause of problems (For example, if you are seeing these alerts, and also seeing garbage collection or out of memory issues, the two are likely correlated.) The configuration settings associated for this alert threshold are detailed here: https://docs-previous.pega.com/pega0004-alert-quantity-data-received-database-query-exceeds-limit
You may need to approach sizing of your java heap with this in mind, for example if you expect to have each requestor store multiple 100MB files in their clipboard, the typical recommendations of 4-8GB heap size may be vastly insufficient for your application. You will also probably need to handle in your own business logic when to remove these large items from the clipboard so that the memory can be recycled and you do not create a memory leak in the application.
As has been stated previously, there is no hard limit on clipboard size. However, your system performance - in particular, memory usage - is the limiting factor when approaching this business problem with your proposed solution in mind.
You must consider that if you're storing the file on the clipboard, that means that it's being stored in memory, in the java heap. The associated alerts (50MB by default) are to assist you in determining if BLOBs loaded from the database are growing to unexpected sizes - you can use these to help determine the cause of problems (For example, if you are seeing these alerts, and also seeing garbage collection or out of memory issues, the two are likely correlated.) The configuration settings associated for this alert threshold are detailed here: https://docs-previous.pega.com/pega0004-alert-quantity-data-received-database-query-exceeds-limit
You may need to approach sizing of your java heap with this in mind, for example if you expect to have each requestor store multiple 100MB files in their clipboard, the typical recommendations of 4-8GB heap size may be vastly insufficient for your application. You will also probably need to handle in your own business logic when to remove these large items from the clipboard so that the memory can be recycled and you do not create a memory leak in the application.
You may also want to review the business need for the underlying business process to determine if there's a better way to process your files rather than storing them in the heap.
COFORGE DPA UK LTD
GB
Hi Rajasekhar,
BLOB size depends on the database on which pega is running. For oracle, this is Maximum size: (4 GB - 1) * DB_BLOCK_SIZE
initialization parameter (8 TB to 128 TB)
for more information you can refer detailed understaning on the link https://docs-previous.pega.com/db-lob-sizing-v54
Thanks
Gaurav
CGI
IN
Thanks Gaurav.
Do we have any limitation on clipboard Page size. If Yes, where do we configure.
Thanks & Regards
U Rajasekhar
PEG
PL
No such limitation from Pega side but there is an alert (Pega0004) which will get triggered if it reached threshold. By default threshold is 50mb.
CGI
IN
Thanks.
Do we have any limitation on clipboard Page size. If Yes, where do we configure.
Thanks & Regards
U Rajasekhar
CGI
IN
Hi
Do we have any limitation on clipboard Page size. If Yes, where do we configure.
Thanks & Regards
U Rajasekhar
CGI
IN
Hi
Do we have any limitation on clipboard Page size. If Yes, where do we configure.
Thanks & Regards
U Rajasekhar
Pegasystems Inc.
IN
Hi,
There is no such limitation on the clipboard size.
There are already alerts in place for
- too many rows in a database query
- too many members on a page list
Clipboard will grow and shrink based on contents dynamically.
You can measure the clipboard size for requestor, refer the below link.
https://community.pega.com/sites/default/files/help_v721/procomhelpmain.htm
Also to know more about the alerts
https://community.pega.com/sites/default/files/help_v717/procomhelpmain.htm
JPMorgan Chase & Company
US
Could you please let me know the business requirement and pega version.
CGI
IN
We are reading the file and storing on clipboard for futher processing.
Client asked, what is the max amount of data can be stored on clipboard?
Thanks in Advance!
Best Regards
U Rajasekhar
Coforge DPA
AU
Hi ,
As mentioned above the alerts will be thrown once it reach threshold value. but if we keep huge data on clipboard its again degrade performance.
Thanks,
Manikumar
CGI
IN
Hi Mani,
As you mentioned "As mentioned above the alerts will be thrown once it reach threshold value"
Where do we configure clipboard threshold value?
Thanks in Advance
Best Regards
U Rajasekhar
Coforge DPA
AU
Hi ,
We have different alerts where it triggers when it will reach the threshold value, there is no such threshold limit for Clipboard. If we keep on increasing the clipbaord size we are degrading the performance of the application.
Please find below link where it might useful :
https://community.pega.com/sites/default/files/help_v721/procomhelpmain.htm
Thanks,
Manikumar
Apple India Pvt Ltd
IN
I dont think maintaining the blob data in clipboard is best approach generally we maintain the filename and its type. based on that we will display the file on the page.
CGI
IN
We are reading the file and storing on clipboard for futher processing.
Client asked, what is the max amount of data can be stored on clipboard?
Thanks in Advance!
Best Regards
U Rajasekhar
CGI
IN
We are reading the file and storing on clipboard for futher processing.
Client asked, what is the max amount of data can be stored on clipboard?
Thanks in Advance!
Best Regards
U Rajasekhar
CGI
IN
We are reading the file and storing on clipboard for futher processing.
Client asked, what is the max amount of data can be stored on clipboard?
Thanks in Advance!
Best Regards
U Rajasekhar
Accepted Solution
Pegasystems Inc.
US
As has been stated previously, there is no hard limit on clipboard size. However, your system performance - in particular, memory usage - is the limiting factor when approaching this business problem with your proposed solution in mind.
You must consider that if you're storing the file on the clipboard, that means that it's being stored in memory, in the java heap. The associated alerts (50MB by default) are to assist you in determining if BLOBs loaded from the database are growing to unexpected sizes - you can use these to help determine the cause of problems (For example, if you are seeing these alerts, and also seeing garbage collection or out of memory issues, the two are likely correlated.) The configuration settings associated for this alert threshold are detailed here: https://docs-previous.pega.com/pega0004-alert-quantity-data-received-database-query-exceeds-limit
You may need to approach sizing of your java heap with this in mind, for example if you expect to have each requestor store multiple 100MB files in their clipboard, the typical recommendations of 4-8GB heap size may be vastly insufficient for your application. You will also probably need to handle in your own business logic when to remove these large items from the clipboard so that the memory can be recycled and you do not create a memory leak in the application.
As has been stated previously, there is no hard limit on clipboard size. However, your system performance - in particular, memory usage - is the limiting factor when approaching this business problem with your proposed solution in mind.
You must consider that if you're storing the file on the clipboard, that means that it's being stored in memory, in the java heap. The associated alerts (50MB by default) are to assist you in determining if BLOBs loaded from the database are growing to unexpected sizes - you can use these to help determine the cause of problems (For example, if you are seeing these alerts, and also seeing garbage collection or out of memory issues, the two are likely correlated.) The configuration settings associated for this alert threshold are detailed here: https://docs-previous.pega.com/pega0004-alert-quantity-data-received-database-query-exceeds-limit
You may need to approach sizing of your java heap with this in mind, for example if you expect to have each requestor store multiple 100MB files in their clipboard, the typical recommendations of 4-8GB heap size may be vastly insufficient for your application. You will also probably need to handle in your own business logic when to remove these large items from the clipboard so that the memory can be recycled and you do not create a memory leak in the application.
You may also want to review the business need for the underlying business process to determine if there's a better way to process your files rather than storing them in the heap.
-
Saptarshi Bera
CGI
IN
Thanks.......Happy New Year!