File generation in UTF-8 and UTF-16 encoding
Hello,
We are upgrading to Pega 8.8.1 from 8.4.3 version and connect-file is deprecated in the latest version.
We were generating files using connect-file in UTF-8 and UTF-16 encoding by customizing the invoke activity in 8.4.3.
How do we generate files with UTF-8 and UTF-16 encoding with connect-file in 8.8.1 given that invoke activity has been redesigned in 8.8.1?
If we were to use Repository API's, how do we set these encoding formats?
Also another challenge with Create file API is we cannot append data to an existing file. Since we are writing large data sets, we were doing it in batches using connect-file. Any solution to this?
Thanks
***Edited by Moderator Marije to change type from General to Product***
JPMORGAN CHASE & CO.
US
@GODZE We are generating txt and xlsx files. We are writing 1 record at a time using connect-file and doing this in batch to append data to the same file several times in a day. Each day we produce new file. We did explore File Data sets but it is supporting CSV and JSON formats only.
We tried Repository API's as Pega suggested but still have the challenge of encoding in UTF-8 & UTF-16 as well as dealing with large volumes of data.
Pegasystems Inc.
GB
@KenshoTsuchihashi is this a question you could help with?
This is based on your knowledge displayed in How to replace Connect File implementation with Repository API approach?
Pegasystems Inc.
JP
In Repository API, there are two approaches - String and Stream. One way to change output file's charset is to use Stream approach and configure its paramter as such. For example, if you want to produce a UTF-16 file, you can write Java code as below. For how to use Repository API, see https://support.pega.com/discussion/how-use-repository-api.
java.io.InputStream inputStream = new java.io.ByteArrayInputStream(CSVString.getBytes(java.nio.charset.StandardCharsets.UTF_16));
tools.getStepPage().getProperty("pyStream").setValue(inputStream);
For Japanese customer, if you want to produce a Shift-JIS file, you can write Java code as below. Instead of using StandardCharsets, specify "MS932" directly. In this case you need a try/catch block or system won't let you save the rule.
In Repository API, there are two approaches - String and Stream. One way to change output file's charset is to use Stream approach and configure its paramter as such. For example, if you want to produce a UTF-16 file, you can write Java code as below. For how to use Repository API, see https://support.pega.com/discussion/how-use-repository-api.
java.io.InputStream inputStream = new java.io.ByteArrayInputStream(CSVString.getBytes(java.nio.charset.StandardCharsets.UTF_16));
tools.getStepPage().getProperty("pyStream").setValue(inputStream);
For Japanese customer, if you want to produce a Shift-JIS file, you can write Java code as below. Instead of using StandardCharsets, specify "MS932" directly. In this case you need a try/catch block or system won't let you save the rule.
try{
java.io.InputStream inputStream = new java.io.ByteArrayInputStream(CSVString.getBytes("MS932"));
tools.getStepPage().getProperty("pyStream").setValue(inputStream);
} catch(Exception e) {
oLog.error("Error occured",e);
}
Thanks,