Question
Cognizant Technology Solutions
US
Last activity: 17 Jan 2020 5:04 EST
incorrect BIX extract output for property values with new lines
Hi Team,
we are facing an issue with our bix extract output. Whenever a property in the extract rule is having values which includes new line, it is producing an incorrect output. A new record is created after the new line char and the entire record is splitted into multiple records in the extract. Please let me know if someone has faced similar issues and what is the solution/workaround.
Actual property value :
"Sample Example Text
07/02/19
$3,462.17
Control #: XXXXXXXXXXX"
In the extract we should be having a single record. But we are seeing the extract as below.
BIX Extract :
Hi Team,
we are facing an issue with our bix extract output. Whenever a property in the extract rule is having values which includes new line, it is producing an incorrect output. A new record is created after the new line char and the entire record is splitted into multiple records in the extract. Please let me know if someone has faced similar issues and what is the solution/workaround.
Actual property value :
"Sample Example Text
07/02/19
$3,462.17
Control #: XXXXXXXXXXX"
In the extract we should be having a single record. But we are seeing the extract as below.
BIX Extract :
DT|"T-57295448"|"I-42390341"|"C-57029720"|"20190708T233421.457 GMT"|"20190708T233421.516 GMT"|""|"T-57295448"|"Pending-Outcome"|"true"|"P"|"Y"|"N"|"EC"|""|""|""|"N/A"|""|"20190708"|"20190702T070000.000 GMT"|"Our Customer Service Dept"|"20190702T070000.000 GMT"|"Our Customer Service Dept"|""|""|"OC"|"20190708"|""|""|""|""|""|"3462.17"|"XXXXX"|""|"Success"|"XXXXX"|"N"|"N"|""|""|""|""|""|"D"|""|""|""|""|"Y"|""|"1"|"OCDDT01"|""|""|"false"|"A"|"N"|"N"|""|"67"|"EMPTY"|"EMPTY"|"EMPTY"|""|""|"170"|"FAILURE"|"~"|""|""|"EMPTY"|""|"9999999999"|""|""|"20190708"|"EMPTY"|"0900"|"T-57295448:9999999999:DDT:EC:0900:N:N:N:false:No:N:A:XXXXXXXXX:N::N:N:N/A"|"Sample Example Text
DT|
DT|
DT|"|""|"20190708"|""|"20190702"|"3462.17"|"070820191634214250"|"XXXXXXXXXXXXX"|"20190702"|"9999999999"|"2019-07-08 Proprietary information hidden"|"0900"|""|""|""|""|"XXXXXXXXXXX"|"C"|"1"|"RJF"|"XXXXXXXXXXX"|"VBK40150"|""|"0"|"VBK40532"|"00"|"XXXXXXX"|""|"No"|""|""|""|"N"|""|""|""|""|"NA"|""|""|"VBK10334=VBK30343;VBK10334=VBK30343;VBK11478=VBK30001;VBK10336=VBK30335;VBK10822=Yes;VBK10823=20190702;VBK10825=3462.17;VBK10826=3462.17;VBK11259=VBK30440;VBK10928=VBK30000;VBK10946=VBK30020;VBK10946=VBK30412;"|"true"|"Yes"|""|""|"Other"|""|""|""|"N"|"Other"|""|""|""|""|""|""|"N"|""|""|""|""|""|""|""|""|""|""|"No"|"false"|"false"|"N"|"N"|""|""|"N"|"N"|""|"N"|""|""|"N"|""|"N"|"N"|"OC"|"N"|""|"N"|""|"DDT"|"N"|"N"|"N"|""|"N"|"N"|"N"|""|"N"|"N"|""|"N"|"N"|"N"|"N"|"N"|"Y"|""|""|"N"|"N"|"N"|"N"|""|"N"|"N"|"N"|"N"|"N"|"N"|""|""|"N"|"N"|""|""|"Phone/Computer"|"Other"|"Other"|"No"|""|""|""|""|"3462.17"|""|""|""|""|"N"|"N"|"N"|"Y"|""|"N"|""|""|""|"N"|"N"|"N"|"N"|"N"|"N"|"N"|"N"|"N"|"N"|"N"|"N"|""|"N"|"N"|"N"|"N"|"N"|""|""|""|""|""|""|"20190702"|""|"OCDDT01"
***Edited by Moderator Marissa to update platform capability tags****
Pegasystems Inc.
US
BIX doesn't output to a .txt file. Are you extracting to csv? Please provide the actual csv file that comes out of BIX. Each property should be in double quotes so you shouldn't see an issue if there is a carriage return in the middle of the text property value. What version of pega/bix are you running on?
Cognizant Technology Solutions
US
Hi,
Thanks for responding back.
We are on Pega 7.1.7.
Yes we are extracting to CSV file. All the property values in the extract file are enclosed within double quotes except for the problem values which contains new line.
I will not be able to upload the actual file bcoz it is huge and contains PII information. I have shared the problem value and records from the original file. All records in the extract file starts with DT. The snippet I shared in my original post should be part of a single record. But due to the presence of new line we are seeing 4 records in the file.
The value of the property is as below (with new line)
Hi,
Thanks for responding back.
We are on Pega 7.1.7.
Yes we are extracting to CSV file. All the property values in the extract file are enclosed within double quotes except for the problem values which contains new line.
I will not be able to upload the actual file bcoz it is huge and contains PII information. I have shared the problem value and records from the original file. All records in the extract file starts with DT. The snippet I shared in my original post should be part of a single record. But due to the presence of new line we are seeing 4 records in the file.
The value of the property is as below (with new line)
"Sample Example Text
07/02/19
$3,462.17
Control #: XXXXXXXXXXX"
In the extract snippet I shared you can see we are getting only "Sample Example Text and it is not ended with double quotes and after that there are two more new records with no content and the last line starts with a closing quote and continues with rest of the values for the record.
Let me know if you are looking for anything specific in the output file.
Thanks
HMRC
GB
Hi Kaustav,
Please see the below link. Seems like it will be helpful
https://collaborate.pega.com/question/need-include-values-comma-bix-csv-extract