Question

Atos Syntel
IN
Last activity: 22 Feb 2025 11:04 EST
File Listener reading data differently for CSV files (LF delimiter) with single and multiple records
When trying to configure file listener to read data from csv files with LF as the delimiter instead of CRLF, we encountered the following issue.
Configuration:
Record Terminator: \n
Character Encoding: default
uploading a csv file with one record (including header), lets say the record data is 22022025,Saturday, the file listener is reading it as 2 2 0 2 2 0 2 5 , S a t u r d a y. it is adding space between each character, same happens to the header, not only this it is assuming there is one more record in the file and passing a empty value for it.
Now if i upload a csv file with more than 1 record(including header), the data is getting read without spaces, no issues here.
To counter this i tried the following in the file listener's configuration
Configuration:
Record Terminator: \n
Character Encoding: UnicodeLittle or UnicodeLittleUnmarked
With this configuration, csv file with single record(including header) is getting read without spaces which is fine, but if i place a csv file with more than 1 record, listener is consuming the file but no data is read from that file.
For both scenarios, Files are moving to completed folder, corresponding report files are generated with pyProcessingStatus tag value as success in them.