Transactionize doesn't group the matching messasges properly.
Hi, Thanks in advance for your response.
Unfortunately, I am having problems trying to do a query with the Transactionize feature.
The query that I wrote is something like this:
| parse "message=\"There are no connector configs associated with the file being processed\", sourceFilePath=*" as sourceFilePath2 nodrop
| parse "message=\"File Processing completed\", sourceFilePath=*" as sourceFilePath
| transactionize sourceFilePath, sourceFilePath2
The log results are:
"_messagetimems","_messagetime","_group_signature","sourcefilepath","sourcefilepath2","_raw"
"1536774665471","09/12/2018 14:51:05.471 -0300","raw/sftp/grn/officedepot/offic... hash(22eb87f6); ","raw/sftp/grn/officedepot/officedepot/2018/09/12/stage-ele_odp_grn_20180831.txt","","12-09-2018 17:51:05.471 INFO #dam-connectors-service c.e.s.c.kafka.TransformationReader thread=dam-connector-57c69751-78eb-4711-b9a6-d61183e0cf9c-StreamThread-1 [] - message=""File Processing completed"", sourceFilePath=raw/sftp/grn/officedepot/officedepot/2018/09/12/stage-ele_odp_grn_20180831.txt"
"1536774665463","09/12/2018 14:51:05.463 -0300","; raw/sftp/grn/officedepot/offic... hash(22eb87f6)","","raw/sftp/grn/officedepot/officedepot/2018/09/12/stage-ele_odp_grn_20180831.txt","12-09-2018 17:51:05.463 WARN #dam-connectors-service c.e.s.c.kafka.TransformationReader thread=dam-connector-57c69751-78eb-4711-b9a6-d61183e0cf9c-StreamThread-1 [] - message=""There are no connector configs associated with the file being processed"", sourceFilePath=raw/sftp/grn/officedepot/officedepot/2018/09/12/stage-ele_odp_grn_20180831.txt"
Please note that the second group signature contains a semicolon, that I think is causing the logs are not being grouped as expected. However check that the hash is the same and the sourceFilePath and sourceFilePath2 matches.
Any help will be very appreciated.
However, I am seeing that the logs where sourceFilePath and sourceFilePath2 matches are not being grouped.
Please sign in to leave a comment.
Comments
0 comments