CSV header is being ingested as a log entry when ingesting using a HTTP collector

Follow

Unknown

• July 01, 2019 05:19

I have a HTTP collector set up to receive CSV log files that are sent to sumo logic using a python script.

The logs are ingested correctly except that the CSV header is also ingested as a log entry.

Does anyone know how to exclude this at the point of ingestion (rather than stripping the header out of the file on the host and then sending to sumo)?

0

• Official comment

  

  Matt Sullivan

  • July 01, 2019 14:00

  If you own the python code, I would just start the iterator with 1 instead of 0 index to start things at line 2. Or if using for x in list pattern, filter out there. If that's infeasible, yes, you can do an exclusion rule with a regex that matches the line with the headers, e.g.
  
  column1.*
  
  More on processing rules here: https://help.sumologic.com/Manage/Collection/Processing-Rules/Include-and-Exclude-Rules

   

  Comment actions Permalink

Please sign in to leave a comment.