logstash-output-sumologic performance

Follow

Scot Needy

• March 09, 2018 20:03

Has anyone else had issues with this plugin ? 

logstash 6.2.2

https://github.com/SumoLogic/logstash-output-sumologic

I can run logstash and send data to Elasticsearch all day but the sumo plugin seems to have a memory
leak. I bumped my Heap to 3Gb, the only think that does is extend the time until the heap is exhausted. 

-Xms3g
-Xmx3g
 

With this plugin and logstash in debug I get thousands of these messages. 

[2018-03-08T09:50:36,895][ERROR][logstash.pipeline        ] A plugin had an unrecoverable error. Will restart this plugin.

[2018-03-08T09:50:37,896][ERROR][io.netty.util.concurrent.DefaultPromise.rejectedExecution] Failed to submit a listener notification task. Event loop shut down

 

0

• Official comment

  

  Dwayne Hoover

  • March 21, 2018 18:41

  Hi Scot

  Can you post the issue to the GitHub repository?  I reached out to one of our folks internally (at Sumo) who can lend a hand.

  Thanks!

  Dwayne

   

  Comment actions Permalink
• 

  Scot Needy

  • April 02, 2018 14:53

   

  This was resolved by tuning the logstash plugin. 

  sumologic {

  .... 

  automatic_retries => 10
  validate_after_inactivity => 3
  request_timeout => 10
  interval => 5
  compress => true
  compress_encoding => "gzip"

  }

  0

  Comment actions Permalink

Please sign in to leave a comment.