logstash:Connection reset by peer==>filebeat:Failed to publish events

问题描述:filebeat-->logstash-->elasticsearch-->kibana这种架构。
问题:logstash-->到es
[ERROR][org.logstash.beats.BeatsHandler] Exception: Connection reset by peer 
有这累的报错后,
filebeat--> 到logstash
ERR Failed to publish events caused by: read tcp xxxx:47752->xxxx:5516: i/o timeout
ERR Failed to publish events caused by: client is not connected
然后就开始停止发送数据了
INFO No non-zero metrics in the last 30s
INFO No non-zero metrics in the last 30s
INFO No non-zero metrics in the last 30s
INFO No non-zero metrics in the last 30s
INFO No non-zero metrics in the last 30s
 
 
请问大神有没有碰到过类似的问题的?是怎么解决的?
现在基本状况是:
es filebeat都做过优化,目前es是一台机器2实例,4分片0副本,索引按天算,一天500多G,有5个logstash进程往es写入数据,5台机器的10个filebeat往logstash发送数据。
已邀请:

kennywu76 - wood@Ctrip

赞同来自: laoyang360

确保升级到最新版的logstash,之前一些版本可能存在bug导致这个问题。 
参考:
https://github.com/logstash-pl ... s/163
https://github.com/logstash-pl ... s/185
 

mingfeng.zhang

赞同来自:

请问问题解决了么?
我这里的filebeat版本是5.4
logstash版本测试过5.4.0,5.4.2都存在这个问题无论是打开ssl验证还是关闭ssl验证。

测试过:
filebeat-logstash在同一网段两台机器
filebeat-logstash在同一网段一台机器

ruicai.li

赞同来自:

我也遇到同样的问题了,集群里面2个节点,每个节点上面一个filebeat,logstash只有主节点上面有一个,es也只有主节点上面有一个。现在的问题是主节点上面的filebeat能把日志写进去,从节点上的filebeat就不行。
从节点的日志:ERR Failed to publish events caused by: write tcp 10.233.75.48:52710->10.233.23.172:5000: write: connection reset by peer
INFO No non-zero metrics in the last 30s
INFO No non-zero metrics in the last 30s
INFO No non-zero metrics in the last 30s
主节点的日志:ERR Not loading modules. Module directory not found: /usr/local/bin/module

要回复问题请先登录注册