在 Mapping 里面,将 dynamic 参数设置成 strict 可以拒绝索引包含未知字段的文档。 此条 Tips 由 medcl 贡献。

filebeat收集日志中断

Beats | 作者 yx979150 | 发布于2019年11月07日 | 阅读数:5994

2019/11/07 06:31:10.987314 output.go:346: INFO Template already exists and will not be overwritten.
2019/11/07 06:31:40.972250 metrics.go:39: INFO Non-zero metrics in the last 30s: filebeat.harvester.open_files=2 filebeat.harvester.running=2 filebeat.harvester.started=2 libbeat.es.call_count.PublishEvents=3733 libbeat.es.publish.read_bytes=2901333 libbeat.es.publish.write_bytes=35039514 libbeat.es.published_and_acked_events=28669 libbeat.es.published_but_not_acked_events=3159 libbeat.publisher.published_events=28670 publish.events=26624 registrar.states.current=2 registrar.states.update=26624 registrar.writes=14
2019/11/07 06:32:10.972272 metrics.go:39: INFO Non-zero metrics in the last 30s: libbeat.es.call_count.PublishEvents=3872 libbeat.es.publish.read_bytes=3194305 libbeat.es.publish.write_bytes=4812896 libbeat.es.published_but_not_acked_events=3872
2019/11/07 06:32:40.972227 metrics.go:39: INFO Non-zero metrics in the last 30s: libbeat.es.call_count.PublishEvents=3907 libbeat.es.publish.read_bytes=3223185 libbeat.es.publish.write_bytes=4856401 libbeat.es.published_but_not_acked_events=3907
2019/11/07 06:33:10.972259 metrics.go:39: INFO Non-zero metrics in the last 30s: libbeat.es.call_count.PublishEvents=3851 libbeat.es.publish.read_bytes=3176986 libbeat.es.publish.write_bytes=4786793 libbeat.es.published_but_not_acked_events=3851
2019/11/07 06:33:40.972275 metrics.go:39: INFO Non-zero metrics in the last 30s: libbeat.es.call_count.PublishEvents=3923 libbeat.es.publish.read_bytes=3236425 libbeat.es.publish.write_bytes=4876289 libbeat.es.published_but_not_acked_events=3923
2019/11/07 06:34:10.972237 metrics.go:39: INFO Non-zero metrics in the last 30s: libbeat.es.call_count.PublishEvents=3937 libbeat.es.publish.read_bytes=3247930 libbeat.es.publish.write_bytes=4893691 libbeat.es.published_but_not_acked_events=3937
2019/11/07 06:34:40.972245 metrics.go:39: INFO Non-zero metrics in the last 30s: libbeat.es.call_count.PublishEvents=3892 libbeat.es.publish.read_bytes=3210791 libbeat.es.publish.write_bytes=4836513 libbeat.es.published_but_not_acked_events=3892
2019/11/07 06:35:10.972249 metrics.go:39: INFO Non-zero metrics in the last 30s: libbeat.es.call_count.PublishEvents=3900 libbeat.es.publish.read_bytes=3217438 libbeat.es.publish.write_bytes=4848943 libbeat.es.published_but_not_acked_events=3900
2019/11/07 06:35:40.972266 metrics.go:39: INFO Non-zero metrics in the last 30s: libbeat.es.call_count.PublishEvents=3754 libbeat.es.publish.read_bytes=3096944 libbeat.es.publish.write_bytes=4666222 libbeat.es.published_but_not_acked_events=3754
2019/11/07 06:36:10.972293 metrics.go:39: INFO Non-zero metrics in the last 30s: libbeat.es.call_count.PublishEvents=3729 libbeat.es.publish.read_bytes=3076317 libbeat.es.publish.write_bytes=4635147 libbeat.es.published_but_not_acked_events=3729
2019/11/07 06:36:40.972255 metrics.go:39: INFO Non-zero metrics in the last 30s: libbeat.es.call_count.PublishEvents=3554 libbeat.es.publish.read_bytes=2931903 libbeat.es.publish.write_bytes=4417622 libbeat.es.published_but_not_acked_events=3554
2019/11/07 06:37:10.972239 metrics.go:39: INFO Non-zero metrics in the last 30s: libbeat.es.call_count.PublishEvents=3912 libbeat.es.publish.read_bytes=3227327 libbeat.es.publish.write_bytes=4862616 libbeat.es.published_but_not_acked_events=3912
2019/11/07 06:37:40.972221 metrics.go:39: INFO Non-zero metrics in the last 30s: libbeat.es.call_count.PublishEvents=3950 libbeat.es.publish.read_bytes=3258684 libbeat.es.publish.write_bytes=4909850 libbeat.es.published_but_not_acked_events=3950
2019/11/07 06:38:10.972678 metrics.go:39: INFO Non-zero metrics in the last 30s: libbeat.es.call_count.PublishEvents=3588 libbeat.es.publish.read_bytes=2959926 libbeat.es.publish.write_bytes=4459884 libbeat.es.published_but_not_acked_events=3588
2019/11/07 06:38:40.972278 metrics.go:39: INFO Non-zero metrics in the last 30s: libbeat.es.call_count.PublishEvents=3424 libbeat.es.publish.read_bytes=2825465 libbeat.es.publish.write_bytes=4256032 libbeat.es.published_but_not_acked_events=3424

启动filebeat没有异常能正常收集并且发送到es,收集一段时间后就收集不到日志了,一直刷上面这个日志,filebeat版本5.5
已邀请:

要回复问题请先登录注册