你可以的,加油

filebeat运行一段时间后自动退出

Beats | 作者 enluoluo | 发布于2019年10月12日 | 阅读数:12115

从官网下载的filebeat-7.3.2版本,部署在centos7系统上,解压后只改了filebeat.yml 内容如下:
#=========================== Filebeat inputs =============================
filebeat.inputs:
- type: log
  enabled: true
  paths:
    - /home/admin/confcenter/logs/confcenter.logFile.*.log
  fields:
    log_source: statistics-log
  fileds_under_root: true

setup.kibana:
  host: "192.168.17.40:5601"

output.logstash:
  hosts: ["192.168.17.41:5044","192.168.17.42:5044"]
 
用nohup ./filebeat -e -c filebeat.yml > filebeat.log &的命令启动,启动后大概2个小时左右服务会自动停掉。
搜集的文件数量不多内容也少,一天就一个文件。
filebeat全部日志如下:

2019-10-11T16:08:29.583+0800 INFO instance/beat.go:607 Home path: [/home/admin/filebeat-7.3.2-linux-x86_64] Config path: [/home/admin/filebeat-7.3.2-linux-x86_64] Data path: [/home/admin/filebeat-7.3.2-linux-x86_64/data] Logs path: [/home/admin/filebeat-7.3.2-linux-x86_64/logs]
2019-10-11T16:08:29.584+0800 INFO instance/beat.go:615 Beat ID: 1a2c1370-e751-4d16-9e1b-0e112febfdc8
2019-10-11T16:08:29.587+0800 INFO [seccomp] seccomp/seccomp.go:101 Syscall filter could not be installed because the kernel does not support seccomp
2019-10-11T16:08:29.587+0800 INFO [beat] instance/beat.go:903 Beat info {"system_info": {"beat": {"path": {"config": "/home/admin/filebeat-7.3.2-linux-x86_64", "data": "/home/admin/filebeat-7.3.2-linux-x86_64/data", "home": "/home/admin/filebeat-7.3.2-linux-x86_64", "logs": "/home/admin/filebeat-7.3.2-linux-x86_64/logs"}, "type": "filebeat", "uuid": "1a2c1370-e751-4d16-9e1b-0e112febfdc8"}}}
2019-10-11T16:08:29.588+0800 INFO [beat] instance/beat.go:912 Build info {"system_info": {"build": {"commit": "5b046c5a97fe1e312f22d40a1f05365621aad621", "libbeat": "7.3.2", "time": "2019-09-06T13:49:32.000Z", "version": "7.3.2"}}}
2019-10-11T16:08:29.588+0800 INFO [beat] instance/beat.go:915 Go runtime info {"system_info": {"go": {"os":"linux","arch":"amd64","max_procs":8,"version":"go1.12.4"}}}
2019-10-11T16:08:29.589+0800 INFO [beat] instance/beat.go:919 Host info {"system_info": {"host": {"architecture":"x86_64","boot_time":"2019-08-25T12:07:15+08:00","containerized":false,"name":"dqfbskj-mysql48","ip":["127.0.0.1/8","::1/128","192.168.17.48/22","fe80::fd69:323e:d465:f33a/64","192.168.122.1/24"],"kernel_version":"3.10.0-693.17.1.el7.x86_64","mac":["00:50:56:8b:80:f1","52:54:00:63:10:43","52:54:00:63:10:43"],"os":{"family":"redhat","platform":"rhel","name":"Red Hat Enterprise Linux Server","version":"7.4 (Maipo)","major":7,"minor":4,"patch":0,"codename":"Maipo"},"timezone":"CST","timezone_offset_sec":28800,"id":"04036329ded7433eba89b4f2c94de25c"}}}
2019-10-11T16:08:29.590+0800 INFO [beat] instance/beat.go:948 Process info {"system_info": {"process": {"capabilities": {"inheritable":null,"permitted":null,"effective":null,"bounding":["chown","dac_override","dac_read_search","fowner","fsetid","kill","setgid","setuid","setpcap","linux_immutable","net_bind_service","net_broadcast","net_admin","net_raw","ipc_lock","ipc_owner","sys_module","sys_rawio","sys_chroot","sys_ptrace","sys_pacct","sys_admin","sys_boot","sys_nice","sys_resource","sys_time","sys_tty_config","mknod","lease","audit_write","audit_control","setfcap","mac_override","mac_admin","syslog","wake_alarm","block_suspend"],"ambient":null}, "cwd": "/home/admin/filebeat-7.3.2-linux-x86_64", "exe": "/home/admin/filebeat-7.3.2-linux-x86_64/filebeat", "name": "filebeat", "pid": 15493, "ppid": 5476, "seccomp": {"mode":"disabled"}, "start_time": "2019-10-11T16:08:28.590+0800"}}}
2019-10-11T16:08:29.590+0800 INFO instance/beat.go:292 Setup Beat: filebeat; Version: 7.3.2
2019-10-11T16:08:29.591+0800 INFO [publisher] pipeline/module.go:97 Beat name: dqfbskj-mysql48
2019-10-11T16:08:29.591+0800 WARN beater/filebeat.go:152 Filebeat is unable to load the Ingest Node pipelines for the configured modules because the Elasticsearch output is not configured/enabled. If you have already loaded the Ingest Node pipelines or are using Logstash pipelines, you can ignore this warning.
2019-10-11T16:08:29.591+0800 INFO [monitoring] log/log.go:118 Starting metrics logging every 30s
2019-10-11T16:08:29.591+0800 INFO instance/beat.go:422 filebeat start running.
2019-10-11T16:08:29.592+0800 INFO registrar/registrar.go:145 Loading registrar data from /home/admin/filebeat-7.3.2-linux-x86_64/data/registry/filebeat/data.json
2019-10-11T16:08:29.592+0800 INFO registrar/registrar.go:152 States Loaded from registrar: 2
2019-10-11T16:08:29.592+0800 WARN beater/filebeat.go:368 Filebeat is unable to load the Ingest Node pipelines for the configured modules because the Elasticsearch output is not configured/enabled. If you have already loaded the Ingest Node pipelines or are using Logstash pipelines, you can ignore this warning.
2019-10-11T16:08:29.592+0800 INFO crawler/crawler.go:72 Loading Inputs: 1
2019-10-11T16:08:29.592+0800 INFO log/input.go:148 Configured paths: [/home/admin/confcenter/logs/confcenter.monitor.*.log]
2019-10-11T16:08:29.592+0800 INFO input/input.go:114 Starting input of type: log; ID: 8365001941138879657 
2019-10-11T16:08:29.592+0800 INFO crawler/crawler.go:106 Loading and starting Inputs completed. Enabled inputs: 1
2019-10-11T16:08:29.592+0800 INFO cfgfile/reload.go:171 Config reloader started
2019-10-11T16:08:29.593+0800 INFO cfgfile/reload.go:226 Loading of config files completed.
2019-10-11T16:08:32.588+0800 INFO add_cloud_metadata/add_cloud_metadata.go:347 add_cloud_metadata: hosting provider type not detected.
2019-10-11T16:08:49.594+0800 INFO log/harvester.go:253 Harvester started for file: /home/admin/confcenter/logs/confcenter.monitor.2019-10-11.0.log
2019-10-11T16:08:50.595+0800 INFO pipeline/output.go:95 Connecting to failover(backoff(async(tcp://192.168.17.41:5044)),backoff(async(tcp://192.168.17.42:5044)))
2019-10-11T16:08:52.326+0800 ERROR pipeline/output.go:100 Failed to connect to failover(backoff(async(tcp://192.168.17.41:5044)),backoff(async(tcp://192.168.17.42:5044))): dial tcp 192.168.17.41:5044: connect: connection refused
2019-10-11T16:08:52.326+0800 INFO pipeline/output.go:93 Attempting to reconnect to failover(backoff(async(tcp://192.168.17.41:5044)),backoff(async(tcp://192.168.17.42:5044))) with 1 reconnect attempt(s)
2019-10-11T16:08:52.327+0800 INFO pipeline/output.go:105 Connection to failover(backoff(async(tcp://192.168.17.41:5044)),backoff(async(tcp://192.168.17.42:5044))) established
2019-10-11T16:08:59.596+0800 INFO [monitoring] log/log.go:145 Non-zero metrics in the last 30s {"monitoring": {"metrics": {"beat":{"cpu":{"system":{"ticks":40,"time":{"ms":48}},"total":{"ticks":100,"time":{"ms":111},"value":100},"user":{"ticks":60,"time":{"ms":63}}},"handles":{"limit":{"hard":4096,"soft":1024},"open":7},"info":{"ephemeral_id":"9f4cff85-eaa7-4e48-8c88-e096f96ae671","uptime":{"ms":30034}},"memstats":{"gc_next":11137328,"memory_alloc":5580592,"memory_total":11259168,"rss":31641600},"runtime":{"goroutines":27}},"filebeat":{"events":{"added":6,"done":6},"harvester":{"open_files":1,"running":1,"started":1}},"libbeat":{"config":{"module":{"running":0},"reloads":1},"output":{"events":{"acked":4,"batches":2,"total":4},"read":{"bytes":12},"type":"logstash","write":{"bytes":1572}},"pipeline":{"clients":1,"events":{"active":0,"filtered":2,"published":4,"retry":4,"total":6},"queue":{"acked":4}}},"registrar":{"states":{"current":2,"update":6},"writes":{"success":3,"total":3}},"system":{"cpu":{"cores":8},"load":{"1":0,"15":0.05,"5":0.01,"norm":{"1":0,"15":0.0063,"5":0.0013}}}}}}
2019-10-11T16:09:29.595+0800 INFO [monitoring] log/log.go:145 Non-zero metrics in the last 30s {"monitoring": {"metrics": {"beat":{"cpu":{"system":{"ticks":50,"time":{"ms":6}},"total":{"ticks":110,"time":{"ms":10},"value":110},"user":{"ticks":60,"time":{"ms":4}}},"handles":{"limit":{"hard":4096,"soft":1024},"open":7},"info":{"ephemeral_id":"9f4cff85-eaa7-4e48-8c88-e096f96ae671","uptime":{"ms":60030}},"memstats":{"gc_next":11137328,"memory_alloc":6020344,"memory_total":11698920},"runtime":{"goroutines":27}},"filebeat":{"harvester":{"open_files":1,"running":1}},"libbeat":{"config":{"module":{"running":0}},"pipeline":{"clients":1,"events":{"active":0}}},"registrar":{"states":{"current":2}},"system":{"load":{"1":0,"15":0.05,"5":0.01,"norm":{"1":0,"15":0.0063,"5":0.0013}}}}}}
2019-10-11T16:09:59.595+0800 INFO [monitoring] log/log.go:145 Non-zero metrics in the last 30s {"monitoring": {"metrics": {"beat":{"cpu":{"system":{"ticks":60,"time":{"ms":6}},"total":{"ticks":130,"time":{"ms":9},"value":130},"user":{"ticks":70,"time":{"ms":3}}},"handles":{"limit":{"hard":4096,"soft":1024},"open":7},"info":{"ephemeral_id":"9f4cff85-eaa7-4e48-8c88-e096f96ae671","uptime":{"ms":90032}},"memstats":{"gc_next":11137328,"memory_alloc":6267584,"memory_total":11946160},"runtime":{"goroutines":27}},"filebeat":{"harvester":{"open_files":1,"running":1}},"libbeat":{"config":{"module":{"running":0}},"pipeline":{"clients":1,"events":{"active":0}}},"registrar":{"states":{"current":2}},"system":{"load":{"1":0,"15":0.05,"5":0.01,"norm":{"1":0,"15":0.0063,"5":0.0013}}}}}}
2019-10-11T16:10:29.598+0800 INFO [monitoring] log/log.go:145 Non-zero metrics in the last 30s {"monitoring": {"metrics": {"beat":{"cpu":{"system":{"ticks":70,"time":{"ms":10}},"total":{"ticks":140,"time":{"ms":13},"value":140},"user":{"ticks":70,"time":{"ms":3}}},"handles":{"limit":{"hard":4096,"soft":1024},"open":7},"info":{"ephemeral_id":"9f4cff85-eaa7-4e48-8c88-e096f96ae671","uptime":{"ms":120036}},"memstats":{"gc_next":11137328,"memory_alloc":6591648,"memory_total":12270224},"runtime":{"goroutines":27}},"filebeat":{"harvester":{"open_files":1,"running":1}},"libbeat":{"config":{"module":{"running":0}},"pipeline":{"clients":1,"events":{"active":0}}},"registrar":{"states":{"current":2}},"system":{"load":{"1":0,"15":0.05,"5":0.01,"norm":{"1":0,"15":0.0063,"5":0.0013}}}}}}
2019-10-11T16:10:59.595+0800 INFO [monitoring] log/log.go:145 Non-zero metrics in the last 30s {"monitoring": {"metrics": {"beat":{"cpu":{"system":{"ticks":70,"time":{"ms":4}},"total":{"ticks":150,"time":{"ms":16},"value":150},"user":{"ticks":80,"time":{"ms":12}}},"handles":{"limit":{"hard":4096,"soft":1024},"open":7},"info":{"ephemeral_id":"9f4cff85-eaa7-4e48-8c88-e096f96ae671","uptime":{"ms":150029}},"memstats":{"gc_next":5045808,"memory_alloc":2531400,"memory_total":12595648},"runtime":{"goroutines":27}},"filebeat":{"harvester":{"open_files":1,"running":1}},"libbeat":{"config":{"module":{"running":0}},"pipeline":{"clients":1,"events":{"active":0}}},"registrar":{"states":{"current":2}},"system":{"load":{"1":0,"15":0.05,"5":0.01,"norm":{"1":0,"15":0.0063,"5":0.0013}}}}}}
2019-10-11T16:11:29.595+0800 INFO [monitoring] log/log.go:145 Non-zero metrics in the last 30s {"monitoring": {"metrics": {"beat":{"cpu":{"system":{"ticks":80,"time":{"ms":7}},"total":{"ticks":160,"time":{"ms":11},"value":160},"user":{"ticks":80,"time":{"ms":4}}},"handles":{"limit":{"hard":4096,"soft":1024},"open":7},"info":{"ephemeral_id":"9f4cff85-eaa7-4e48-8c88-e096f96ae671","uptime":{"ms":180030}},"memstats":{"gc_next":5045808,"memory_alloc":2946008,"memory_total":13010256},"runtime":{"goroutines":27}},"filebeat":{"harvester":{"open_files":1,"running":1}},"libbeat":{"config":{"module":{"running":0}},"pipeline":{"clients":1,"events":{"active":0}}},"registrar":{"states":{"current":2}},"system":{"load":{"1":0,"15":0.05,"5":0.01,"norm":{"1":0,"15":0.0063,"5":0.0013}}}}}}
2019-10-11T16:11:59.595+0800 INFO [monitoring] log/log.go:145 Non-zero metrics in the last 30s {"monitoring": {"metrics": {"beat":{"cpu":{"system":{"ticks":80,"time":{"ms":6}},"total":{"ticks":170,"time":{"ms":9},"value":170},"user":{"ticks":90,"time":{"ms":3}}},"handles":{"limit":{"hard":4096,"soft":1024},"open":7},"info":{"ephemeral_id":"9f4cff85-eaa7-4e48-8c88-e096f96ae671","uptime":{"ms":210030}},"memstats":{"gc_next":5045808,"memory_alloc":3268104,"memory_total":13332352},"runtime":{"goroutines":27}},"filebeat":{"harvester":{"open_files":1,"running":1}},"libbeat":{"config":{"module":{"running":0}},"pipeline":{"clients":1,"events":{"active":0}}},"registrar":{"states":{"current":2}},"system":{"load":{"1":0,"15":0.05,"5":0.01,"norm":{"1":0,"15":0.0063,"5":0.0013}}}}}}
2019-10-11T16:12:29.595+0800 INFO [monitoring] log/log.go:145 Non-zero metrics in the last 30s {"monitoring": {"metrics": {"beat":{"cpu":{"system":{"ticks":90,"time":{"ms":5}},"total":{"ticks":180,"time":{"ms":8},"value":180},"user":{"ticks":90,"time":{"ms":3}}},"handles":{"limit":{"hard":4096,"soft":1024},"open":7},"info":{"ephemeral_id":"9f4cff85-eaa7-4e48-8c88-e096f96ae671","uptime":{"ms":240029}},"memstats":{"gc_next":5045808,"memory_alloc":3516896,"memory_total":13581144},"runtime":{"goroutines":27}},"filebeat":{"harvester":{"open_files":1,"running":1}},"libbeat":{"config":{"module":{"running":0}},"pipeline":{"clients":1,"events":{"active":0}}},"registrar":{"states":{"current":2}},"system":{"load":{"1":0,"15":0.05,"5":0.01,"norm":{"1":0,"15":0.0063,"5":0.0013}}}}}}
2019-10-11T16:12:59.595+0800 INFO [monitoring] log/log.go:145 Non-zero metrics in the last 30s {"monitoring": {"metrics": {"beat":{"cpu":{"system":{"ticks":90,"time":{"ms":3}},"total":{"ticks":190,"time":{"ms":14},"value":190},"user":{"ticks":100,"time":{"ms":11}}},"handles":{"limit":{"hard":4096,"soft":1024},"open":7},"info":{"ephemeral_id":"9f4cff85-eaa7-4e48-8c88-e096f96ae671","uptime":{"ms":270031}},"memstats":{"gc_next":5047632,"memory_alloc":2695520,"memory_total":14066848},"runtime":{"goroutines":27}},"filebeat":{"harvester":{"open_files":1,"running":1}},"libbeat":{"config":{"module":{"running":0}},"pipeline":{"clients":1,"events":{"active":0}}},"registrar":{"states":{"current":2}},"system":{"load":{"1":0,"15":0.05,"5":0.01,"norm":{"1":0,"15":0.0063,"5":0.0013}}}}}}
2019-10-11T16:13:29.593+0800 INFO [monitoring] log/log.go:145 Non-zero metrics in the last 30s {"monitoring": {"metrics": {"beat":{"cpu":{"system":{"ticks":100,"time":{"ms":5}},"total":{"ticks":210,"time":{"ms":9},"value":210},"user":{"ticks":110,"time":{"ms":4}}},"handles":{"limit":{"hard":4096,"soft":1024},"open":7},"info":{"ephemeral_id":"9f4cff85-eaa7-4e48-8c88-e096f96ae671","uptime":{"ms":300029}},"memstats":{"gc_next":5047632,"memory_alloc":2866448,"memory_total":14237776},"runtime":{"goroutines":27}},"filebeat":{"harvester":{"open_files":1,"running":1}},"libbeat":{"config":{"module":{"running":0}},"pipeline":{"clients":1,"events":{"active":0}}},"registrar":{"states":{"current":2}},"system":{"load":{"1":0,"15":0.05,"5":0.01,"norm":{"1":0,"15":0.0063,"5":0.0013}}}}}}
2019-10-11T16:13:55.606+0800 INFO log/harvester.go:278 File is inactive: /home/admin/confcenter/logs/confcenter.monitor.2019-10-11.0.log. Closing because close_inactive of 5m0s reached.
2019-10-11T16:13:59.595+0800 INFO [monitoring] log/log.go:145 Non-zero metrics in the last 30s {"monitoring": {"metrics": {"beat":{"cpu":{"system":{"ticks":100,"time":{"ms":6}},"total":{"ticks":210,"time":{"ms":11},"value":210},"user":{"ticks":110,"time":{"ms":5}}},"handles":{"limit":{"hard":4096,"soft":1024},"open":6},"info":{"ephemeral_id":"9f4cff85-eaa7-4e48-8c88-e096f96ae671","uptime":{"ms":330029}},"memstats":{"gc_next":5047632,"memory_alloc":3198736,"memory_total":14570064},"runtime":{"goroutines":23}},"filebeat":{"events":{"added":1,"done":1},"harvester":{"closed":1,"open_files":0,"running":0}},"libbeat":{"config":{"module":{"running":0}},"pipeline":{"clients":1,"events":{"active":0,"filtered":1,"total":1}}},"registrar":{"states":{"current":2,"update":1},"writes":{"success":1,"total":1}},"system":{"load":{"1":0,"15":0.05,"5":0.01,"norm":{"1":0,"15":0.0063,"5":0.0013}}}}}}
2019-10-11T16:14:29.595+0800 INFO [monitoring] log/log.go:145 Non-zero metrics in the last 30s {"monitoring": {"metrics": {"beat":{"cpu":{"system":{"ticks":100,"time":{"ms":3}},"total":{"ticks":210,"time":{"ms":7},"value":210},"user":{"ticks":110,"time":{"ms":4}}},"handles":{"limit":{"hard":4096,"soft":1024},"open":6},"info":{"ephemeral_id":"9f4cff85-eaa7-4e48-8c88-e096f96ae671","uptime":{"ms":360032}},"memstats":{"gc_next":5047632,"memory_alloc":3524240,"memory_total":14895568},"runtime":{"goroutines":23}},"filebeat":{"harvester":{"open_files":0,"running":0}},"libbeat":{"config":{"module":{"running":0}},"pipeline":{"clients":1,"events":{"active":0}}},"registrar":{"states":{"current":2}},"system":{"load":{"1":0,"15":0.05,"5":0.01,"norm":{"1":0,"15":0.0063,"5":0.0013}}}}}}
2019-10-11T16:14:59.595+0800 INFO [monitoring] log/log.go:145 Non-zero metrics in the last 30s {"monitoring": {"metrics": {"beat":{"cpu":{"system":{"ticks":110,"time":{"ms":10}},"total":{"ticks":230,"time":{"ms":14},"value":230},"user":{"ticks":120,"time":{"ms":4}}},"handles":{"limit":{"hard":4096,"soft":1024},"open":6},"info":{"ephemeral_id":"9f4cff85-eaa7-4e48-8c88-e096f96ae671","uptime":{"ms":390029}},"memstats":{"gc_next":4978368,"memory_alloc":2496656,"memory_total":15214608},"runtime":{"goroutines":23}},"filebeat":{"harvester":{"open_files":0,"running":0}},"libbeat":{"config":{"module":{"running":0}},"pipeline":{"clients":1,"events":{"active":0}}},"registrar":{"states":{"current":2}},"system":{"load":{"1":0,"15":0.05,"5":0.01,"norm":{"1":0,"15":0.0063,"5":0.0013}}}}}}
2019-10-11T16:15:29.595+0800 INFO [monitoring] log/log.go:145 Non-zero metrics in the last 30s {"monitoring": {"metrics": {"beat":{"cpu":{"system":{"ticks":120,"time":{"ms":3}},"total":{"ticks":240,"time":{"ms":7},"value":240},"user":{"ticks":120,"time":{"ms":4}}},"handles":{"limit":{"hard":4096,"soft":1024},"open":6},"info":{"ephemeral_id":"9f4cff85-eaa7-4e48-8c88-e096f96ae671","uptime":{"ms":420032}},"memstats":{"gc_next":4978368,"memory_alloc":2826616,"memory_total":15544568},"runtime":{"goroutines":23}},"filebeat":{"harvester":{"open_files":0,"running":0}},"libbeat":{"config":{"module":{"running":0}},"pipeline":{"clients":1,"events":{"active":0}}},"registrar":{"states":{"current":2}},"system":{"load":{"1":0,"15":0.05,"5":0.01,"norm":{"1":0,"15":0.0063,"5":0.0013}}}}}}
2019-10-11T16:15:59.595+0800 INFO [monitoring] log/log.go:145 Non-zero metrics in the last 30s {"monitoring": {"metrics": {"beat":{"cpu":{"system":{"ticks":120,"time":{"ms":3}},"total":{"ticks":250,"time":{"ms":8},"value":250},"user":{"ticks":130,"time":{"ms":5}}},"handles":{"limit":{"hard":4096,"soft":1024},"open":6},"info":{"ephemeral_id":"9f4cff85-eaa7-4e48-8c88-e096f96ae671","uptime":{"ms":450030}},"memstats":{"gc_next":4978368,"memory_alloc":3151688,"memory_total":15869640,"rss":-2547712},"runtime":{"goroutines":23}},"filebeat":{"harvester":{"open_files":0,"running":0}},"libbeat":{"config":{"module":{"running":0}},"pipeline":{"clients":1,"events":{"active":0}}},"registrar":{"states":{"current":2}},"system":{"load":{"1":0,"15":0.05,"5":0.01,"norm":{"1":0,"15":0.0063,"5":0.0013}}}}}}
2019-10-11T16:16:29.595+0800 INFO [monitoring] log/log.go:145 Non-zero metrics in the last 30s {"monitoring": {"metrics": {"beat":{"cpu":{"system":{"ticks":120,"time":{"ms":3}},"total":{"ticks":250,"time":{"ms":9},"value":250},"user":{"ticks":130,"time":{"ms":6}}},"handles":{"limit":{"hard":4096,"soft":1024},"open":6},"info":{"ephemeral_id":"9f4cff85-eaa7-4e48-8c88-e096f96ae671","uptime":{"ms":480031}},"memstats":{"gc_next":4978368,"memory_alloc":3554816,"memory_total":16272768},"runtime":{"goroutines":23}},"filebeat":{"harvester":{"open_files":0,"running":0}},"libbeat":{"config":{"module":{"running":0}},"pipeline":{"clients":1,"events":{"active":0}}},"registrar":{"states":{"current":2}},"system":{"load":{"1":0,"15":0.05,"5":0.01,"norm":{"1":0,"15":0.0063,"5":0.0013}}}}}}
2019-10-11T16:16:59.595+0800 INFO [monitoring] log/log.go:145 Non-zero metrics in the last 30s {"monitoring": {"metrics": {"beat":{"cpu":{"system":{"ticks":130,"time":{"ms":2}},"total":{"ticks":270,"time":{"ms":13},"value":270},"user":{"ticks":140,"time":{"ms":11}}},"handles":{"limit":{"hard":4096,"soft":1024},"open":6},"info":{"ephemeral_id":"9f4cff85-eaa7-4e48-8c88-e096f96ae671","uptime":{"ms":510032}},"memstats":{"gc_next":4978368,"memory_alloc":2497744,"memory_total":16510216},"runtime":{"goroutines":23}},"filebeat":{"harvester":{"open_files":0,"running":0}},"libbeat":{"config":{"module":{"running":0}},"pipeline":{"clients":1,"events":{"active":0}}},"registrar":{"states":{"current":2}},"system":{"load":{"1":0,"15":0.05,"5":0.01,"norm":{"1":0,"15":0.0063,"5":0.0013}}}}}}
2019-10-11T16:17:09.615+0800 INFO log/harvester.go:253 Harvester started for file: /home/admin/confcenter/logs/confcenter.monitor.2019-10-11.0.log
2019-10-11T16:17:10.622+0800 ERROR logstash/async.go:256 Failed to publish events caused by: write tcp 192.168.17.48:59180->192.168.17.42:5044: write: connection reset by peer
2019-10-11T16:17:12.476+0800 ERROR pipeline/output.go:121 Failed to publish events: write tcp 192.168.17.48:59180->192.168.17.42:5044: write: connection reset by peer
2019-10-11T16:17:12.476+0800 INFO pipeline/output.go:95 Connecting to failover(backoff(async(tcp://192.168.17.41:5044)),backoff(async(tcp://192.168.17.42:5044)))
2019-10-11T16:17:16.325+0800 ERROR pipeline/output.go:100 Failed to connect to failover(backoff(async(tcp://192.168.17.41:5044)),backoff(async(tcp://192.168.17.42:5044))): dial tcp 192.168.17.41:5044: connect: connection refused
2019-10-11T16:17:16.325+0800 INFO pipeline/output.go:93 Attempting to reconnect to failover(backoff(async(tcp://192.168.17.41:5044)),backoff(async(tcp://192.168.17.42:5044))) with 1 reconnect attempt(s)
2019-10-11T16:17:16.326+0800 INFO pipeline/output.go:105 Connection to failover(backoff(async(tcp://192.168.17.41:5044)),backoff(async(tcp://192.168.17.42:5044))) established
2019-10-11T16:17:29.595+0800 INFO [monitoring] log/log.go:145 Non-zero metrics in the last 30s {"monitoring": {"metrics": {"beat":{"cpu":{"system":{"ticks":140,"time":{"ms":17}},"total":{"ticks":300,"time":{"ms":37},"value":300},"user":{"ticks":160,"time":{"ms":20}}},"handles":{"limit":{"hard":4096,"soft":1024},"open":7},"info":{"ephemeral_id":"9f4cff85-eaa7-4e48-8c88-e096f96ae671","uptime":{"ms":540031}},"memstats":{"gc_next":8126128,"memory_alloc":5528968,"memory_total":20056640,"rss":1126400},"runtime":{"goroutines":27}},"filebeat":{"events":{"added":5,"done":5},"harvester":{"open_files":1,"running":1,"started":1}},"libbeat":{"config":{"module":{"running":0}},"output":{"events":{"acked":4,"batches":2,"failed":4,"total":8},"read":{"bytes":6},"write":{"bytes":905,"errors":1}},"pipeline":{"clients":1,"events":{"active":0,"filtered":1,"published":4,"retry":12,"total":5},"queue":{"acked":4}}},"registrar":{"states":{"current":2,"update":5},"writes":{"success":2,"total":2}},"system":{"load":{"1":0,"15":0.05,"5":0.01,"norm":{"1":0,"15":0.0063,"5":0.0013}}}}}}
2019-10-11T16:17:59.595+0800 INFO [monitoring] log/log.go:145 Non-zero metrics in the last 30s {"monitoring": {"metrics": {"beat":{"cpu":{"system":{"ticks":150,"time":{"ms":4}},"total":{"ticks":320,"time":{"ms":10},"value":320},"user":{"ticks":170,"time":{"ms":6}}},"handles":{"limit":{"hard":4096,"soft":1024},"open":7},"info":{"ephemeral_id":"9f4cff85-eaa7-4e48-8c88-e096f96ae671","uptime":{"ms":570033}},"memstats":{"gc_next":8126128,"memory_alloc":5786944,"memory_total":20314616},"runtime":{"goroutines":27}},"filebeat":{"harvester":{"open_files":1,"running":1}},"libbeat":{"config":{"module":{"running":0}},"pipeline":{"clients":1,"events":{"active":0}}},"registrar":{"states":{"current":2}},"system":{"load":{"1":0,"15":0.05,"5":0.01,"norm":{"1":0,"15":0.0063,"5":0.0013}}}}}}
2019-10-11T16:18:29.595+0800 INFO [monitoring] log/log.go:145 Non-zero metrics in the last 30s {"monitoring": {"metrics": {"beat":{"cpu":{"system":{"ticks":150,"time":{"ms":8}},"total":{"ticks":320,"time":{"ms":12},"value":320},"user":{"ticks":170,"time":{"ms":4}}},"handles":{"limit":{"hard":4096,"soft":1024},"open":7},"info":{"ephemeral_id":"9f4cff85-eaa7-4e48-8c88-e096f96ae671","uptime":{"ms":600031}},"memstats":{"gc_next":8126128,"memory_alloc":6189272,"memory_total":20716944,"rss":266240},"runtime":{"goroutines":27}},"filebeat":{"harvester":{"open_files":1,"running":1}},"libbeat":{"config":{"module":{"running":0}},"pipeline":{"clients":1,"events":{"active":0}}},"registrar":{"states":{"current":2}},"system":{"load":{"1":0,"15":0.05,"5":0.01,"norm":{"1":0,"15":0.0063,"5":0.0013}}}}}}
2019-10-11T16:18:59.595+0800 INFO [monitoring] log/log.go:145 Non-zero metrics in the last 30s {"monitoring": {"metrics": {"beat":{"cpu":{"system":{"ticks":160,"time":{"ms":3}},"total":{"ticks":340,"time":{"ms":9},"value":340},"user":{"ticks":180,"time":{"ms":6}}},"handles":{"limit":{"hard":4096,"soft":1024},"open":7},"info":{"ephemeral_id":"9f4cff85-eaa7-4e48-8c88-e096f96ae671","uptime":{"ms":630033}},"memstats":{"gc_next":8126128,"memory_alloc":6428448,"memory_total":20956120,"rss":262144},"runtime":{"goroutines":27}},"filebeat":{"harvester":{"open_files":1,"running":1}},"libbeat":{"config":{"module":{"running":0}},"pipeline":{"clients":1,"events":{"active":0}}},"registrar":{"states":{"current":2}},"system":{"load":{"1":0,"15":0.05,"5":0.01,"norm":{"1":0,"15":0.0063,"5":0.0013}}}}}}
2019-10-11T16:19:29.595+0800 INFO [monitoring] log/log.go:145 Non-zero metrics in the last 30s {"monitoring": {"metrics": {"beat":{"cpu":{"system":{"ticks":160,"time":{"ms":2}},"total":{"ticks":360,"time":{"ms":17},"value":360},"user":{"ticks":200,"time":{"ms":15}}},"handles":{"limit":{"hard":4096,"soft":1024},"open":7},"info":{"ephemeral_id":"9f4cff85-eaa7-4e48-8c88-e096f96ae671","uptime":{"ms":660030}},"memstats":{"gc_next":5050256,"memory_alloc":2547408,"memory_total":21280104,"rss":532480},"runtime":{"goroutines":27}},"filebeat":{"harvester":{"open_files":1,"running":1}},"libbeat":{"config":{"module":{"running":0}},"pipeline":{"clients":1,"events":{"active":0}}},"registrar":{"states":{"current":2}},"system":{"load":{"1":0,"15":0.05,"5":0.01,"norm":{"1":0,"15":0.0063,"5":0.0013}}}}}}
2019-10-11T16:19:59.595+0800 INFO [monitoring] log/log.go:145 Non-zero metrics in the last 30s {"monitoring": {"metrics": {"beat":{"cpu":{"system":{"ticks":170,"time":{"ms":7}},"total":{"ticks":370,"time":{"ms":10},"value":370},"user":{"ticks":200,"time":{"ms":3}}},"handles":{"limit":{"hard":4096,"soft":1024},"open":7},"info":{"ephemeral_id":"9f4cff85-eaa7-4e48-8c88-e096f96ae671","uptime":{"ms":690030}},"memstats":{"gc_next":5050256,"memory_alloc":2956288,"memory_total":21688984},"runtime":{"goroutines":27}},"filebeat":{"harvester":{"open_files":1,"running":1}},"libbeat":{"config":{"module":{"running":0}},"pipeline":{"clients":1,"events":{"active":0}}},"registrar":{"states":{"current":2}},"system":{"load":{"1":0,"15":0.05,"5":0.01,"norm":{"1":0,"15":0.0063,"5":0.0013}}}}}}
2019-10-11T16:20:25.627+0800 ERROR logstash/async.go:256 Failed to publish events caused by: write tcp 192.168.17.48:59198->192.168.17.42:5044: write: connection reset by peer
2019-10-11T16:20:27.436+0800 ERROR pipeline/output.go:121 Failed to publish events: write tcp 192.168.17.48:59198->192.168.17.42:5044: write: connection reset by peer
2019-10-11T16:20:27.436+0800 INFO pipeline/output.go:95 Connecting to failover(backoff(async(tcp://192.168.17.41:5044)),backoff(async(tcp://192.168.17.42:5044)))
2019-10-11T16:20:29.595+0800 INFO [monitoring] log/log.go:145 Non-zero metrics in the last 30s {"monitoring": {"metrics": {"beat":{"cpu":{"system":{"ticks":170,"time":{"ms":4}},"total":{"ticks":390,"time":{"ms":21},"value":390},"user":{"ticks":220,"time":{"ms":17}}},"handles":{"limit":{"hard":4096,"soft":1024},"open":6},"info":{"ephemeral_id":"9f4cff85-eaa7-4e48-8c88-e096f96ae671","uptime":{"ms":720030}},"memstats":{"gc_next":8137968,"memory_alloc":4165304,"memory_total":23606864},"runtime":{"goroutines":26}},"filebeat":{"events":{"active":4,"added":4},"harvester":{"open_files":1,"running":1}},"libbeat":{"config":{"module":{"running":0}},"output":{"events":{"batches":1,"failed":4,"total":4},"write":{"errors":1}},"pipeline":{"clients":1,"events":{"active":4,"published":4,"retry":4,"total":4}}},"registrar":{"states":{"current":2}},"system":{"load":{"1":0,"15":0.05,"5":0.01,"norm":{"1":0,"15":0.0063,"5":0.0013}}}}}}
2019-10-11T16:20:32.629+0800 ERROR pipeline/output.go:100 Failed to connect to failover(backoff(async(tcp://192.168.17.41:5044)),backoff(async(tcp://192.168.17.42:5044))): dial tcp 192.168.17.41:5044: connect: connection refused
2019-10-11T16:20:32.629+0800 INFO pipeline/output.go:93 Attempting to reconnect to failover(backoff(async(tcp://192.168.17.41:5044)),backoff(async(tcp://192.168.17.42:5044))) with 1 reconnect attempt(s)
2019-10-11T16:20:32.630+0800 INFO pipeline/output.go:105 Connection to failover(backoff(async(tcp://192.168.17.41:5044)),backoff(async(tcp://192.168.17.42:5044))) established
2019-10-11T16:20:59.596+0800 INFO [monitoring] log/log.go:145 Non-zero metrics in the last 30s {"monitoring": {"metrics": {"beat":{"cpu":{"system":{"ticks":180,"time":{"ms":13}},"total":{"ticks":410,"time":{"ms":29},"value":410},"user":{"ticks":230,"time":{"ms":16}}},"handles":{"limit":{"hard":4096,"soft":1024},"open":7},"info":{"ephemeral_id":"9f4cff85-eaa7-4e48-8c88-e096f96ae671","uptime":{"ms":750031}},"memstats":{"gc_next":5127104,"memory_alloc":2656000,"memory_total":26850056,"rss":-2973696},"runtime":{"goroutines":27}},"filebeat":{"events":{"active":-4,"added":2,"done":6},"harvester":{"open_files":1,"running":1}},"libbeat":{"config":{"module":{"running":0}},"output":{"events":{"acked":6,"batches":2,"total":6},"read":{"bytes":12},"write":{"bytes":1688}},"pipeline":{"clients":1,"events":{"active":0,"published":2,"retry":8,"total":2},"queue":{"acked":6}}},"registrar":{"states":{"current":2,"update":6},"writes":{"success":2,"total":2}},"system":{"load":{"1":0.06,"15":0.05,"5":0.03,"norm":{"1":0.0075,"15":0.0063,"5":0.0038}}}}}}
2019-10-11T16:21:29.594+0800 INFO [monitoring] log/log.go:145 Non-zero metrics in the last 30s {"monitoring": {"metrics": {"beat":{"cpu":{"system":{"ticks":190,"time":{"ms":5}},"total":{"ticks":420,"time":{"ms":9},"value":420},"user":{"ticks":230,"time":{"ms":4}}},"handles":{"limit":{"hard":4096,"soft":1024},"open":7},"info":{"ephemeral_id":"9f4cff85-eaa7-4e48-8c88-e096f96ae671","uptime":{"ms":780029}},"memstats":{"gc_next":5127104,"memory_alloc":2912152,"memory_total":27106208},"runtime":{"goroutines":27}},"filebeat":{"harvester":{"open_files":1,"running":1}},"libbeat":{"config":{"module":{"running":0}},"pipeline":{"clients":1,"events":{"active":0}}},"registrar":{"states":{"current":2}},"system":{"load":{"1":0.12,"15":0.05,"5":0.04,"norm":{"1":0.015,"15":0.0063,"5":0.005}}}}}}
2019-10-11T16:21:59.593+0800 INFO [monitoring] log/log.go:145 Non-zero metrics in the last 30s {"monitoring": {"metrics": {"beat":{"cpu":{"system":{"ticks":190,"time":{"ms":2}},"total":{"ticks":430,"time":{"ms":8},"value":430},"user":{"ticks":240,"time":{"ms":6}}},"handles":{"limit":{"hard":4096,"soft":1024},"open":7},"info":{"ephemeral_id":"9f4cff85-eaa7-4e48-8c88-e096f96ae671","uptime":{"ms":810030}},"memstats":{"gc_next":5127104,"memory_alloc":3318176,"memory_total":27512232},"runtime":{"goroutines":27}},"filebeat":{"harvester":{"open_files":1,"running":1}},"libbeat":{"config":{"module":{"running":0}},"pipeline":{"clients":1,"events":{"active":0}}},"registrar":{"states":{"current":2}},"system":{"load":{"1":0.07,"15":0.05,"5":0.04,"norm":{"1":0.0088,"15":0.0063,"5":0.005}}}}}}
2019-10-11T16:22:29.595+0800 INFO [monitoring] log/log.go:145 Non-zero metrics in the last 30s {"monitoring": {"metrics": {"beat":{"cpu":{"system":{"ticks":190,"time":{"ms":4}},"total":{"ticks":440,"time":{"ms":8},"value":440},"user":{"ticks":250,"time":{"ms":4}}},"handles":{"limit":{"hard":4096,"soft":1024},"open":7},"info":{"ephemeral_id":"9f4cff85-eaa7-4e48-8c88-e096f96ae671","uptime":{"ms":840031}},"memstats":{"gc_next":5127104,"memory_alloc":3730520,"memory_total":27924576},"runtime":{"goroutines":27}},"filebeat":{"harvester":{"open_files":1,"running":1}},"libbeat":{"config":{"module":{"running":0}},"pipeline":{"clients":1,"events":{"active":0}}},"registrar":{"states":{"current":2}},"system":{"load":{"1":0.04,"15":0.05,"5":0.04,"norm":{"1":0.005,"15":0.0063,"5":0.005}}}}}}
2019-10-11T16:22:59.595+0800 INFO [monitoring] log/log.go:145 Non-zero metrics in the last 30s {"monitoring": {"metrics": {"beat":{"cpu":{"system":{"ticks":200,"time":{"ms":8}},"total":{"ticks":460,"time":{"ms":19},"value":460},"user":{"ticks":260,"time":{"ms":11}}},"handles":{"limit":{"hard":4096,"soft":1024},"open":7},"info":{"ephemeral_id":"9f4cff85-eaa7-4e48-8c88-e096f96ae671","uptime":{"ms":870029}},"memstats":{"gc_next":5051536,"memory_alloc":2533848,"memory_total":28082320},"runtime":{"goroutines":27}},"filebeat":{"harvester":{"open_files":1,"running":1}},"libbeat":{"config":{"module":{"running":0}},"pipeline":{"clients":1,"events":{"active":0}}},"registrar":{"states":{"current":2}},"system":{"load":{"1":0.03,"15":0.05,"5":0.03,"norm":{"1":0.0038,"15":0.0063,"5":0.0038}}}}}}
2019-10-11T16:23:29.595+0800 INFO [monitoring] log/log.go:145 Non-zero metrics in the last 30s {"monitoring": {"metrics": {"beat":{"cpu":{"system":{"ticks":210,"time":{"ms":6}},"total":{"ticks":470,"time":{"ms":9},"value":470},"user":{"ticks":260,"time":{"ms":3}}},"handles":{"limit":{"hard":4096,"soft":1024},"open":7},"info":{"ephemeral_id":"9f4cff85-eaa7-4e48-8c88-e096f96ae671","uptime":{"ms":900029}},"memstats":{"gc_next":5051536,"memory_alloc":2867728,"memory_total":28416200},"runtime":{"goroutines":27}},"filebeat":{"harvester":{"open_files":1,"running":1}},"libbeat":{"config":{"module":{"running":0}},"pipeline":{"clients":1,"events":{"active":0}}},"registrar":{"states":{"current":2}},"system":{"load":{"1":0.02,"15":0.05,"5":0.03,"norm":{"1":0.0025,"15":0.0063,"5":0.0038}}}}}}
2019-10-11T16:23:59.595+0800 INFO [monitoring] log/log.go:145 Non-zero metrics in the last 30s {"monitoring": {"metrics": {"beat":{"cpu":{"system":{"ticks":210,"time":{"ms":5}},"total":{"ticks":470,"time":{"ms":8},"value":470},"user":{"ticks":260,"time":{"ms":3}}},"handles":{"limit":{"hard":4096,"soft":1024},"open":7},"info":{"ephemeral_id":"9f4cff85-eaa7-4e48-8c88-e096f96ae671","uptime":{"ms":930031}},"memstats":{"gc_next":5051536,"memory_alloc":3356048,"memory_total":28904520},"runtime":{"goroutines":27}},"filebeat":{"harvester":{"open_files":1,"running":1}},"libbeat":{"config":{"module":{"running":0}},"pipeline":{"clients":1,"events":{"active":0}}},"registrar":{"states":{"current":2}},"system":{"load":{"1":0.01,"15":0.05,"5":0.03,"norm":{"1":0.0013,"15":0.0063,"5":0.0038}}}}}}
2019-10-11T16:24:29.594+0800 INFO [monitoring] log/log.go:145 Non-zero metrics in the last 30s {"monitoring": {"metrics": {"beat":{"cpu":{"system":{"ticks":220,"time":{"ms":7}},"total":{"ticks":480,"time":{"ms":9},"value":480},"user":{"ticks":260,"time":{"ms":2}}},"handles":{"limit":{"hard":4096,"soft":1024},"open":7},"info":{"ephemeral_id":"9f4cff85-eaa7-4e48-8c88-e096f96ae671","uptime":{"ms":960031}},"memstats":{"gc_next":5051536,"memory_alloc":3681584,"memory_total":29230056},"runtime":{"goroutines":27}},"filebeat":{"harvester":{"open_files":1,"running":1}},"libbeat":{"config":{"module":{"running":0}},"pipeline":{"clients":1,"events":{"active":0}}},"registrar":{"states":{"current":2}},"system":{"load":{"1":0.01,"15":0.05,"5":0.03,"norm":{"1":0.0013,"15":0.0063,"5":0.0038}}}}}}
2019-10-11T16:24:59.593+0800 INFO [monitoring] log/log.go:145 Non-zero metrics in the last 30s {"monitoring": {"metrics": {"beat":{"cpu":{"system":{"ticks":220,"time":{"ms":2}},"total":{"ticks":500,"time":{"ms":15},"value":500},"user":{"ticks":280,"time":{"ms":13}}},"handles":{"limit":{"hard":4096,"soft":1024},"open":7},"info":{"ephemeral_id":"9f4cff85-eaa7-4e48-8c88-e096f96ae671","uptime":{"ms":990030}},"memstats":{"gc_next":5051504,"memory_alloc":2615480,"memory_total":29471512},"runtime":{"goroutines":27}},"filebeat":{"harvester":{"open_files":1,"running":1}},"libbeat":{"config":{"module":{"running":0}},"pipeline":{"clients":1,"events":{"active":0}}},"registrar":{"states":{"current":2}},"system":{"load":{"1":0,"15":0.05,"5":0.02,"norm":{"1":0,"15":0.0063,"5":0.0025}}}}}}
2019-10-11T16:25:29.595+0800 INFO [monitoring] log/log.go:145 Non-zero metrics in the last 30s {"monitoring": {"metrics": {"beat":{"cpu":{"system":{"ticks":230,"time":{"ms":5}},"total":{"ticks":510,"time":{"ms":9},"value":510},"user":{"ticks":280,"time":{"ms":4}}},"handles":{"limit":{"hard":4096,"soft":1024},"open":7},"info":{"ephemeral_id":"9f4cff85-eaa7-4e48-8c88-e096f96ae671","uptime":{"ms":1020029}},"memstats":{"gc_next":5051504,"memory_alloc":2866368,"memory_total":29722400},"runtime":{"goroutines":27}},"filebeat":{"harvester":{"open_files":1,"running":1}},"libbeat":{"config":{"module":{"running":0}},"pipeline":{"clients":1,"events":{"active":0}}},"registrar":{"states":{"current":2}},"system":{"load":{"1":0,"15":0.05,"5":0.02,"norm":{"1":0,"15":0.0063,"5":0.0025}}}}}}
2019-10-11T16:25:54.639+0800 INFO log/harvester.go:278 File is inactive: /home/admin/confcenter/logs/confcenter.monitor.2019-10-11.0.log. Closing because close_inactive of 5m0s reached.
2019-10-11T16:25:59.595+0800 INFO [monitoring] log/log.go:145 Non-zero metrics in the last 30s {"monitoring": {"metrics": {"beat":{"cpu":{"system":{"ticks":230,"time":{"ms":5}},"total":{"ticks":520,"time":{"ms":13},"value":520},"user":{"ticks":290,"time":{"ms":8}}},"handles":{"limit":{"hard":4096,"soft":1024},"open":6},"info":{"ephemeral_id":"9f4cff85-eaa7-4e48-8c88-e096f96ae671","uptime":{"ms":1050030}},"memstats":{"gc_next":5051504,"memory_alloc":3273656,"memory_total":30129688,"rss":-303104},"runtime":{"goroutines":23}},"filebeat":{"events":{"added":1,"done":1},"harvester":{"closed":1,"open_files":0,"running":0}},"libbeat":{"config":{"module":{"running":0}},"pipeline":{"clients":1,"events":{"active":0,"filtered":1,"total":1}}},"registrar":{"states":{"current":2,"update":1},"writes":{"success":1,"total":1}},"system":{"load":{"1":0,"15":0.05,"5":0.02,"norm":{"1":0,"15":0.0063,"5":0.0025}}}}}}
2019-10-11T16:26:29.595+0800 INFO [monitoring] log/log.go:145 Non-zero metrics in the last 30s {"monitoring": {"metrics": {"beat":{"cpu":{"system":{"ticks":240,"time":{"ms":3}},"total":{"ticks":530,"time":{"ms":7},"value":530},"user":{"ticks":290,"time":{"ms":4}}},"handles":{"limit":{"hard":4096,"soft":1024},"open":6},"info":{"ephemeral_id":"9f4cff85-eaa7-4e48-8c88-e096f96ae671","uptime":{"ms":1080029}},"memstats":{"gc_next":5051504,"memory_alloc":3508544,"memory_total":30364576},"runtime":{"goroutines":23}},"filebeat":{"harvester":{"open_files":0,"running":0}},"libbeat":{"config":{"module":{"running":0}},"pipeline":{"clients":1,"events":{"active":0}}},"registrar":{"states":{"current":2}},"system":{"load":{"1":0,"15":0.05,"5":0.01,"norm":{"1":0,"15":0.0063,"5":0.0013}}}}}}
2019-10-11T16:26:59.595+0800 INFO [monitoring] log/log.go:145 Non-zero metrics in the last 30s {"monitoring": {"metrics": {"beat":{"cpu":{"system":{"ticks":240,"time":{"ms":3}},"total":{"ticks":550,"time":{"ms":16},"value":550},"user":{"ticks":310,"time":{"ms":13}}},"handles":{"limit":{"hard":4096,"soft":1024},"open":6},"info":{"ephemeral_id":"9f4cff85-eaa7-4e48-8c88-e096f96ae671","uptime":{"ms":1110029}},"memstats":{"gc_next":4980896,"memory_alloc":2493952,"memory_total":30691520},"runtime":{"goroutines":23}},"filebeat":{"harvester":{"open_files":0,"running":0}},"libbeat":{"config":{"module":{"running":0}},"pipeline":{"clients":1,"events":{"active":0}}},"registrar":{"states":{"current":2}},"system":{"load":{"1":0,"15":0.05,"5":0.01,"norm":{"1":0,"15":0.0063,"5":0.0013}}}}}}
2019-10-11T16:27:29.595+0800 INFO [monitoring] log/log.go:145 Non-zero metrics in the last 30s {"monitoring": {"metrics": {"beat":{"cpu":{"system":{"ticks":240,"time":{"ms":3}},"total":{"ticks":550,"time":{"ms":7},"value":550},"user":{"ticks":310,"time":{"ms":4}}},"handles":{"limit":{"hard":4096,"soft":1024},"open":6},"info":{"ephemeral_id":"9f4cff85-eaa7-4e48-8c88-e096f96ae671","uptime":{"ms":1140031}},"memstats":{"gc_next":4980896,"memory_alloc":2990280,"memory_total":31187848},"runtime":{"goroutines":23}},"filebeat":{"harvester":{"open_files":0,"running":0}},"libbeat":{"config":{"module":{"running":0}},"pipeline":{"clients":1,"events":{"active":0}}},"registrar":{"states":{"current":2}},"system":{"load":{"1":0,"15":0.05,"5":0.01,"norm":{"1":0,"15":0.0063,"5":0.0013}}}}}}
2019-10-11T16:27:59.595+0800 INFO [monitoring] log/log.go:145 Non-zero metrics in the last 30s {"monitoring": {"metrics": {"beat":{"cpu":{"system":{"ticks":250,"time":{"ms":5}},"total":{"ticks":570,"time":{"ms":10},"value":570},"user":{"ticks":320,"time":{"ms":5}}},"handles":{"limit":{"hard":4096,"soft":1024},"open":6},"info":{"ephemeral_id":"9f4cff85-eaa7-4e48-8c88-e096f96ae671","uptime":{"ms":1170030}},"memstats":{"gc_next":4980896,"memory_alloc":3143048,"memory_total":31340616},"runtime":{"goroutines":23}},"filebeat":{"harvester":{&
已邀请:

yuwei

赞同来自: zn

我改用rpm版本或者用root打开,好像就没这个问题了

pzxsheng

赞同来自: Jiehui Tang

找到解决方法,原因就不知道,通过shell脚本启动
 
 

#!/bin/bash
nohup /home/elk/filebeat-7.7.0-linux-x86_64/filebeat -e -c /home/elk/filebeat-7.7.0-linux-x86_64/filebeat.yml > filebeat.log &
 
 

xiaoqi17

赞同来自:

楼主您好,遇到了同样的问题,也是7.3.2版本,请问有解决吗?
filebeat莫名被stop了。相关日志:
 

nzmd

赞同来自:

我是7.2也有这个问题

guoyandong

赞同来自:

自己 下载个yum源安装的包  看下他的xxx.service 的配置咋写的就行 
[Unit]
Description=filebeat is a lightweight shipper for metrics.
Documentation=https://www.elastic.co/products/beats/filebeat
Wants=network-online.target
After=network-online.target

[Service]

Environment="BEAT_LOG_OPTS=-e"
Environment="BEAT_CONFIG_OPTS=-c /usr/local/linux_elk7.4/filebeat-7.4.2-linux-x86_64/filebeat.yml"
Environment="BEAT_PATH_OPTS=-path.home /usr/local/linux_elk7.4/filebeat-7.4.2-linux-x86_64 -path.config /usr/local/linux_elk7.4/filebeat-7.4.2-linux-x86_64 -path.data /usr/local/linux_elk7.4/filebeat-7.4.2-linux-x86_64/data -path.logs /usr/local/linux_elk7.4/filebeat-7.4.2-linux-x86_64/logs"
ExecStart=/usr/local/linux_elk7.4/filebeat-7.4.2-linux-x86_64/filebeat $BEAT_LOG_OPTS $BEAT_CONFIG_OPTS $BEAT_PATH_OPTS
Restart=always

[Install]
WantedBy=multi-user.target
照他这么配就没事   自己  nohup *******   &  这样就™的自己退  谁知道怎么回事 

imwesley

赞同来自:

请问楼主问题解决了吗?我也遇到了这个问题,总是自动退出,日志如下:
2019-12-13T18:41:30.741+0800    INFO    [monitoring]    log/log.go:145  Non-zero metrics in the last 30s        {"monitoring": {"metrics": {"beat":{"cpu":{"system":{"ticks":930,"time":{"ms":2}},"total":{"ticks":2620,"time":{"ms":4},"value":2620},"user":{"ticks":1690,"time":{"ms":2}}},"handles":{"limit":{"hard":131072,"soft":65536},"open":8},"info":{"ephemeral_id":"3ceef3ed-ff4c-49f8-b20e-c8ef157d191b","uptime":{"ms":11400164}},"memstats":{"gc_next":8144336,"memory_alloc":5222496,"memory_total":345942544},"runtime":{"goroutines":26}},"filebeat":{"harvester":{"open_files":1,"running":1}},"libbeat":{"config":{"module":{"running":0}},"pipeline":{"clients":1,"events":{"active":0}}},"registrar":{"states":{"current":10}},"system":{"load":{"1":0.09,"15":0.17,"5":0.14,"norm":{"1":0.0225,"15":0.0425,"5":0.035}}}}}}
2019-12-13T18:42:00.741+0800 INFO [monitoring] log/log.go:145 Non-zero metrics in the last 30s {"monitoring": {"metrics": {"beat":{"cpu":{"system":{"ticks":930,"time":{"ms":1}},"total":{"ticks":2630,"time":{"ms":6},"value":2630},"user":{"ticks":1700,"time":{"ms":5}}},"handles":{"limit":{"hard":131072,"soft":65536},"open":8},"info":{"ephemeral_id":"3ceef3ed-ff4c-49f8-b20e-c8ef157d191b","uptime":{"ms":11430163}},"memstats":{"gc_next":5097280,"memory_alloc":2605536,"memory_total":346301744,"rss":-888832},"runtime":{"goroutines":26}},"filebeat":{"harvester":{"open_files":1,"running":1}},"libbeat":{"config":{"module":{"running":0}},"pipeline":{"clients":1,"events":{"active":0}}},"registrar":{"states":{"current":10}},"system":{"load":{"1":0.11,"15":0.17,"5":0.14,"norm":{"1":0.0275,"15":0.0425,"5":0.035}}}}}}
2019-12-13T18:42:28.303+0800 INFO beater/filebeat.go:443 Stopping filebeat
2019-12-13T18:42:28.304+0800 INFO crawler/crawler.go:139 Stopping Crawler
2019-12-13T18:42:28.304+0800 INFO crawler/crawler.go:149 Stopping 1 inputs
2019-12-13T18:42:28.304+0800 INFO input/input.go:149 input ticker stopped
2019-12-13T18:42:28.304+0800 INFO input/input.go:167 Stopping Input: 10479034256437976383
2019-12-13T18:42:28.306+0800 INFO cfgfile/reload.go:229 Dynamic config reloader stopped
2019-12-13T18:42:28.306+0800 INFO log/harvester.go:274 Reader was closed: /opt/ebiz/webapps/ebiz-claim-center/logs/application.log. Closing.
2019-12-13T18:42:28.306+0800 INFO crawler/crawler.go:165 Crawler stopped
2019-12-13T18:42:28.306+0800 INFO registrar/registrar.go:367 Stopping Registrar
2019-12-13T18:42:28.306+0800 INFO registrar/registrar.go:293 Ending Registrar
2019-12-13T18:42:28.321+0800 INFO [monitoring] log/log.go:153 Total non-zero metrics {"monitoring": {"metrics": {"beat":{"cpu":{"system":{"ticks":930,"time":{"ms":938}},"total":{"ticks":2630,"time":{"ms":2644},"value":2630},"user":{"ticks":1700,"time":{"ms":1706}}},"handles":{"limit":{"hard":131072,"soft":65536},"open":7},"info":{"ephemeral_id":"3ceef3ed-ff4c-49f8-b20e-c8ef157d191b","uptime":{"ms":11457743}},"memstats":{"gc_next":5097280,"memory_alloc":2989608,"memory_total":346685816,"rss":15691776},"runtime":{"goroutines":12}},"filebeat":{"events":{"added":6248,"done":6248},"harvester":{"closed":8,"open_files":0,"running":0,"started":8},"input":{"log":{"files":{"renamed":1}}}},"libbeat":{"config":{"module":{"running":0},"reloads":1},"output":{"events":{"acked":6223,"batches":98,"failed":652,"total":6875},"read":{"bytes":498},"type":"logstash","write":{"bytes":719476,"errors":20}},"pipeline":{"clients":0,"events":{"active":0,"filtered":25,"published":6223,"retry":3352,"total":6248},"queue":{"acked":6223}}},"registrar":{"states":{"current":10,"update":6248},"writes":{"success":98,"total":98}},"system":{"cpu":{"cores":4},"load":{"1":0.12,"15":0.17,"5":0.15,"norm":{"1":0.03,"15":0.0425,"5":0.0375}}}}}}
2019-12-13T18:42:28.321+0800 INFO [monitoring] log/log.go:154 Uptime: 3h10m57.744547981s
2019-12-13T18:42:28.321+0800 INFO [monitoring] log/log.go:131 Stopping metrics logging.
2019-12-13T18:42:28.321+0800 INFO instance/beat.go:432 filebeat stopped.

 

Florence - 待我光头之日

赞同来自:

请问解决了吗

Jiehui Tang

赞同来自:

同样遇到这样的问题,手工命令行 :
./filebeat -c filebeat.yml &启动后,运行1-2h后自动结束,filebeat 7.4.0

要回复问题请先登录注册