filebeat 6.5.4
收集上百个文件，我们发现数据有重复收集的情况，通过线上的Debug 发现以下日志信息
各位巨佬们有遇到过吗，或者有没有什么思路可以分享下
收集上百个文件，我们发现数据有重复收集的情况，通过线上的Debug 发现以下日志信息
2020-04-24T06:24:23.688+0800 DEBUG [input] log/input.go:494 Update existing file for harvesting: /log5/funshout.txt, offset: 426533
2020-04-24T06:24:23.688+0800 DEBUG [input] log/input.go:513 Old file was truncated. Starting from the beginning: /log5/funshout.txt, offset: 426485, new size: %!d(MISSING)
2020-04-24T06:24:23.688+0800 DEBUG [harvester] log/harvester.go:489 Setting offset for file based on seek: /log5/funshout.txt
2020-04-24T06:24:23.688+0800 DEBUG [harvester] log/harvester.go:475 Setting offset for file: /log5/funshout.txt. Offset: 0
2020-04-24T06:24:23.688+0800 DEBUG [harvester] log/harvester.go:390 Update state: /log5/funshout.txt, offset: 0各位巨佬们有遇到过吗，或者有没有什么思路可以分享下
1 个回复
juin - 大数据开发
赞同来自:
Old file was truncated. Starting from the beginning: /log5/funshout.txt, offset: 426485, new size: %!d(MISSING)