不要急,总有办法的

logstash 全量导出es索引库数据异常

Logstash | 作者 yiyu | 发布于2020年12月23日 | 阅读数:190

[2020-12-23T09:22:10,580][ERROR][logstash.javapipeline    ] A plugin had an unrecoverable error. Will restart this plugin.
Pipeline_id:main
Plugin: <LogStash::Inputs::Elasticsearch size=>5000, hosts=>["flow01:9200"], query=>"{\"query\": {\"match_all\": {}},\"sort\": [{\"time\": {\"order\": \"asc\"}}]}", scroll=>"1m", index=>"sss_*", docinfo=>false, id=>"6bd72454f6171feb4b4d478707f0654ace2faaefb018e653726e2766c161727f", enable_metric=>true, codec=><LogStash::Codecs::JSON id=>"json_b47a1658-e134-427b-97e8-c559028226bc", enable_metric=>true, charset=>"UTF-8">, docinfo_target=>"@metadata", docinfo_fields=>["_index", "_type", "_id"], ssl=>false>
Error: [429] {"error":{"root_cause":[{"type":"circuit_breaking_exception","reason":"[parent] Data too large, data for [<http_request>] would be [8064172214/7.5gb], which is larger than the limit of [7969862451/7.4gb], real usage: [8064171296/7.5gb], new bytes reserved: [918/918b]","bytes_wanted":8064172214,"bytes_limit":7969862451,"durability":"PERMANENT"}],"type":"circuit_breaking_exception","reason":"[parent] Data too large, data for [<http_request>] would be [8064172214/7.5gb], which is larger than the limit of [7969862451/7.4gb], real usage: [8064171296/7.5gb], new bytes reserved: [918/918b]","bytes_wanted":8064172214,"bytes_limit":7969862451,"durability":"PERMANENT"},"status":429}
Exception: Elasticsearch::Transport::Transport::ServerError
Stack: /home/software/logstash-7.2.0/vendor/bundle/jruby/2.5.0/gems/elasticsearch-transport-5.0.5/lib/elasticsearch/transport/transport/base.rb:202:in `__raise_transport_error'
/home/software/logstash-7.2.0/vendor/bundle/jruby/2.5.0/gems/elasticsearch-transport-5.0.5/lib/elasticsearch/transport/transport/base.rb:319:in `perform_request'
/home/software/logstash-7.2.0/vendor/bundle/jruby/2.5.0/gems/elasticsearch-transport-5.0.5/lib/elasticsearch/transport/transport/http/faraday.rb:20:in `perform_request'
/home/software/logstash-7.2.0/vendor/bundle/jruby/2.5.0/gems/elasticsearch-transport-5.0.5/lib/elasticsearch/transport/client.rb:131:in `perform_request'
/home/software/logstash-7.2.0/vendor/bundle/jruby/2.5.0/gems/elasticsearch-api-5.0.5/lib/elasticsearch/api/actions/search.rb:183:in `search'
/home/software/logstash-7.2.0/vendor/bundle/jruby/2.5.0/gems/logstash-input-elasticsearch-4.3.1/lib/logstash/inputs/elasticsearch.rb:280:in `search_request'
/home/software/logstash-7.2.0/vendor/bundle/jruby/2.5.0/gems/logstash-input-elasticsearch-4.3.1/lib/logstash/inputs/elasticsearch.rb:228:in `do_run_slice'
/home/software/logstash-7.2.0/vendor/bundle/jruby/2.5.0/gems/logstash-input-elasticsearch-4.3.1/lib/logstash/inputs/elasticsearch.rb:209:in `do_run'
/home/software/logstash-7.2.0/vendor/bundle/jruby/2.5.0/gems/logstash-input-elasticsearch-4.3.1/lib/logstash/inputs/elasticsearch.rb:197:in `run'
/home/software/logstash-7.2.0/logstash-core/lib/logstash/java_pipeline.rb:309:in `inputworker'
/home/software/logstash-7.2.0/logstash-core/lib/logstash/java_pipeline.rb:302:in `block in start_input'
cenOS7 服务器 ,配置文件没问题,前两天还运行好好的.
已邀请:

yiyu - 96新人

赞同来自:

磁盘还有1.5T可用

要回复问题请先登录注册