橡皮、老虎皮、狮子皮哪一个最不好?

elasticsearch es_rejected_execution_exception异常

Elasticsearch | 作者 bigsmart | 发布于2021年11月22日 | 阅读数:137

错误:
{"took":1,"errors":true,"items":[{"create":{"_index":"fluent-2021.11.22","_type":"_doc","_id":"_ZeaRX0BfEFBL71gl713","status":429,"error":{"type":"es_rejected_execution_exception","reason":"rejected execution of primary operation [coordinating_and_primary_bytes=91931217, replica_bytes=42663376, all_bytes=134594593, primary_operation_bytes=8608, max_coordinating_and_primary_bytes=107374182]"}}},{"create":{"_index":"fluent-2021.11.22","_type":"_doc","_id":"_peaRX0BfEFBL71gl713","status":429,"error":{"type":"es_rejected_execution_exception","reason":"rejected execution of primary operation [coordinating_and_primary_bytes=84980460, replica_bytes=66475525, all_bytes=151455985, primary_operation_bytes=13087, max_coordinating_and_primary_bytes=107374182]"}}},{"create":{"_index":"fluent-2021.11.22","_type":"_doc","_id":"_5eaRX0BfEFBL71gl713","status":429,"error":{"type":"es_rejected_execution_exception","reason":"rejected execution of primary operation [coordinating_and_primary_bytes=84980460, replica_bytes=66475525, all_bytes=151455985, primary_operation_bytes=13087, max_coordinating_and_primary_bytes=107374182]"}}},{"create":{"_index":"fluent-

我在网上搜索说是 bluk请求过多,elasticsearch线程池占满es拒绝请求了

但是我使用 GET /_cat/thread_pool?v
node_name name active queue rejected
elasticsearch-master-1 analyze 0 0 0
elasticsearch-master-1 auto_complete 0 0 0
elasticsearch-master-1 ccr 0 0 0
elasticsearch-master-1 fetch_shard_started 0 0 0
elasticsearch-master-1 fetch_shard_store 0 0 0
elasticsearch-master-1 flush 0 0 0
elasticsearch-master-1 force_merge 0 0 0
elasticsearch-master-1 generic 0 0 0
elasticsearch-master-1 get 0 0 0
elasticsearch-master-1 listener 0 0 0
elasticsearch-master-1 management 1 0 0
elasticsearch-master-1 ml_datafeed 0 0 0
elasticsearch-master-1 ml_job_comms 0 0 0

在 rejected 列中显示为 0,这是不是表示没有请求被拒绝?那这个报错是不是ES线程池用完了的问题呢?
已邀请:

Ombres

赞同来自: bigsmart kin122

通过异常能观测到,你的es才1g内存,未索引的数据不能超过 indexing_pressure.memory.limit 的最大限制,默认堆内存的10%

kin122

赞同来自: bigsmart

GET /_cat/thread_pool?v能完整展示么?没看到write线程

caster_QL

赞同来自: bigsmart

线程池满了(一般是cpu核数)会进入队列(一般是2000);
队列满了就会rejected了
可以通过命令查看thread_pool的状态,默认看到的字段较少,通过h=XX,XX指定更多字段有助于观察
 

要回复问题请先登录注册