身安不如心安,屋宽不如心宽 。

elasticsearch-jdbc导入数据时,日志中大量的出现这样的记录。

Elasticsearch | 作者 linfree | 发布于2017年01月11日 | 阅读数:16021

最后,导入的数据总量比mysql用count(*)查的少了很多,请问是什么原因呢?
[9997]: index [data], type [com1], id [AVmMEA7tDbeS2tx38Qcc], message [RemoteTransportException[[Professor Power][127.0.0.1:9300][indices:data/write/bulk[s][p]]]; nested: EsRejectedExecutionException[rejected execution of org.elasticsearch.transport.TransportService$4@411e3301 on EsThreadPoolExecutor[bulk, queue capacity = 50, org.elasticsearch.common.util.concurrent.EsThreadPoolExecutor@5e719f47[Running, pool size = 24, active threads = 24, queued tasks = 50, completed tasks = 52930]]];]
[9998]: index [data], type [com1], id [AVmMEA7tDbeS2tx38Qcd], message [RemoteTransportException[[Professor Power][127.0.0.1:9300][indices:data/write/bulk[s][p]]]; nested: EsRejectedExecutionException[rejected execution of org.elasticsearch.transport.TransportService$4@4107be18 on EsThreadPoolExecutor[bulk, queue capacity = 50, org.elasticsearch.common.util.concurrent.EsThreadPoolExecutor@5e719f47[Running, pool size = 24, active threads = 24, queued tasks = 50, completed tasks = 52930]]];]
[9999]: index [data], type [com1], id [AVmMEA7tDbeS2tx38Qce], message [RemoteTransportException[[Professor Power][127.0.0.1:9300][indices:data/write/bulk[s][p]]]; nested: EsRejectedExecutionException[rejected execution of org.elasticsearch.transport.TransportService$4@71311b02 on EsThreadPoolExecutor[bulk, queue capacity = 50, org.elasticsearch.common.util.concurrent.EsThreadPoolExecutor@5e719f47[Running, pool size = 24, active threads = 24, queued tasks = 50, completed tasks = 52930]]];]

PDSND`~4T451}T}G668)HCF.png
已邀请:

kennywu76 - Wood

赞同来自: linfree

说明ES索引数据的速度已经跟不上client端发送bulk请求的速度,请求队列已满以致开始拒绝新的请求。 这是ES集群的自我保护机制,client端应该处理这种异常,可以适当sleep一段时间重试。

JennyJoker - 90后IT菜鸟

赞同来自:

楼主,你的mysql数据导入进去了吗? 我的在报索引找不到"error" : {
    "root_cause" : [ {
      "type" : "index_not_found_exception",
      "reason" : "no such index",
      "resource.type" : "index_or_alias",
      "resource.id" : "gotdemo",
      "index" : "gotdemo"
    } ],
    "type" : "index_not_found_exception",
    "reason" : "no such index",
    "resource.type" : "index_or_alias",
    "resource.id" : "gotdemo",
    "index" : "gotdemo"
  },
  "status" : 404

DIOUGENS

赞同来自:

请问一下楼主es-jdbc的这个默认值是在哪修改的

要回复问题请先登录注册