elasticsearch GC问题

目前有es集群（总共7台机器），其中1台es client节点，其余6台都是es data节点，目前程序直接连接client节点，目前遇到的问题是，client节点过一段时间就会报GC问题，以下是日志详情，目前状态是client节点一直打印下边日志，没有其它报错信息，不知道该如何排查这种问题，烦请大老门指点。。。。。。。
 
---------

[2023-03-15T15:25:57,842][INFO ][o.e.m.j.JvmGcMonitorService] [vm-30] [gc][11072] overhead, spent [417ms] collecting in the last [1s]
[2023-03-15T15:25:58,843][INFO ][o.e.m.j.JvmGcMonitorService] [vm-30] [gc][11073] overhead, spent [430ms] collecting in the last [1s]
[2023-03-15T15:25:59,844][INFO ][o.e.m.j.JvmGcMonitorService] [vm-30] [gc][11074] overhead, spent [438ms] collecting in the last [1s]
[2023-03-15T15:26:00,915][INFO ][o.e.m.j.JvmGcMonitorService] [vm-30] [gc][11075] overhead, spent [500ms] collecting in the last [1s]
[2023-03-15T15:26:02,063][INFO ][o.e.m.j.JvmGcMonitorService] [vm-30] [gc][11076] overhead, spent [555ms] collecting in the last [1.1s]
[2023-03-15T15:26:03,064][INFO ][o.e.m.j.JvmGcMonitorService] [vm-30] [gc][11077] overhead, spent [357ms] collecting in the last [1s]
[2023-03-15T15:26:04,083][WARN ][o.e.m.j.JvmGcMonitorService] [vm-30] [gc][11078] overhead, spent [712ms] collecting in the last [1s]
[2023-03-15T15:26:05,193][WARN ][o.e.m.j.JvmGcMonitorService] [vm-30] [gc][11079] overhead, spent [723ms] collecting in the last [1.1s]
[2023-03-15T15:26:06,194][WARN ][o.e.m.j.JvmGcMonitorService] [vm-30] [gc][11080] overhead, spent [594ms] collecting in the last [1s]
[2023-03-15T15:26:07,350][WARN ][o.e.m.j.JvmGcMonitorService] [vm-30] [gc][11081] overhead, spent [809ms] collecting in the last [1.1s]
[2023-03-15T15:26:08,650][WARN ][o.e.m.j.JvmGcMonitorService] [vm-30] [gc][11082] overhead, spent [906ms] collecting in the last [1.2s]
[2023-03-15T15:26:09,698][WARN ][o.e.m.j.JvmGcMonitorService] [vm-30] [gc][11083] overhead, spent [650ms] collecting in the last [1s]
[2023-03-15T15:26:13,947][INFO ][o.e.m.j.JvmGcMonitorService] [vm-30] [gc][11087] overhead, spent [543ms] collecting in the last [1.2s]
[2023-03-15T15:26:15,029][INFO ][o.e.m.j.JvmGcMonitorService] [vm-30] [gc][11088] overhead, spent [427ms] collecting in the last [1s]
[2023-03-15T15:26:16,157][INFO ][o.e.m.j.JvmGcMonitorService] [vm-30] [gc][11089] overhead, spent [485ms] collecting in the last [1.1s]
[2023-03-15T15:26:17,308][INFO ][o.e.m.j.JvmGcMonitorService] [vm-30] [gc][11090] overhead, spent [547ms] collecting in the last [1.1s]
[2023-03-15T15:26:18,308][INFO ][o.e.m.j.JvmGcMonitorService] [vm-30] [gc][11091] overhead, spent [308ms] collecting in the last [1s]
[2023-03-15T15:26:19,309][WARN ][o.e.m.j.JvmGcMonitorService] [vm-30] [gc][11092] overhead, spent [647ms] collecting in the last [1s]
[2023-03-15T15:26:20,309][WARN ][o.e.m.j.JvmGcMonitorService] [vm-30] [gc][11093] overhead, spent [692ms] collecting in the last [1s]
[2023-03-15T15:26:21,310][WARN ][o.e.m.j.JvmGcMonitorService] [vm-30] [gc][11094] overhead, spent [712ms] collecting in the last [1s]
[2023-03-15T15:26:22,753][WARN ][o.e.m.j.JvmGcMonitorService] [vm-30] [gc][11095] overhead, spent [1s] collecting in the last [1.4s]
[2023-03-15T15:26:23,753][WARN ][o.e.m.j.JvmGcMonitorService] [vm-30] [gc][11096] overhead, spent [696ms] collecting in the last [1s]
[2023-03-15T15:26:24,893][WARN ][o.e.m.j.JvmGcMonitorService] [vm-30] [gc][11097] overhead, spent [831ms] collecting in the last [1.1s]
[2023-03-15T15:26:26,032][WARN ][o.e.m.j.JvmGcMonitorService] [vm-30] [gc][11098] overhead, spent [628ms] collecting in the last [1.1s]
[2023-03-15T15:26:27,160][WARN ][o.e.m.j.JvmGcMonitorService] [vm-30] [gc][11099] overhead, spent [778ms] collecting in the last [1.1s]
[2023-03-15T15:26:29,230][WARN ][o.e.m.j.JvmGcMonitorService] [vm-30] [gc][11101] overhead, spent [542ms] collecting in the last [1s]
[2023-03-15T15:26:30,230][INFO ][o.e.m.j.JvmGcMonitorService] [vm-30] [gc][11102] overhead, spent [300ms] collecting in the last [1s]
[2023-03-15T15:26:31,424][WARN ][o.e.m.j.JvmGcMonitorService] [vm-30] [gc][11103] overhead, spent [613ms] collecting in the last [1.1s]
[2023-03-15T15:26:33,425][WARN ][o.e.m.j.JvmGcMonitorService] [vm-30] [gc][11105] overhead, spent [587ms] collecting in the last [1s]
[2023-03-15T15:26:34,722][WARN ][o.e.m.j.JvmGcMonitorService] [vm-30] [gc][11106] overhead, spent [701ms] collecting in the last [1.2s]
[2023-03-15T15:26:35,898][WARN ][o.e.m.j.JvmGcMonitorService] [vm-30] [gc][11107] overhead, spent [781ms] collecting in the last [1.1s]
[2023-03-15T15:26:37,019][WARN ][o.e.m.j.JvmGcMonitorService] [vm-30] [gc][11108] overhead, spent [722ms] collecting in the last [1.1s]
[2023-03-15T15:26:38,168][WARN ][o.e.m.j.JvmGcMonitorService] [vm-30] [gc][11109] overhead, spent [752ms] collecting in the last [1.1s]
[2023-03-15T15:26:39,426][WARN ][o.e.m.j.JvmGcMonitorService] [vm-30] [gc][11110] overhead, spent [860ms] collecting in the last [1.2s]
[2023-03-15T15:26:40,485][WARN ][o.e.m.j.JvmGcMonitorService] [vm-30] [gc][11111] overhead, spent [662ms] collecting in the last [1s]
[2023-03-15T15:26:41,485][INFO ][o.e.m.j.JvmGcMonitorService] [vm-30] [gc][11112] overhead, spent [278ms] collecting in the last [1s]
[2023-03-15T15:26:44,623][INFO ][o.e.m.j.JvmGcMonitorService] [vm-30] [gc][11115] overhead, spent [499ms] collecting in the last [1.1s]
[2023-03-15T15:26:45,883][WARN ][o.e.m.j.JvmGcMonitorService] [vm-30] [gc][11116] overhead, spent [798ms] collecting in the last [1.2s]
[2023-03-15T15:26:46,884][WARN ][o.e.m.j.JvmGcMonitorService] [vm-30] [gc][11117] overhead, spent [555ms] collecting in the last [1s]
[2023-03-15T15:26:48,191][WARN ][o.e.m.j.JvmGcMonitorService] [vm-30] [gc][11118] overhead, spent [571ms] collecting in the last [1s]
[2023-03-15T15:26:49,192][WARN ][o.e.m.j.JvmGcMonitorService] [vm-30] [gc][11119] overhead, spent [849ms] collecting in the last [1.3s]
[2023-03-15T15:26:50,346][WARN ][o.e.m.j.JvmGcMonitorService] [vm-30] [gc][11120] overhead, spent [792ms] collecting in the last [1.1s]
[2023-03-15T15:26:51,346][WARN ][o.e.m.j.JvmGcMonitorService] [vm-30] [gc][11121] overhead, spent [611ms] collecting in the last [1s]
[2023-03-15T15:26:52,507][WARN ][o.e.m.j.JvmGcMonitorService] [vm-30] [gc][11122] overhead, spent [886ms] collecting in the last [1.1s]
[2023-03-15T15:26:53,508][WARN ][o.e.m.j.JvmGcMonitorService] [vm-30] [gc][11123] overhead, spent [529ms] collecting in the last [1s]
[2023-03-15T15:27:39,090][WARN ][o.e.m.j.JvmGcMonitorService] [vm-30] [gc][old][11124][3] duration [45.1s], collections [1]/[45.5s], total [45.1s]/[45.6s], memory [17.5gb]->[11.2gb]/[17.9gb], all_pools {[youn
g] [328.9mb]->[5.5mb]/[532.5mb]}{[survivor] [66.4mb]->[0b]/[66.5mb]}{[old] [17.1gb]->[11.2gb]/[17.3gb]}
[2023-03-15T15:27:39,090][WARN ][o.e.m.j.JvmGcMonitorService] [vm-30] [gc][11124] overhead, spent [45.4s] collecting in the last [45.5s]
[2023-03-15T15:27:40,358][WARN ][o.e.m.j.JvmGcMonitorService] [vm-30] [gc][11125] overhead, spent [739ms] collecting in the last [1.2s]
[2023-03-15T15:27:41,359][INFO ][o.e.m.j.JvmGcMonitorService] [vm-30] [gc][11126] overhead, spent [479ms] collecting in the last [1s]
[2023-03-15T15:27:42,486][WARN ][o.e.m.j.JvmGcMonitorService] [vm-30] [gc][11127] overhead, spent [737ms] collecting in the last [1.1s]
[2023-03-15T15:27:43,611][WARN ][o.e.m.j.JvmGcMonitorService] [vm-30] [gc][11128] overhead, spent [728ms] collecting in the last [1.1s]
[2023-03-15T15:27:44,611][WARN ][o.e.m.j.JvmGcMonitorService] [vm-30] [gc][11129] overhead, spent [738ms] collecting in the last [1s]
[2023-03-15T15:27:45,628][WARN ][o.e.m.j.JvmGcMonitorService] [vm-30] [gc][11130] overhead, spent [722ms] collecting in the last [1s]
[2023-03-15T15:27:46,883][WARN ][o.e.m.j.JvmGcMonitorService] [vm-30] [gc][11131] overhead, spent [791ms] collecting in the last [1.2s]
[2023-03-15T15:27:48,135][WARN ][o.e.m.j.JvmGcMonitorService] [vm-30] [gc][11132] overhead, spent [793ms] collecting in the last [1.2s]
[2023-03-15T15:27:49,332][WARN ][o.e.m.j.JvmGcMonitorService] [vm-30] [gc][11133] overhead, spent [795ms] collecting in the last [1.1s]
[2023-03-15T15:27:50,333][INFO ][o.e.m.j.JvmGcMonitorService] [vm-30] [gc][11134] overhead, spent [252ms] collecting in the last [1s]
[2023-03-15T15:27:52,830][WARN ][o.e.t.TransportService ] [vm-30] Received response for a request that has timed out, sent [67780ms] ago, timed out [13737ms] ago, action [internal:discovery/zen/fd/master_pi
ng], node [{vm-38}{OggZrZ37Q8OHnR3UJZJxfg}{Z_rGWgGgThOKgnvSbVzFHA}{172.16.0.38}{172.16.0.38:9300}{rack=vm-38}], id [597622]
[2023-03-15T15:27:54,482][WARN ][o.e.m.j.JvmGcMonitorService] [vm-30] [gc][11138] overhead, spent [761ms] collecting in the last [1.1s]
[2023-03-15T15:27:55,687][WARN ][o.e.m.j.JvmGcMonitorService] [vm-30] [gc][11139] overhead, spent [836ms] collecting in the last [1.2s]
[2023-03-15T15:27:56,939][WARN ][o.e.m.j.JvmGcMonitorService] [vm-30] [gc][11140] overhead, spent [875ms] collecting in the last [1.2s]
[2023-03-15T15:29:06,876][WARN ][o.e.m.j.JvmGcMonitorService] [vm-30] [gc][old][11141][4] duration [1.1m], collections [1]/[1.1m], total [1.1m]/[1.9m], memory [17gb]->[14.7gb]/[17.9gb], all_pools {[young] [3.
9mb]->[58.5mb]/[532.5mb]}{[survivor] [66.4mb]->[0b]/[66.5mb]}{[old] [16.9gb]->[14.6gb]/[17.3gb]}
[2023-03-15T15:29:06,876][WARN ][o.e.m.j.JvmGcMonitorService] [vm-30] [gc][11141] overhead, spent [1.1m] collecting in the last [1.1m]
[2023-03-15T15:29:08,163][WARN ][o.e.m.j.JvmGcMonitorService] [vm-30] [gc][11142] overhead, spent [850ms] collecting in the last [1.2s]
[2023-03-15T15:29:09,163][WARN ][o.e.m.j.JvmGcMonitorService] [vm-30] [gc][11143] overhead, spent [587ms] collecting in the last [1s]
[2023-03-15T15:29:10,434][WARN ][o.e.m.j.JvmGcMonitorService] [vm-30] [gc][11144] overhead, spent [982ms] collecting in the last [1.2s]
[2023-03-15T15:29:11,696][WARN ][o.e.m.j.JvmGcMonitorService] [vm-30] [gc][11145] overhead, spent [837ms] collecting in the last [1.2s]
[2023-03-15T15:29:13,016][WARN ][o.e.m.j.JvmGcMonitorService] [vm-30] [gc][11146] overhead, spent [893ms] collecting in the last [1.3s]
[2023-03-15T15:30:25,467][WARN ][o.e.m.j.JvmGcMonitorService] [vm-30] [gc][old][11147][5] duration [1.2m], collections [1]/[1.2m], total [1.2m]/[3.1m], memory [17.2gb]->[17.1gb]/[17.9gb], all_pools {[young] [
3.2mb]->[11.3mb]/[532.5mb]}{[survivor] [66.4mb]->[0b]/[66.5mb]}{[old] [17.1gb]->[17.1gb]/[17.3gb]}