好的想法是十分钱一打,真正无价的是能够实现这些想法的人。

logstash配置out自定义模板到ES失败

Elasticsearch | 作者 a6676726 | 发布于2017年10月19日 | 阅读数:6789

架构是 filebeat-redis-logstash-es 做日志的特殊字段 分词处理 logstash out 定义自定义模板
output {
elasticsearch {
hosts=> "*:9200"
index => "logstash-%{type}-%{+YYYY.MM.dd}"
template_overwrite => true
document_type => "%{type}"
manage_template => "true"
template => "/data/config/nginx.json"
template_name =>"nginx.json"

logstash 日志
[2017-10-19T10:05:16,666][INFO ][logstash.outputs.elasticsearch] Attempting to install template {:manage_template=>{"logstash-*-access"=>{"mappings"=>{"*-access"=>{"_all"=>{"enabled"=>true, "norms"=>false}, "dynamic_templates"=>[{"message_field"=>{"match"=>"message", "match_mapping_type"=>"text", "mapping"=>{"fielddata"=>{"format"=>"disabled"}, "index"=>"analyzed", "omit_norms"=>true, "type"=>"text"}}}, {"text_fields"=>{"match"=>"*", "match_mapping_type"=>"text", "mapping"=>{"fielddata"=>{"format"=>"disabled"}, "fields"=>{"keyword"=>{"ignore_above"=>256, "index"=>"not_analyzed", "type"=>"text"}}, "index"=>"analyzed", "omit_norms"=>true, "type"=>"text"}}}], "properties"=>{"@timestamp"=>{"type"=>"date"}, "@version"=>{"type"=>"keyword", "index"=>"not_analyzed"}, "type"=>{"type"=>"keyword", "index"=>"not_analyzed"}, "timestamp"=>{"type"=>"date"}, "domain"=>{"type"=>"keyword", "index"=>"not_analyzed"}, "host"=>{"type"=>"keyword", "index"=>"not_analyzed"}, "sessionId"=>{"type"=>"keyword", "index"=>"not_analyzed"}, "userId"=>{"type"=>"keyword", "index"=>"not_analyzed"}, "visitorId"=>{"type"=>"keyword", "index"=>"not_analyzed"}, "yssessionId"=>{"type"=>"keyword", "index"=>"not_analyzed"}, "agent"=>{"type"=>"text", "norms"=>false, "fields"=>{"keyword"=>{"type"=>"keyword", "index"=>"not_analyzed", "ignore_above"=>256}}}, "path"=>{"type"=>"text", "norms"=>false, "fields"=>{"keyword"=>{"type"=>"keyword", "ignore_above"=>256}}}, "referer"=>{"type"=>"text", "norms"=>false, "fields"=>{"keyword"=>{"type"=>"keyword", "ignore_above"=>256}}}, "request"=>{"type"=>"text", "norms"=>false, "fields"=>{"keyword"=>{"type"=>"keyword", "ignore_above"=>256}}}, "requestBody"=>{"type"=>"text", "norms"=>false, "fields"=>{"keyword"=>{"type"=>"keyword", "ignore_above"=>256}}}, "upstreamHost"=>{"type"=>"text", "norms"=>false, "fields"=>{"keyword"=>{"type"=>"keyword", "ignore_above"=>256}}}, "url"=>{"type"=>"text", "norms"=>false, "fields"=>{"keyword"=>{"type"=>"keyword", "ignore_above"=>256}}}, "size"=>{"type"=>"long"}, "status"=>{"type"=>"long"}, "requestTime"=>{"type"=>"long"}, "responseTime"=>{"type"=>"long"}, "clientIp"=>{"type"=>"keyword", "index"=>"not_analyzed"}}}, "_default_"=>{"_all"=>{"enabled"=>true, "norms"=>false}, "dynamic_templates"=>[{"message_field"=>{"match"=>"message", "match_mapping_type"=>"text", "mapping"=>{"fielddata"=>{"format"=>"disabled"}, "index"=>"analyzed", "omit_norms"=>true, "type"=>"text"}}}, {"text_fields"=>{"match"=>"*", "match_mapping_type"=>"text", "mapping"=>{"fielddata"=>{"format"=>"disabled"}, "fields"=>{"keyword"=>{"ignore_above"=>256, "index"=>"not_analyzed", "type"=>"text"}}, "index"=>"analyzed", "omit_norms"=>true, "type"=>"text"}}}], "properties"=>{"@timestamp"=>{"type"=>"date"}, "@version"=>{"type"=>"keyword"}, "geoip"=>{"dynamic"=>"true", "properties"=>{"ip"=>{"type"=>"ip"}, "latitude"=>{"type"=>"float"}, "location"=>{"type"=>"geo_point"}, "longitude"=>{"type"=>"float"}}}}}}}}}
[2017-10-19T10:05:16,681][INFO ][logstash.outputs.elasticsearch] Installing elasticsearch template to _template/logstash
[2017-10-19T10:05:16,721][ERROR][logstash.outputs.elasticsearch] Failed to install template. {:message=>"Got response code '400' contact Elasticsearch at URL 'http://*:9200/_template/logstash'", :class=>"LogStash::Outputs::ElasticSearch::HttpClient::Pool::BadResponseCodeError"}


curl 查错误的ES _template/模板 404 如果不指定模板名称 有一台正常的ES curl到的是 order 1的自定义模板 错误的ES curl的都是系统默认的模板 求大神指导。。
已邀请:

medcl - 今晚打老虎。

赞同来自:

es 的配置为什么是:hosts=> "*:9200"

要回复问题请先登录注册