身安不如心安,屋宽不如心宽 。

elasticsearch 安装脚本

Elasticsearchguoliang_1992 发表了文章 • 0 个评论 • 2844 次浏览 • 2017-08-05 14:40 • 来自相关话题

1:需要传入安装路径这个参数
2:默认是安装5.2.2,可以在脚本中修改
注意:
因为不能上传.sh结尾的,我把后缀名改为.doc 使用的时候再改回.sh即可
 
有不完善的地方,还望大家指正(:
 
installDir=$1
curl -L -O https://artifacts.elastic.co/d ... ar.gz

mkdir $installDir
echo "安装的位置$installDir"
tar -xvf elasticsearch-5.2.2.tar.gz -C $installDir

mv $installDir/elasticsearch-5.2.2 $installDir/elasticsearch
echo "添加es用户 esuser 组 esuser"
groupadd esuser
useradd esuser -g esuser -p esuser

echo "输入es用户密码"
passwd esuser

cd $installDir
chown -R esuser:esuser $installDir/elasticsearch
###sh +x $installDir/elasticsearch/bin/elasticsearch -Ecluster.name=my_cluster_name -Enode.name=my_node_name

function install_mvn(){
wget http://repos.fedorapeople.org/ ... .repo -O /etc/yum.repos.d/epel-apache-maven.repo
yum -y install apache-maven

}
function getik(){
ver="v5.2.2"
yum -y install git
git clone https://github.com/medcl/elasticsearch-analysis-ik
cd elasticsearch-analysis-ik
git checkout tags/$ver
mvn clean
mvn compile
mvn package
cd -

}
install_mvn
version=5.2.2
getik
mkdir $installDir/elasticsearch/plugins/ik
unzip elasticsearch-analysis-ik/target/releases/elasticsearch-analysis-ik-$version.zip -d $installDir/elasticsearch/plugins/ik

社区日报 第7期 (2017-08-05)

社区日报bsll 发表了文章 • 0 个评论 • 5200 次浏览 • 2017-08-05 08:47 • 来自相关话题

1. 23 Useful Elasticsearch Example Queries  http://t.cn/R9Sjxf5

ES作为全文检索引擎,最常用的查询都在这里了




2. All About Analyzers

Part 1: http://t.cn/R9SFtYd

Part 2: http://t.cn/R9SFxPZ

如何利用ES提供的tokenizer filter以及正则等组件定制自己的analyzer,这篇文章给出了方向。




3. Elasticsearch Security: Authentication, Encryption, and Backup http://t.cn/R9SQJlK

安全问题永远不会过时,用这篇文章检查下你的ES集群是否有安全隐患




编辑:bsll

归档:https://elasticsearch.cn/article/213

订阅:https://tinyletter.com/elastic-daily

[求助] mac, elasticsearch 5.5.1安装中文分词器后,无法正常启动

Elasticsearchguoliang_1992 回复了问题 • 4 人关注 • 2 个回复 • 3706 次浏览 • 2017-08-05 14:58 • 来自相关话题

死磕Elasticsearch交流群,和你一起,共同成长!

Elasticsearchancestor 回复了问题 • 4 人关注 • 1 个回复 • 5293 次浏览 • 2017-08-04 23:00 • 来自相关话题

logstash日期格式转换

Logstashsiufenglee 回复了问题 • 2 人关注 • 3 个回复 • 5342 次浏览 • 2017-08-07 12:41 • 来自相关话题

[求助]日志脱敏:filebeat>logstash>es>kibana

ElasticsearchLincoln 回复了问题 • 3 人关注 • 2 个回复 • 6279 次浏览 • 2018-04-27 10:35 • 来自相关话题

【阿里巴巴】【急聘】数据分析产品开发专家

求职招聘ywding 发表了文章 • 0 个评论 • 3727 次浏览 • 2017-08-04 16:12 • 来自相关话题

岗位职责(工作内容)
  • 负责数据分析产品全栈式开发;
  • 指导开发人员工作,提升团队整体的技术能力;
  • 学习研究业界前沿技术,并迅速转化为项目生产力。


任职资格、技能和经验
  • 全栈开发能力,熟悉JS/CSS/Html,Node.js等;
  • 前端开发能力优秀者优先;
  • 具有数据分析类产品设计或研发经验技术优先;
  • 注重代码质量,能高效编写优雅的代码;
  • 思路清晰,善于思考,能独立分析和解决问题,责任心强,具备良好的团队合作精神和承受压力的能力;
  • 具备广泛的技术视野和很强的技术前瞻性。

 
工作地点北京、杭州,薪资待遇优厚,欢迎各位大神!
联系方式:wending.ywd@alibaba-inc.com
岗位职责(工作内容)
  • 负责数据分析产品全栈式开发;
  • 指导开发人员工作,提升团队整体的技术能力;
  • 学习研究业界前沿技术,并迅速转化为项目生产力。


任职资格、技能和经验
  • 全栈开发能力,熟悉JS/CSS/Html,Node.js等;
  • 前端开发能力优秀者优先;
  • 具有数据分析类产品设计或研发经验技术优先;
  • 注重代码质量,能高效编写优雅的代码;
  • 思路清晰,善于思考,能独立分析和解决问题,责任心强,具备良好的团队合作精神和承受压力的能力;
  • 具备广泛的技术视野和很强的技术前瞻性。

 
工作地点北京、杭州,薪资待遇优厚,欢迎各位大神!
联系方式:wending.ywd@alibaba-inc.com

为什么es5.4用missing这个过滤报错呢,是废弃了嘛

Elasticsearchnovia 回复了问题 • 2 人关注 • 1 个回复 • 8012 次浏览 • 2017-08-04 15:41 • 来自相关话题

elasticsearch 返回基于指标计算后的指标

回复

Elasticsearchyrcumt 回复了问题 • 2 人关注 • 1 个回复 • 3054 次浏览 • 2017-08-04 22:29 • 来自相关话题

logstash-input-jdbc怎样简化配置文件

LogstashNeal.Shan 回复了问题 • 4 人关注 • 4 个回复 • 3406 次浏览 • 2017-09-19 20:13 • 来自相关话题

logstash-input-kafka 导入数据时 logstash和kafka必须在同一台机器上么

Logstashwangnan9279 回复了问题 • 3 人关注 • 3 个回复 • 6040 次浏览 • 2017-11-16 16:15 • 来自相关话题

单机环境下怎样确定ES分片数量

ElasticsearchBrickXu 回复了问题 • 7 人关注 • 4 个回复 • 8894 次浏览 • 2017-08-07 14:52 • 来自相关话题

Logstash通过output写入ES时,无法自动创建索引

Elasticsearchyangg 回复了问题 • 3 人关注 • 3 个回复 • 15263 次浏览 • 2017-08-05 03:25 • 来自相关话题

谁帮忙看下这个错误

ElasticsearchErin 回复了问题 • 4 人关注 • 4 个回复 • 22023 次浏览 • 2020-10-28 20:28 • 来自相关话题

Lucene 6 基于BKD Tree Index 的应用

Elasticsearchkeehang 发表了文章 • 0 个评论 • 5340 次浏览 • 2017-08-04 10:20 • 来自相关话题

BKD Tree 
https://www.elastic.co/blog/lucene-points-6.0
Block k-d trees are a simple yet powerful data structure. At index time, they are built by recursively partitioning the full space of N-dimensional points to be indexed into smaller and smaller rectangular cells, splitting equally along the widest ranging dimension at each step of the recursion. However, unlike an ordinary k-d tree, a block k-d tree stops recursing once there are fewer than a pre-specified (1024 in our case, by default) number of points in the cell.

At that point, all points within that cell are written into one leaf block on disk and the starting file-pointer for that block is saved into an in-heap binary tree structure. In the 1D case, this is simply a full sort of all values, divided into adjacent leaf blocks. There are k-d tree variants that can support removing values, and rebalancing, but Lucene does not need these operations because of its write-once per-segment design.
 
At search time, the same recursion takes place, testing at each level whether the requested query shape intersects the left or right sub-tree of each dimensional split, and recursing if so. In the 1D case, the query shape is simply a numeric range whereas in the 2D and 3D cases, it is a geo-spatial shape (circle, ring, rectangle, polygon, cube, etc.).
测试集合:模拟一亿条
0," nnrIuS","raet","lnsr","inu ","saia",83.405273,73.302012,3991,24,"N"," usA","airport","rra i"
1,"omlritp","aaVe","y Mu","AaVV","NMc ",15.459643,-20.826241,2627,54,"a","eemo","airport","MaArp"
2,"kyaneMr","iasm","raAA"," tnt","inls",16.606066,38.663728,2761,53,"o","arIi","airport","uiron"



1. General Multidimensional Space Points
   Search for points with exact given values. 
  Search for points which has one of the value from a given set of values. 
Search for points within a given range. 
Get the number of points which has exact point.
Get the number of points within a given range. (Ranges are multidimensional ranges. In 3D, they are boxes.)
Divide points into range-buckets and get the count in each buckets. (Range bucket is a range which has a label in it)
 
2. Locations on the planet surface. (Latitude, Longitude)
  Find closest set of airports to a given town.  
  Find the set of airports within a given radius from a particular town.
  Find the set of airports inside a country. (Country can be given as a polygon) 
  Find the set of airports within a given range of Latitudes and Longitudes. It is a Latitude, Longitude box query. (For a examples: Airports closer to the equatorial) 
  Find the set of airports closer to a given path. (Path can be something like a road. Find the airports which are less than 50km away from a given highway)
  Count the airports in each country by giving country maps as polygons.
 
search  result:
 
Loading Data is finished ----------------------------------------------------------------------
建索引花费时间:982ms
LatLon - Box Query Example------------------------------------------------------------------------------
search_LatLon_Box 花费时间:69ms

LatLon - K Nearest------------------------------------------------------------------------------
search_LatLon_Nearest 花费时间:108ms

DoublePoint 1D Point Exact------------------------------------------------------------------------------
search_Double_1D_Exact 花费时间:10ms

DoublePoint 1D - Range------------------------------------------------------------------------------
search_Double_1D_range 花费时间:8ms

DoublePoint 1D - Range Buckets -----------------------------------------------------------------------------
search_Double_1D_range_bucket 花费时间:58ms

DoublePoint multi dimensional - Range------------------------------------------------------------------------------
search_Double_MiltiDimensional_Range 花费时间:1ms