身安不如心安,屋宽不如心宽 。

社区日报 第99期 (2017-11-13)

社区日报cyberdak 发表了文章 • 1 个评论 • 2606 次浏览 • 2017-11-13 09:20 • 来自相关话题

1、使用于商业智能的复杂模型建模教程
http://t.cn/Rj2uLh9
2、logstash配置文件的vscode插件,从其编辑配置文件不再发愁。
http://t.cn/Rj21ncE
3、elk告警插件sentinl。随着版本的更新,目前已经可以媲美x-pack的reporter以及watcher。
http://t.cn/Rj216Ef
4、只等你来 | Elastic Meetup 广州交流会
https://elasticsearch.cn/article/364 

编辑:cyberdak
归档:https://elasticsearch.cn/article/372
订阅:https://tinyletter.com/elastic-daily

spring-boot 和elasticsearch整合数据存放目录

回复

Elasticsearchxisonchen 发起了问题 • 1 人关注 • 0 个回复 • 3443 次浏览 • 2017-11-12 18:29 • 来自相关话题

为什么有了es还有好多企业自研搜索引擎

ElasticsearchJiaShiwen 回复了问题 • 6 人关注 • 4 个回复 • 9425 次浏览 • 2017-11-15 12:29 • 来自相关话题

社区日报 第98期 (2017-11-12)

社区日报至尊宝 发表了文章 • 0 个评论 • 2399 次浏览 • 2017-11-12 16:06 • 来自相关话题

1. (自备梯子)推荐三个数据库相关(MySQL,MongoDB,Elasticsearch)的课程。
http://t.cn/RjPvlq1
2. 将 ELASTICSEARCH 写入速度优化到极限
http://t.cn/RWs8yvS
3. 零点之战!探访阿里巴巴8大技术专家,提前揭秘2017双11关键技术。
http://t.cn/RjPPzGc
4. 只等你来 | Elastic Meetup 广州交流会
https://elasticsearch.cn/article/364

编辑:至尊宝
归档:https://elasticsearch.cn/article/371
订阅:https://tinyletter.com/elastic-daily

es scroll 每次返回多少数据量合适啊?

Elasticsearchbjfk2006 回复了问题 • 4 人关注 • 2 个回复 • 4528 次浏览 • 2017-11-14 17:05 • 来自相关话题

三步上手 esrally 完成 elasticsearch 压测任务

Elasticsearchrockybean 发表了文章 • 2 个评论 • 5164 次浏览 • 2017-11-12 11:31 • 来自相关话题

[原文链接](https://segmentfault.com/a/1190000011966008)

距离上一篇 [esrally 教程](https://segmentfault.com/a/1190000011174694)过去快2个月了,这期间不停有同学来询问使用中遇到的问题,尤其由于其测试数据存储在国外 aws 上,导致下载极慢。为了让大家快速上手使用 esrally,我 build 了一个可用的 docker 镜像,然后将 13GB 的测试数据拉取到国内的存储上,通过百度网盘的方式分享给大家。大家只要按照下面简单的几步操作就可以顺畅地使用 esrally 来进行相关测试了。

操作步骤


废话不多说,先上菜!

  1. 拉取镜像
    `<br /> docker pull rockybean/esrally<br />
  2. 下载数据文件 链接:http://pan.baidu.com/s/1eSrjZgA 密码:aagl
  3. 进入下载后的文件夹 rally_track,执行如下命令开始测试
    <br /> docker run -it -v $(PWD):/root/track rockybean/esrally esrally race --track-path=/root/track/logging --offline --pipeline=benchmark-only --target-hosts=192.168.1.105:9200<br />

    打完收工!

    几点说明


    数据文件介绍

    esrally 自带的测试数据即为 rally_track 文件夹中的内容,主要包括:

    • Geonames(geonames): for evaluating the performance of structured data.
    • Geopoint(geopoint): for evaluating the performance of geo queries.
    • Percolator(percolator): for evaluating the performance of percolation queries.
    • PMC(pmc): for evaluating the performance of full text search.
    • NYC taxis(nyc_taxis): for evaluating the performance for highly structured data.
    • Nested(nested): for evaluating the performance for nested documents.
    • Logging(logging): for evaluating the performance of (Web) server logs.
    • noaa(noaa): for evaluating the performance of range fields.

      可以根据自己的需要下载对应的测试数据,不必下载全部,保证对应文件夹下载完全即可。


      命令解释


      docker 相关

      docker run -it rockybean/esrally esrally 为执行的 esrally 命令,-v $(PWD):/root/track是将 rally_docker 文件夹映射到 docker 容器中,$(PWD)是获取当前目录的意思,所以在此前要 cd 到 rally_docker 目录,当然你写全路径也是没有问题的。

      esrally 的 docker 镜像比较简单,可以参看 [ github 项目介绍][1]。

      esrally 相关

      该镜像是通过自定义 track 的方式来加载数据,所以命令行中用到 --track=/root/track/logging 的命令行参数。注意这里的 /root/track 即上面我们绑定到容器的目录,更换 logging 为其他的数据集名称即可加载其他的测试数据。

      该容器只支持测试第三方 es 集群,即 --pipeline=benchmark-only 模式。这应该也是最常见的压测需求了。


      愉快地去玩耍吧!




      [1]: https://github.com/rockybean/esrally-docker

Transport Client 不轮询

回复

Elasticsearchredhat 发起了问题 • 2 人关注 • 0 个回复 • 2359 次浏览 • 2017-11-12 10:41 • 来自相关话题

带有时间的文件输入到logstash

Logstashxiaoke 回复了问题 • 2 人关注 • 2 个回复 • 2893 次浏览 • 2017-11-13 17:47 • 来自相关话题

segment段文件非常大会有什么问题没?比如说100G一个?

ElasticsearchElastIcPG 回复了问题 • 8 人关注 • 3 个回复 • 4805 次浏览 • 2017-11-14 17:51 • 来自相关话题

kibana的统计查询太慢了。如何定位问题所在

Elasticsearchrockybean 回复了问题 • 2 人关注 • 1 个回复 • 11596 次浏览 • 2017-11-11 17:38 • 来自相关话题

sense不能用了改用kibana吧

ElasticsearchJiaShiwen 发表了文章 • 0 个评论 • 5683 次浏览 • 2017-11-11 12:34 • 来自相关话题

elasticsearch的dsl开发工具sense被google下架了,kibana console是很好的替代品。但是,我们的es集群前些日子因为应付安全检查改为https+basic auth方式(详细配置过程见本人博文:http://blog.csdn.net/jiashiwen ... 14374),kibana需要进行若干配置才能工作。另外老系统中还有elasticsearch2.3.3遗留,需要kibana4.5.1+sense。




一、elasticsearch5.5.2+kibana5.5.2

1.下载与elasticsearch版本号一致的kibana安装包,笔者目前开发环境5.5.2,对应kibana版本也为5.5.2(最新的5.6版本会报不兼容错误,不能运行)。




2.配置config/kibana.yml文件,主要配置项如下 
# The URL of the Elasticsearch instance to use for all your queries.
#elasticsearch.url: "http://localhost:9200&quot;
elasticsearch.url: "https://192.168.1.1:9281/&quot;


# If your Elasticsearch is protected with basic authentication, these settings provide
# the username and password that the Kibana server uses to perform maintenance on the Kibana
# index at startup. Your Kibana users still need to authenticate with Elasticsearch, which
# is proxied through the Kibana server.
#elasticsearch.username: "user"
#elasticsearch.password: "pass"
elasticsearch.username: "admin"
elasticsearch.password: "admin"


# Optional settings that provide the paths to the PEM-format SSL certificate and key files.
# These files validate that your Elasticsearch backend uses the same key files.
#elasticsearch.ssl.certificate: /path/to/your/client.crt
#elasticsearch.ssl.key: /path/to/your/client.key
elasticsearch.ssl.certificate: /home/develop/kibana-5.6.3-linux-x86_64/config/crts/eshttp.crt
elasticsearch.ssl.key: /home/develop/kibana-5.6.3-linux-x86_64/config/crts/eshttp.key


# To disregard the validity of SSL certificates, change this setting's value to 'none'.
#elasticsearch.ssl.verificationMode: full
elasticsearch.ssl.verificationMode: none各项配置看文件内说明,写的很清楚,这里就不翻译了,其中最重要的是这两样elasticsearch.ssl.certificate和elasticsearch.ssl.key,一定要与服务端保持一致。由于证书是自己生成的,校验项elasticsearch.ssl.verificationMode的值需要改为none。




启动kibana后,通过http://localhose:5601访问即可

社区日报 第97期 (2017-11-11)

社区日报bsll 发表了文章 • 0 个评论 • 2276 次浏览 • 2017-11-11 09:37 • 来自相关话题

  1. sense为什么不能用了,看看ES官方怎么说?
    http://t.cn/RlB3B62

  2. 使用allocation API快速定位分片分配问题
    http://t.cn/RlrzTsD

  3. ES6.0有关防止硬盘被填满的改进
    http://t.cn/RlrU3Nr

  4. 喜大普奔,ES社区支持Markdown编辑器了
    https://elasticsearch.cn/article/366

  5. Elastic 收购网站搜索 SaaS 服务领导者 Swiftype
    http://t.cn/Rl3a4P2

  6. 只等你来 | Elastic Meetup 广州交流会
    https://elasticsearch.cn/article/364

Elastic 招聘技术支持工程师,坐标北京

求职招聘medcl 发表了文章 • 6 个评论 • 5795 次浏览 • 2017-11-10 23:16 • 来自相关话题

DG5LrOuXUAEgq4Q.jpg




[立即申请](https://www.elastic.co/about/c ... 923231)

Support Engineer - Mandarin Speaking


Location: Beijing, China


Department: Support


Responsibilities

  • Ensuring customer issues are resolved within our committed service level agreements.
  • Maintain strong relationships with our customers for the delivery of support.
  • Have a mindset of continuous improvement, in terms of efficiency of support processes and customer satisfaction.

    Experience

  • Demonstrable experience in of support in technology businesses
  • Experience working across multi-cultural and geographically distributed teams

    Key Skills


  • Strong verbal and written communication skills in both Mandarin and English.
  • Customer orientated focus.
  • Team player, ability to work in a fast pace environment with a positive and adaptable approach.
  • Knowledge of databases or search technologies a plus.
  • Demonstrated strong technical understanding of software products.

    Additional Information


  • Competitive pay and benefits
  • Stock options
  • Catered lunches, snacks, and beverages in most offices
  • An environment in which you can balance great work with a great life
  • Passionate people building great products
  • Employees with a wide variety of interests
  • Distributed-first company with employees in over 30 countries, spread across 18 time zones, and speaking over 30 languages!

    [立即申请](https://www.elastic.co/about/c ... 923231)

    Elastic is an Equal Employment employer committed to the principles of equal employment opportunity and affirmative action for all applicants and employees. Qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender perception or identity, national origin, age, marital status, protected veteran status, or disability status or any other basis protected by federal, state or local law, ordinance or regulation. Elastic also makes reasonable accommodations for disabled employees consistent with applicable law.

    About Elastic

    Elastic is the world's leading software provider for making structured and unstructured data usable in real time for search, logging, security, and analytics use cases. Founded in 2012 by the people behind the Elasticsearch, Kibana, Beats, and Logstash open source projects, Elastic's global community has more than 80,000 members across 45 countries, and since its initial release. Elastic's products have achieved more than 100 million cumulative downloads. Today thousands of organizations, including Cisco, eBay, Dell, Goldman Sachs, Groupon, HP, Microsoft, Netflix, The New York Times, Uber, Verizon, Yelp, and Wikipedia, use the Elastic Stack, X-Pack, and Elastic Cloud to power mission-critical systems that drive new revenue opportunities and massive cost savings. Elastic is backed by more than $104 million in funding from Benchmark Capital, Index Ventures, and NEA; has headquarters in Amsterdam, the Netherlands, and Mountain View, California; and has over 500 employees in more than 30 countries around the world.

    Our Philosophy


    We’re always on the search for amazing people, people who have deep passion for technology and are masters at their craft. We build highly sophisticated distributed systems and we don’t take our technology lightly. In Elasticsearch, you’ll have the opportunity to work in a vibrant young company next to some of the smartest and highly skilled technologists the industry has to offer. We’re looking for great team players, yet we also promote independence and ownership. We’re hackers… but of the good kind. The kind that innovates and creates cutting edge products that eventually translates to a lot of happy, smiling faces.

    LifeAtElastic



    DEFMWTGV0AAOxBT.jpg



    DFml2iQXcAAI4Dk.jpg



    DFR1IpGVoAAyYfH.jpg



    DHciIhpUMAAwk7W.jpg



    DI-WzDWXoAAx8Z0.jpg



    DKSTN1SVAAAoVgd.jpg



    DJtbgW6UEAAmKu_.jpg



    DIpqETTXoAAktBP.jpg



    DKv1Gu1UMAAwJal.jpg




    [有兴趣加入我们么?点击申请](https://www.elastic.co/about/c ... 923231)

elasticsearch5.6比5.2版本区别

回复

Elasticsearches_shengbin 发起了问题 • 1 人关注 • 0 个回复 • 3571 次浏览 • 2017-11-10 18:20 • 来自相关话题

es memory lock的问题

回复

Elasticsearchbenhairui 发起了问题 • 2 人关注 • 0 个回复 • 5142 次浏览 • 2017-11-10 17:58 • 来自相关话题