Elasticsearch 5.3 搭建过程

刺骨的言语ヽ痛彻心扉 2022-01-14 20:29 204阅读 0赞

[2019独角兽企业重金招聘Python工程师标准>>> ][2019_Python_] ![hot3.png][]

[笔者百度云下载地址][Link 1] [官方下载地址][Link 2]

*  [大规模Elasticsearch集群管理心得][Elasticsearch]
 *  [Elasticsearch 5 入坑指南][Elasticsearch 5]
 *  [ES内存那点事][ES]
 *  [谈谈ES的Recovery][ES_Recovery]
 *  [集群部署插件][Link 3]
 *  [cookbook-elasticsearch][]

[Elasticsearch配置项2][Elasticsearch_2] [Elasticsearch配置项1][Elasticsearch_1]

计划在6个节点上部署ES。 节点host分别是master,worker1,worker2,worker3,worker4,worker5 IP依次是169.254.7.160~165

在6个节点上执行如下命令

useradd es # 创建 用户es，启动需要用到
    
    # 在 /etc/security/limits.conf 文件最后新增 如下信息
    
    # 配合es 启用 memory_lock ，需修改 /etc/security/limits.conf
    # https://www.elastic.co/guide/en/elasticsearch/reference/current/setup-configuration-memory.html
    es soft memlock unlimited
    es hard memlock unlimited
    
    # 最大文件打开数
    # https://www.elastic.co/guide/en/elasticsearch/reference/current/file-descriptors.html
    es soft nofile 65536
    es hard nofile 65536
    
    # 最大线程数
    # https://www.elastic.co/guide/en/elasticsearch/reference/current/_maximum_number_of_threads_check.html
    es soft nproc 2048 
    es hard nproc 2048 
    
    # Maximum size virtual memory check （mmap）
    # https://www.elastic.co/guide/en/elasticsearch/reference/current/max-size-virtual-memory-check.html
    es soft as unlimited
    es hard as unlimited
    
    # /etc/security/limits.conf 修改完成
    
    # 修改 /etc/sysctl.conf
    vm.max_map_count=262144
    
    # /etc/sysctl.conf 修改成功

在master中执行

# 修改 mmap counts
    # https://www.elastic.co/guide/en/elasticsearch/reference/current/vm-max-map-count.html
    sysctl -w vm.max_map_count=262144
    
    tar -zxvf elasticsearch-5.3.0.tar.gz -C /usr/local # 解压至 /usr/local
    
    cd /usr/local # 进入安装目录
    ln -s elasticsearch-5.3.0 elasticsearch # 创建软连
    
    # 将ES_HOME 加入环境变量并生效。
    
    # 修改配置文件
    vi $ES_HOME/conf/elasticsearch.yml
    
    # 如下为配置文件 $ES_HOME/conf/elasticsearch.yml 内的修改
    
    node.name:    ${HOSTNAME}
    path.data: /home/es/data
    path.logs: /home/es/logs
    # 启用 禁止交换
    bootstrap.memory_lock: true
    
    # 6/2 +1 = 4
    discovery.zen.minimum_master_nodes: 4
    
    # 此配置每个节点都不同
    network.host: 169.254.7.160
    
    discovery.zen.ping.unicast.hosts:
       - master
       - worker1
       - worker2
       - worker3
       - worker4
       - worker5
    
    # 配置文件 $ES_HOME/conf/elasticsearch.yml 修改完成
    
    # 其他几个节点也类似操作。也可以用scp。scp后各节点的$ES_HOME/conf/elasticsearch.yml 中的 network.host 参数需要修改下。
    
    # 在每个节点中启动
    # 切换到 es 用户启动 elasticsearch
    su es
    
    # Xms和Xmx 大小保持一致，避免震荡堆
    # ES_JAVA_OPTS="-Xms2g -Xmx2g" ./bin/elasticsearch
    
    # -d daemon
    # 参数使用 -E
    ./bin/elasticsearch -d -p /home/es/es.pid -Ecluster.name=my_cluster  # 启动
    
    # 在同网段访问
    curl -XGET 'localhost:9200/_cat/health?v&pretty' # 检查es健康 状况
    
    # 检查是否启用 bootstrap.memory_lock
    curl -XGET 'localhost:9200/_nodes?filter_path=**.mlockall&pretty'

安装 kibana [官网tar.gz下载][tar.gz]

tar -zxvf kibana-5.3.0-linux-x86_64.tar.gz -C /usr/local
    cd /usr/local
    ln -s kibana-5.3.0-linux-x86_64 kibana
    
    cd config/
    # 修改配置文件
    vi kibana.yml
    
    server.host: "master"
    elasticsearch.url: "http://master:9200"
    # kibana.yml 修改完成
    
    # 启动kibana
    cd ../bin
    ./kibana 
    
    # 访问kibana
    http://master:5601

安装sense

# 下载 https://download.elasticsearch.org/elastic/sense/sense-latest.tar.gz

转载于:https://my.oschina.net/corleone/blog/873660

[2019_Python_]: https://my.oschina.net/u/2663968/blog/3061697
[hot3.png]: /images/20220114/769dd08e8f3d46d791b1048ef8aad7de.png
[Link 1]: https://pan.baidu.com/s/1o7CMdSY#list/path=%2Fsetups%2Flinux%2FES
[Link 2]: https://artifacts.elastic.co/downloads/elasticsearch/elasticsearch-5.3.0.tar.gz
[Elasticsearch]: http://elasticsearch.cn/article/110
[Elasticsearch 5]: http://elasticsearch.cn/article/120
[ES]: http://elasticsearch.cn/article/32
[ES_Recovery]: http://elasticsearch.cn/article/38
[Link 3]: https://github.com/elastic/puppet-elasticsearch
[cookbook-elasticsearch]: https://github.com/elastic/cookbook-elasticsearch
[Elasticsearch_2]: http://yemengying.com/2016/03/21/elasticsearch-settings2/
[Elasticsearch_1]: http://yemengying.com/2016/03/18/Elasticsearch%E9%85%8D%E7%BD%AE%E9%A1%B9-Local-gateway-HTTP-Indices-Network-Settings%E6%A8%A1%E5%9D%97%E9%85%8D%E7%BD%AE/
[tar.gz]: https://artifacts.elastic.co/downloads/kibana/kibana-5.3.0-linux-x86_64.tar.gz