JavaEE进阶——Docker安装Solr(单机/集群)

蔚落 2022-05-15 23:15 437阅读 0赞

## 准备工作 ##

*  [了解 Solr 服务相关知识][Solr]
 *  [了解Docker][Docker]
 *  [了解Docker的网络模型][Docker 1]

## 本地环境 ##

*  宿主机：CentOS 7
 *  Docker CE

## 安装单机版Solr服务 ##

1.  [拉取 Solr 镜像][Solr 1]；
    
        docker pull solr:7.4.0
2.  启动 *Solr* 容器，即可访问 [http://ip:8983/][http_ip_8983] ；
    
        docker run --name taotao-solr -d -p 8983:8983 -t solr:7.4.0
3.  新建 SolrCore，名称为 *collection1*；
    
        docker exec -it --user=solr taotao-solr bin/solr create_core -c collection1
4.  为了方便后续修改配置，将容器 solr 文件拷贝本地 `/usr/local/solr/` 路径下；
    
        docker cp taotao-solr:/opt/solr/ /usr/local/ # 容器拷贝宿主机
5.  设置中文分词 *smartcn*；
    
     *  进入容器 `docker exec -it taotao-solr /bin/bash` ；
     *  定位Solr7自带的中文分词器 *smartcn* 的jar包位置 `/opt/solr/contrib/analysis-extras/lucene-libs`；
     *  进入创建的 *solrcore: collection1* 配置目录 `/opt/solr/server/solr/collection1/conf` ，修改 `solrconfig.xml` 添加 *smartcn* 包的 `lib` 标签；
        
        ![修改路径添加jar包][jar]
     *  在 `managed-schema` 中添加中文分词的 FieldType ；
        
        ![添加FieldType][FieldType]
     *  上传配置，重启solr服务。
        
            docker cp /usr/local/solr/server/solr/collection1/conf/solrconfig.xml taotao-solr:/opt/solr/server/solr/collection1/conf/solrconfig.xml
            docker cp /usr/local/solr/server/solr/collection1/conf/managed-schema taotao-solr:/opt/solr/server/solr/collection1/conf/managed-schema
            docker restart taotao-solr
        
        ![中文分词][20180813065633200]

## 安装集群版SolrCloud ##

1.  CNM 新建 Docker 自定义网络；
    
        [root@localhost ~]# docker network create taotao-zks
        8e3f9c7f672c38573609c294c7de5c13f69dbac1f03795bf415270ca4b07c41a
        [root@localhost ~]# docker network ls
        NETWORK ID          NAME                DRIVER              SCOPE
        bdb405aa48bf        bridge              bridge              local
        52dbb516d633        host                host                local
        dd5c9b3d1fb8        none                null                local
        8e3f9c7f672c        taotao-zks          bridge              local
2.  Docker 容器搭建 ZooKeeper 集群（3个实例）；
    
        # 启动实例1
        
        docker run -d \
            --restart=always \
            -v /usr/local/taotao-zks/zk1/data:/data \
            -v /usr/local/taotao-zks/zk1/datalog:/datalog \
            -p 2182:2181 \
            -e ZOO_MY_ID=1 \
            -e ZOO_SERVERS="server.1=taotao-zk1:2888:3888 server.2=taotao-zk2:2888:3888 server.3=taotao-zk3:2888:3888" \
            --name=taotao-zk1 \
            --net=taotao-zks \
            --privileged \
            zookeeper:3.4.13
        
        
        # 启动实例2
        
        docker run -d \
            --restart=always \
            -v /usr/local/taotao-zks/zk2/data:/data \
            -v /usr/local/taotao-zks/zk2/datalog:/datalog \
            -p 2183:2181 \
            -e ZOO_MY_ID=2 \
            -e ZOO_SERVERS="server.1=taotao-zk1:2888:3888 server.2=taotao-zk2:2888:3888 server.3=taotao-zk3:2888:3888" \
            --name=taotao-zk2 \
            --net=taotao-zks \
            --privileged \
            zookeeper:3.4.13
        
        
        # 启动实例3
        
        docker run -d \
            --restart=always \
            -v /usr/local/taotao-zks/zk3/data:/data \
            -v /usr/local/taotao-zks/zk3/datalog:/datalog \
            -p 2184:2181 \
            -e ZOO_MY_ID=3 \
            -e ZOO_SERVERS="server.1=taotao-zk1:2888:3888 server.2=taotao-zk2:2888:3888 server.3=taotao-zk3:2888:3888" \
            --name=taotao-zk3 \
            --net=taotao-zks \
            --privileged \
            zookeeper:3.4.13
3.  查看ZooKeeper集群搭建状态。
    
        # 宿主机执行命令 可能需要先安装nc(yum -y install nc)
        
        echo stat|nc 127.0.0.1 2182
        echo stat|nc 127.0.0.1 2183
        echo stat|nc 127.0.0.1 2184
4.  搭建 Solr Cloud（4个实例）；
    
        # 启动实例1
        
        docker run --name taotao-solrcloud1 --net=taotao-zks -d -p 8984:8983 solr:7.4.0 bash -c '/opt/solr/bin/solr start -f -z taotao-zk1:2181,taotao-zk2:2181,taotao-zk3:2181'
        
        
        # 启动实例2
        
        docker run --name taotao-solrcloud2 --net=taotao-zks -d -p 8985:8983 solr:7.4.0 bash -c '/opt/solr/bin/solr start -f -z taotao-zk1:2181,taotao-zk2:2181,taotao-zk3:2181'
        
        
        # 启动实例3
        
        docker run --name taotao-solrcloud3 --net=taotao-zks -d -p 8986:8983 solr:7.4.0 bash -c '/opt/solr/bin/solr start -f -z taotao-zk1:2181,taotao-zk2:2181,taotao-zk3:2181'
        
        
        # 启动实例4
        
        docker run --name taotao-solrcloud4 --net=taotao-zks -d -p 8987:8983 solr:7.4.0 bash -c '/opt/solr/bin/solr start -f -z taotao-zk1:2181,taotao-zk2:2181,taotao-zk3:2181'
5.  验证搭建结果，访问 [http://ip:8984/][http_ip_8984] 、[http://ip:8985/][http_ip_8985] 、[http://ip:8986/][http_ip_8986] 或 [http://ip:8987/][http_ip_8987]；
    
    ![7个容器][7]
6.  上传配置文件 conf 目录到 ZooKeeper 中心；
    
        docker exec -it taotao-solrcloud1 /opt/solr/server/scripts/cloud-scripts/zkcli.sh -zkhost taotao-zk1:2181,taotao-zk2:2181,taotao-zk3:2181 -cmd upconfig -confdir /opt/solr/server/solr/configsets/sample_techproducts_configs/conf -confname taotao-solrcloud-conf
7.  查询zookeeper集群是否包含配置文件；
    
        docker exec -it taotao-zk1 /bin/bash
        bash-4.4# ./bin/zkCli.sh -server taotao-zk2:2181
        Connecting to taotao-zk2:2181
        ---日志省略---
        [zk: taotao-zk2:2181(CONNECTED) 0] ls /configs/taotao-solrcloud-conf
        [currency.xml, mapping-FoldToASCII.txt, managed-schema, protwords.txt, synonyms.txt, stopwords.txt, _schema_analysis_synonyms_english.json, velocity, update-script.js, _schema_analysis_stopwords_english.json, solrconfig.xml, elevate.xml, clustering, _rest_managed.json, mapping-ISOLatin1Accent.txt, spellings.txt, xslt, lang, params.json]
    
    或者请求：[http://ip:8987/solr/admin/configs?action=LIST][http_ip_8987_solr_admin_configs_action_LIST]
8.  更新配置文件上传 ZooKeeper 集群；
    
        # 拷贝宿主机修改的目录上传至solr集群中某一节点
        
        docker cp /usr/local/solr/server/solr/collection1/conf/solrconfig.xml taotao-solrcloud1:/opt/solr/server/solr/configsets/sample_techproducts_configs/conf/solrconfig.xml
        docker cp /usr/local/solr/server/solr/collection1/conf/managed-schema taotao-solrcloud1:/opt/solr/server/solr/configsets/sample_techproducts_configs/conf/managed-schema
        
        
        # 利用putfile命令更新集群的配置文件
        
        docker exec -it taotao-solrcloud1 /opt/solr/server/scripts/cloud-scripts/zkcli.sh -zkhost taotao-zk1:2181,taotao-zk2:2181,taotao-zk3:2181 -cmd putfile /configs/taotao-solrcloud-conf/solrconfig.xml /opt/solr/server/solr/configsets/sample_techproducts_configs/conf/solrconfig.xml
        docker exec -it taotao-solrcloud1 /opt/solr/server/scripts/cloud-scripts/zkcli.sh -zkhost taotao-zk1:2181,taotao-zk2:2181,taotao-zk3:2181 -cmd putfile /configs/taotao-solrcloud-conf/managed-schema /opt/solr/server/solr/configsets/sample_techproducts_configs/conf/managed-schema
9.  创建collection，分两片，每片一主一备。浏览器输入请求：
    
     *  [http://ip:8987/solr/admin/collections?action=CREATE&name=collection1&numShards=2&replicationFactor=2 ][http_ip_8987_solr_admin_collections_action_CREATE_name_collection1_numShards_2_replicationFactor_2]
     *  [http://ip:8987/solr/admin/collections?action=CREATE&name=collection2&numShards=2&replicationFactor=2&collection.configName=taotao-solrcloud-conf ][http_ip_8987_solr_admin_collections_action_CREATE_name_collection2_numShards_2_replicationFactor_2_collection.configName_taotao-solrcloud-conf]
    
    ![创建collection][collection]
    
    两种方式区别在于配置文件的使用是否指定，如果不指定，则会创建默认的一套配置文件。
    
    ![配置文件][20180813070704833]
10. 重新载入ZooKeeper更新后的配置文件。
    
    [http://ip:8987/solr/admin/collections?action=RELOAD&name=collection1][http_ip_8987_solr_admin_collections_action_RELOAD_name_collection1]
    
    [http://ip:8987/solr/admin/collections?action=RELOAD&name=collection2][http_ip_8987_solr_admin_collections_action_RELOAD_name_collection2]

[Solr]: https://blog.csdn.net/bskfnvjtlyzmv867/article/details/80940089
[Docker]: https://blog.csdn.net/bskfnvjtlyzmv867/article/details/81044217
[Docker 1]: https://yq.aliyun.com/articles/30328
[Solr 1]: https://hub.docker.com/_/solr/
[http_ip_8983]: http://ip:8983/
[jar]: /images/20220516/3ab1803397a243be86a8b2a468428c1b.png
[FieldType]: /images/20220516/374aaf95d6804c07814be40d190ed2f8.png
[20180813065633200]: /images/20220516/44edbf4d67414674967bd9c9b4eb7b4d.png
[http_ip_8984]: http://ip:8984/
[http_ip_8985]: http://ip:8985/
[http_ip_8986]: http://ip:8986/
[http_ip_8987]: http://ip:8987/
[7]: /images/20220516/076f24d75b344099980ec7b870e0b1e0.png
[http_ip_8987_solr_admin_configs_action_LIST]: http://ip:8987/solr/admin/configs?action=LIST
[http_ip_8987_solr_admin_collections_action_CREATE_name_collection1_numShards_2_replicationFactor_2]: http://ip:8987/solr/admin/collections?action=CREATE&name=collection1&numShards=2&replicationFactor=2
[http_ip_8987_solr_admin_collections_action_CREATE_name_collection2_numShards_2_replicationFactor_2_collection.configName_taotao-solrcloud-conf]: http://ip:8987/solr/admin/collections?action=CREATE&name=collection2&numShards=2&replicationFactor=2&collection.configName=taotao-solrcloud-conf
[collection]: /images/20220516/64d1c5b1213e469baf3ef6933e8c005e.png
[20180813070704833]: /images/20220516/b829ac27bc5b42bb84f7a790fac5eaf6.png
[http_ip_8987_solr_admin_collections_action_RELOAD_name_collection1]: http://ip:8987/solr/admin/collections?action=RELOAD&name=collection1
[http_ip_8987_solr_admin_collections_action_RELOAD_name_collection2]: http://ip:8987/solr/admin/collections?action=RELOAD&name=collection2