ElasticSearch系列 - 安装

ゞ浴缸里的玫瑰 2024-04-17 20:07 56阅读 0赞

#### ElasticSearch系列 - 安装 ####

##### ElasticSearch 安装 #####

[elasticSearch下载][elasticSearch]

![\[外链图片转存失败(img-zCZ66B2z-1567216164016)(/Users/aaron/Library/Application Support/typora-user-images/image-20190826191125115.png)\]][img-zCZ66B2z-1567216164016_Users_aaron_Library_Application Support_typora-user-images_image-20190826191125115.png]

选择MACOS 下载，然后解压zip包

Elasticsearch目录结构为：

<table> 
 <thead> 
  <tr> 
   <th align="center">目录</th> 
   <th align="center">配置文件</th> 
   <th align="center">描述</th> 
  </tr> 
 </thead> 
 <tbody> 
  <tr> 
   <td align="center">bin</td> 
   <td align="center"></td> 
   <td align="center">脚本文件，包括起点elasticsearch。安装插件，运行统计数据等</td> 
  </tr> 
  <tr> 
   <td align="center">config</td> 
   <td align="center">elasticsearch.yml</td> 
   <td align="center">集群配置文件，user，role based相关配置</td> 
  </tr> 
  <tr> 
   <td align="center">JDK</td> 
   <td align="center"></td> 
   <td align="center">java运行环境</td> 
  </tr> 
  <tr> 
   <td align="center">data</td> 
   <td align="center">path.data</td> 
   <td align="center">数据文件</td> 
  </tr> 
  <tr> 
   <td align="center">lib</td> 
   <td align="center"></td> 
   <td align="center">java类库</td> 
  </tr> 
  <tr> 
   <td align="center">logs</td> 
   <td align="center">path.log</td> 
   <td align="center">日志文件</td> 
  </tr> 
  <tr> 
   <td align="center">modules</td> 
   <td align="center"></td> 
   <td align="center">包含所有ES模块</td> 
  </tr> 
  <tr> 
   <td align="center">plugins</td> 
   <td align="center"></td> 
   <td align="center">包含所有已安装插件</td> 
  </tr> 
 </tbody> 
</table>

启动Elasticsearch

![在这里插入图片描述][watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3FxXzMzMzMwNjg3_size_16_color_FFFFFF_t_70]

输入localhost:9200

![\[外链图片转存失败(img-G9vOG4Lj-1567216111022)(/Users/aaron/Library/Application Support/typora-user-images/image-20190826214020066.png)\]][img-G9vOG4Lj-1567216111022_Users_aaron_Library_Application Support_typora-user-images_image-20190826214020066.png]

正常启动

查看安装插件  
![在这里插入图片描述][watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3FxXzMzMzMwNjg3_size_16_color_FFFFFF_t_70 1]

##### Kibanna安装 #####

[Kibanna下载地址][Kibanna]  
![\[外链图片转存失败(img-tJ9ZMO9P-1567216111022)(/Users/aaron/Library/Application Support/typora-user-images/image-20190826222453033.png)\]][img-tJ9ZMO9P-1567216111022_Users_aaron_Library_Application Support_typora-user-images_image-20190826222453033.png]

选择MAC 下载安装包，解压

运行Kibanna

![\[外链图片转存失败(img-2aKWj8S8-1567216111023)(/Users/aaron/Library/Application Support/typora-user-images/image-20190826222845090.png)\]][img-2aKWj8S8-1567216111023_Users_aaron_Library_Application Support_typora-user-images_image-20190826222845090.png]

**PS：Kibanna必须在elasticsearch运行后才可以启动**

输入localhost:5601

![\[外链图片转存失败(img-jX1wrVeC-1567216111023)(/Users/aaron/Library/Application Support/typora-user-images/image-20190826223147934.png)\]][img-jX1wrVeC-1567216111023_Users_aaron_Library_Application Support_typora-user-images_image-20190826223147934.png]

显示已经正常启动

##### Logstash 安装 #####

[logstash下载地址][logstash]  
![在这里插入图片描述][watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3FxXzMzMzMwNjg3_size_16_color_FFFFFF_t_70 2]

下载ZIP，解压

加载数据进ElasticSearch，需要覆盖config文件夹中的logstash.conf文件

这个文件是配置数据转换格式的，定义input，输出ouput

input {
      file {
        path => "/Users/aaron/Documents/Infrastructure/logstash-7.3.1/bin/movies.csv"
        start_position => "beginning"
        sincedb_path => "/dev/null"
      }
    }
    filter {
      csv {
        separator => ","
        columns => ["id","content","genre"]
      }
    
      mutate {
        split => { "genre" => "|" }
        remove_field => ["path", "host","@timestamp","message"]
      }
    
      mutate {
    
        split => ["content", "("]
        add_field => { "title" => "%{[content][0]}"}
        add_field => { "year" => "%{[content][1]}"}
      }
    #  mutate {
    
    #    gsub => [
    #      
    #      "year", "\\)", ""
    #    ]
    #  }
      mutate {
        convert => {
          "year" => "integer"
        }
        strip => ["title"]
        remove_field => ["path", "host","@timestamp","message","content"]
      }
    }
    output {
       elasticsearch {
         hosts => "http://localhost:9200"
         index => "movies"
         document_id => "%{id}"
       }
      stdout {}
    }

然后执行logstash命令  
![\[外链图片转存失败(img-Cqm0ToM1-1567216111024)(/Users/aaron/Library/Application Support/typora-user-images/image-20190826223940202.png)\]][img-Cqm0ToM1-1567216111024_Users_aaron_Library_Application Support_typora-user-images_image-20190826223940202.png]

[elasticSearch]: https://www.elastic.co/cn/downloads/elasticsearch
[img-zCZ66B2z-1567216164016_Users_aaron_Library_Application Support_typora-user-images_image-20190826191125115.png]: https://image.dandelioncloud.cn/pgy_files/images/2024/04/17/655afb896e104c98bca58d60f0b3e8f2.png
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3FxXzMzMzMwNjg3_size_16_color_FFFFFF_t_70]: https://image.dandelioncloud.cn/pgy_files/images/2024/04/17/389675db1da54b738361c61e4b48dbe1.png
[img-G9vOG4Lj-1567216111022_Users_aaron_Library_Application Support_typora-user-images_image-20190826214020066.png]: https://image.dandelioncloud.cn/pgy_files/images/2024/04/17/9aaadcdacd5b454cbce45c05cce10ccd.png
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3FxXzMzMzMwNjg3_size_16_color_FFFFFF_t_70 1]: https://image.dandelioncloud.cn/pgy_files/images/2024/04/17/72180d0f016c4d9dbbf5113c7db845ce.png
[Kibanna]: https://www.elastic.co/cn/downloads/kibana
[img-tJ9ZMO9P-1567216111022_Users_aaron_Library_Application Support_typora-user-images_image-20190826222453033.png]: https://image.dandelioncloud.cn/pgy_files/images/2024/04/17/f648139057c047d19671f94f0361a9af.png
[img-2aKWj8S8-1567216111023_Users_aaron_Library_Application Support_typora-user-images_image-20190826222845090.png]: https://image.dandelioncloud.cn/pgy_files/images/2024/04/17/1c021b88e5c548c983f04e9c2b45dbab.png
[img-jX1wrVeC-1567216111023_Users_aaron_Library_Application Support_typora-user-images_image-20190826223147934.png]: https://image.dandelioncloud.cn/pgy_files/images/2024/04/17/4c8514a641a244b48768d93c069ed6c5.png
[logstash]: https://www.elastic.co/cn/downloads/logstash
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3FxXzMzMzMwNjg3_size_16_color_FFFFFF_t_70 2]: https://image.dandelioncloud.cn/pgy_files/images/2024/04/17/b35d16d479ee4902a2a4e7dfb81270ee.png
[img-Cqm0ToM1-1567216111024_Users_aaron_Library_Application Support_typora-user-images_image-20190826223940202.png]: https://image.dandelioncloud.cn/pgy_files/images/2024/04/17/4c91e019e601415a89c71ca9c17c5b98.png