Centos7搭建hadoop3.3.4分布式集群

太过爱你忘了你带给我的痛 2024-03-26 10:53 58阅读 0赞

#### 文章目录 ####

*  1、背景
 *  2、集群规划
 *   *  2.1 hdfs集群规划
     *  2.2 yarn集群规划
     *  3、集群搭建步骤
     *   *  3.1 安装JDK
         *  3.2 修改主机名和host映射
         *  3.3 配置时间同步
         *  3.4 关闭防火墙
         *  3.5 配置ssh免密登录
         *   *  3.5.1 新建hadoop部署用户
             *  3.5.2 配置hadoopdeploy用户到任意一台机器都免密登录
         *  3.7 配置hadoop
         *   *  3.7.1 创建目录(3台机器都执行)
             *  3.7.2 下载hadoop并解压(hadoop01操作)
             *  3.7.3 配置hadoop环境变量(hadoop01操作)
             *  3.7.4 hadoop的配置文件分类(hadoop01操作)
             *  3.7.5 配置 hadoop-env.sh(hadoop01操作)
             *  3.7.6 配置core-site.xml文件(hadoop01操作)(核心配置文件)
             *  3.7.7 配置hdfs-site.xml文件(hadoop01操作)(hdfs配置文件)
             *  3.7.8 配置yarn-site.xml文件(hadoop01操作)(yarn配置文件)
             *  3.7.9 配置mapred-site.xml文件(hadoop01操作)(mapreduce配置文件)
             *  3.7.10 配置workers文件(hadoop01操作)
             *  3.7.11 3台机器hadoop配置同步(hadoop01操作)
             *   *  1、同步hadoop文件
                 *  2、hadoop02和hadoop03设置hadoop的环境变量
 *  3、启动集群
 *   *  3.1 集群格式化
     *  3.2 集群启动
     *   *  3.2.1 逐个启动进程
         *  3.2.2 脚本一键启动
     *  3.3 启动集群
     *   *  3.3.1 启动hdfs集群
         *  3.3.2 启动yarn集群
         *  3.3.3 启动JobHistoryServer
     *  3.4 查看各个机器上启动的服务是否和我们规划的一致
     *  3.5 访问页面
     *   *  3.5.1 访问NameNode ui (hdfs集群)
         *  3.5.2 访问SecondaryNameNode ui
         *  3.5.3 查看ResourceManager ui(yarn集群)
         *  3.5.4 访问jobhistory
 *  4、参考链接

## 1、背景 ##

最近在学习`hadoop`，本文记录一下，怎样在Centos7系统上搭建一个`3`个节点的`hadoop`集群。

## 2、集群规划 ##

`hadoop`集群是由2个集群构成的，分别是`hdfs`集群和`yarn`集群。2个集群都是主从结构。

### 2.1 hdfs集群规划 ###

<table> 
 <thead> 
  <tr> 
   <th>ip地址</th> 
   <th>主机名</th> 
   <th>部署服务</th> 
  </tr> 
 </thead> 
 <tbody> 
  <tr> 
   <td>192.168.121.140</td> 
   <td>hadoop01</td> 
   <td>NameNode,DataNode,JobHistoryServer</td> 
  </tr> 
  <tr> 
   <td>192.168.121.141</td> 
   <td>hadoop02</td> 
   <td>DataNode</td> 
  </tr> 
  <tr> 
   <td>192.168.121.142</td> 
   <td>hadoop03</td> 
   <td>DataNode,SecondaryNameNode</td> 
  </tr> 
 </tbody> 
</table>

### 2.2 yarn集群规划 ###

<table> 
 <thead> 
  <tr> 
   <th>ip地址</th> 
   <th>主机名</th> 
   <th>部署服务</th> 
  </tr> 
 </thead> 
 <tbody> 
  <tr> 
   <td>192.168.121.140</td> 
   <td>hadoop01</td> 
   <td>NodeManager</td> 
  </tr> 
  <tr> 
   <td>192.168.121.141</td> 
   <td>hadoop02</td> 
   <td>ResourceManager,NodeManager</td> 
  </tr> 
  <tr> 
   <td>192.168.121.142</td> 
   <td>hadoop03</td> 
   <td>NodeManager</td> 
  </tr> 
 </tbody> 
</table>

### 3、集群搭建步骤 ###

#### 3.1 安装JDK ####

安装jdk步骤较为简单，此处省略。需要注意的是hadoop需要的jdk版本。 [https://cwiki.apache.org/confluence/display/HADOOP/Hadoop+Java+Versions][https_cwiki.apache.org_confluence_display_HADOOP_Hadoop_Java_Versions]

#### 3.2 修改主机名和host映射 ####

<table> 
 <thead> 
  <tr> 
   <th>ip地址</th> 
   <th>主机名</th> 
  </tr> 
 </thead> 
 <tbody> 
  <tr> 
   <td>192.168.121.140</td> 
   <td>hadoop01</td> 
  </tr> 
  <tr> 
   <td>192.168.121.141</td> 
   <td>hadoop02</td> 
  </tr> 
  <tr> 
   <td>192.168.121.142</td> 
   <td>hadoop03</td> 
  </tr> 
 </tbody> 
</table>

**3台机器上同时执行如下命令**

# 此处修改主机名，3台机器的主机名需要都不同
    [root@hadoop01 ~]# vim /etc/hostname
    [root@hadoop01 ~]# cat /etc/hostname
    hadoop01
    [root@hadoop01 ~]# vim /etc/hosts
    [root@hadoop01 ~]# cat /etc/hosts | grep hadoop*
    192.168.121.140 hadoop01
    192.168.121.141 hadoop02
    192.168.121.142 hadoop03

![修改主机名和host映射][host]

#### 3.3 配置时间同步 ####

集群中的时间最好保持一致，否则可能会有问题。此处我本地搭建，虚拟机是可以链接外网，直接配置和外网时间同步。如果不能链接外网，则集群中的3台服务器，让另外的2台和其中的一台保持时间同步。

**3台机器同时执行如下命令**

# 将centos7的时区设置成上海
    [root@hadoop01 ~]# ln -sf /usr/share/zoneinfo/Asia/Shanghai /etc/localtime
    # 安装ntp
    [root@hadoop01 ~]# yum install ntp
    已加载插件：fastestmirror
    Loading mirror speeds from cached hostfile
    base                                           | 3.6 kB     00:00
    extras                                         | 2.9 kB     00:00
    updates                                        | 2.9 kB     00:00
    软件包 ntp-4.2.6p5-29.el7.centos.2.aarch64 已安装并且是最新版本
    无须任何处理
    # 将ntp设置成缺省启动
    [root@hadoop01 ~]# systemctl enable ntpd
    # 重启ntp服务
    [root@hadoop01 ~]# service ntpd restart
    Redirecting to /bin/systemctl restart ntpd.service
    # 对准时间
    [root@hadoop01 ~]# ntpdate asia.pool.ntp.org
    19 Feb 12:36:22 ntpdate[1904]: the NTP socket is in use, exiting
    # 对准硬件时间和系统时间
    [root@hadoop01 ~]# /sbin/hwclock --systohc
    # 查看时间
    [root@hadoop01 ~]# timedatectl
          Local time: 日 2023-02-19 12:36:35 CST
      Universal time: 日 2023-02-19 04:36:35 UTC
            RTC time: 日 2023-02-19 04:36:35
           Time zone: Asia/Shanghai (CST, +0800)
         NTP enabled: yes
    NTP synchronized: no
     RTC in local TZ: no
          DST active: n/a
    # 开始自动时间和远程ntp时间进行同步
    [root@hadoop01 ~]# timedatectl set-ntp true

#### 3.4 关闭防火墙 ####

3台机器上同时关闭防火墙，如果不关闭的话，则需要放行hadoop可能用到的所有端口等。

# 关闭防火墙
    [root@hadoop01 ~]# systemctl stop firewalld
    systemctl stop firewalld
    # 关闭防火墙开机自启
    [root@hadoop01 ~]# systemctl disable firewalld.service
    Removed symlink /etc/systemd/system/multi-user.target.wants/firewalld.service.
    Removed symlink /etc/systemd/system/dbus-org.fedoraproject.FirewallD1.service.
    [root@hadoop01 ~]#

#### 3.5 配置ssh免密登录 ####

##### 3.5.1 新建hadoop部署用户 #####

[root@hadoop01 ~]# useradd hadoopdeploy
    [root@hadoop01 ~]# passwd hadoopdeploy
    更改用户 hadoopdeploy 的密码 。
    新的 密码：
    无效的密码： 密码包含用户名在某些地方
    重新输入新的 密码：
    passwd：所有的身份验证令牌已经成功更新。
    [root@hadoop01 ~]# vim /etc/sudoers
    [root@hadoop01 ~]# cat /etc/sudoers | grep hadoopdeploy
    hadoopdeploy    ALL=(ALL)       NOPASSWD: ALL
    [root@hadoop01 ~]#

![新建hadoop部署用户][hadoop]

##### 3.5.2 配置hadoopdeploy用户到任意一台机器都免密登录 #####

`配置3台机器，从任意一台到自身和另外2台都进行免密登录。`

<table> 
 <thead> 
  <tr> 
   <th>当前机器</th> 
   <th>当前用户</th> 
   <th>免密登录的机器</th> 
   <th>免密登录的用户</th> 
  </tr> 
 </thead> 
 <tbody> 
  <tr> 
   <td>hadoop01</td> 
   <td>hadoopdeploy</td> 
   <td>hadoop01,hadoop02,hadoop03</td> 
   <td>hadoopdeploy</td> 
  </tr> 
  <tr> 
   <td>hadoop02</td> 
   <td>hadoopdeploy</td> 
   <td>hadoop01,hadoop02,hadoop03</td> 
   <td>hadoopdeploy</td> 
  </tr> 
  <tr> 
   <td>hadoop03</td> 
   <td>hadoopdeploy</td> 
   <td>hadoop01,hadoop02,hadoop03</td> 
   <td>hadoopdeploy</td> 
  </tr> 
 </tbody> 
</table>

此处演示从 `hadoop01`到`hadoop01,hadoop02,hadoop03`免密登录的`shell`

# 切换到 hadoopdeploy 用户
    [root@hadoop01 ~]# su - hadoopdeploy
    Last login: Sun Feb 19 13:05:43 CST 2023 on pts/0
    # 生成公私钥对，下方的提示直接3个回车即可
    [hadoopdeploy@hadoop01 ~]$ ssh-keygen -t rsa
    Generating public/private rsa key pair.
    Enter file in which to save the key (/home/hadoopdeploy/.ssh/id_rsa):
    Created directory '/home/hadoopdeploy/.ssh'.
    Enter passphrase (empty for no passphrase):
    Enter same passphrase again:
    Your identification has been saved in /home/hadoopdeploy/.ssh/id_rsa.
    Your public key has been saved in /home/hadoopdeploy/.ssh/id_rsa.pub.
    The key fingerprint is:
    SHA256:PFvgTUirtNLwzDIDs+SD0RIzMPt0y1km5B7rY16h1/E hadoopdeploy@hadoop01
    The key's randomart image is:
    +---[RSA 2048]----+
    |B   .   .        |
    | B o   . o       |
    |+ * * + + .      |
    | O B / = +       |
    |. = @ O S o      |
    |   o * o *       |
    |    = o o E      |
    |   o +           |
    |    .            |
    +----[SHA256]-----+
    [hadoopdeploy@hadoop01 ~]$ ssh-copy-id hadoop01
    ...
    [hadoopdeploy@hadoop01 ~]$ ssh-copy-id hadoop02
    ...
    [hadoopdeploy@hadoop01 ~]$ ssh-copy-id hadoop03

#### 3.7 配置hadoop ####

此处如无特殊说明，都是使用的`hadoopdeploy`用户来操作。

##### 3.7.1 创建目录(3台机器都执行) #####

# 创建 /opt/bigdata 目录
    [hadoopdeploy@hadoop01 ~]$ sudo mkdir /opt/bigdata
    # 将 /opt/bigdata/ 目录及它下方所有的子目录的所属者和所属组都给 hadoopdeploy
    [hadoopdeploy@hadoop01 ~]$ sudo chown -R hadoopdeploy:hadoopdeploy /opt/bigdata/
    [hadoopdeploy@hadoop01 ~]$ ll /opt
    total 0
    drwxr-xr-x. 2 hadoopdeploy hadoopdeploy  6 Feb 19 13:15 bigdata

##### 3.7.2 下载hadoop并解压(hadoop01操作) #####

# 进入目录
    [hadoopdeploy@hadoop01 ~]$ cd /opt/bigdata/
    # 下载
    [hadoopdeploy@hadoop01 ~]$ https://www.apache.org/dyn/closer.cgi/hadoop/common/hadoop-3.3.4/hadoop-3.3.4.tar.gz
    # 解压并压缩
    [hadoopdeploy@hadoop01 bigdata]$ tar -zxvf hadoop-3.3.4.tar.gz && rm -rvf hadoop-3.3.4.tar.gz

##### 3.7.3 配置hadoop环境变量(hadoop01操作) #####

![hadoop的目录结构][hadoop 1]

# 进入hadoop目录
    [hadoopdeploy@hadoop01 hadoop-3.3.4]$ cd /opt/bigdata/hadoop-3.3.4/
    # 切换到root用户
    [hadoopdeploy@hadoop01 hadoop-3.3.4]$ su - root
    Password:
    Last login: Sun Feb 19 13:06:41 CST 2023 on pts/0
    [root@hadoop01 ~]# vim /etc/profile
    # 查看hadoop环境变量配置
    [root@hadoop01 ~]# tail -n 3 /etc/profile
    # 配置HADOOP
    export HADOOP_HOME=/opt/bigdata/hadoop-3.3.4/
    export PATH=${HADOOP_HOME}/bin:${HADOOP_HOME}/sbin:$PATH
    # 让环境变量生效
    [root@hadoop01 ~]# source /etc/profile

##### 3.7.4 hadoop的配置文件分类(hadoop01操作) #####

在`hadoop`中配置文件大概有这么`3`大类。

*  默认的只读配置文件： `core-default.xml, hdfs-default.xml, yarn-default.xml and mapred-default.xml.`
 *  自定义配置文件： `etc/hadoop/core-site.xml, etc/hadoop/hdfs-site.xml, etc/hadoop/yarn-site.xml and etc/hadoop/mapred-site.xml` 会覆盖默认的配置。
 *  环境配置文件： `etc/hadoop/hadoop-env.sh and optionally the etc/hadoop/mapred-env.sh and etc/hadoop/yarn-env.sh` 比如配置`NameNode`的启动参数`HDFS_NAMENODE_OPTS`等。
 *

![hadoop的配置文件][hadoop 2]

##### 3.7.5 配置 hadoop-env.sh(hadoop01操作) #####

# 切换到hadoopdeploy用户
    [root@hadoop01 ~]# su - hadoopdeploy
    Last login: Sun Feb 19 14:22:50 CST 2023 on pts/0
    # 进入到hadoop的配置目录
    [hadoopdeploy@hadoop01 ~]$ cd /opt/bigdata/hadoop-3.3.4/etc/hadoop/
    [hadoopdeploy@hadoop01 hadoop]$ vim hadoop-env.sh
    # 增加如下内容
    export JAVA_HOME=/usr/local/jdk8
    export HDFS_NAMENODE_USER=hadoopdeploy
    export HDFS_DATANODE_USER=hadoopdeploy
    export HDFS_SECONDARYNAMENODE_USER=hadoopdeploy
    export YARN_RESOURCEMANAGER_USER=hadoopdeploy
    export YARN_NODEMANAGER_USER=hadoopdeploy

##### 3.7.6 配置core-site.xml文件(hadoop01操作)(核心配置文件) #####

默认配置文件路径：[https://hadoop.apache.org/docs/current/hadoop-project-dist/hadoop-common/core-default.xml][https_hadoop.apache.org_docs_current_hadoop-project-dist_hadoop-common_core-default.xml]

`vim /opt/bigdata/hadoop-3.3.4/etc/hadoop/core-site.xml`

<configuration>
        
        <property>
            <name>fs.defaultFS</name>
            <value>hdfs://hadoop01:8020</value>
        </property>
    
        
        <property>
            <name>hadoop.tmp.dir</name>
            <value>/opt/bigdata/hadoop-3.3.4/data</value>
        </property>
    
        
        <property>
            <name>hadoop.http.staticuser.user</name>
            <value>hadoopdeploy</value>
        </property>
        
    	<property>
    	    <name>fs.trash.interval</name>
    	    <value>1440</value>
    	</property>
    </configuration>

##### 3.7.7 配置hdfs-site.xml文件(hadoop01操作)(hdfs配置文件) #####

默认配置文件路径：[https://hadoop.apache.org/docs/current/hadoop-project-dist/hadoop-hdfs/hdfs-default.xml][https_hadoop.apache.org_docs_current_hadoop-project-dist_hadoop-hdfs_hdfs-default.xml]

`vim /opt/bigdata/hadoop-3.3.4/etc/hadoop/hdfs-site.xml`

<configuration>
    
        
        <property>
            <name>dfs.replication</name>
            <value>2</value>
        </property>
    
        
        <property>
            <name>dfs.namenode.http-address</name>
            <value>hadoop01:9870</value>
        </property>
        
        <property>
            <name>dfs.namenode.secondary.http-address</name>
            <value>hadoop03:9868</value>
        </property>
    
    </configuration>

##### 3.7.8 配置yarn-site.xml文件(hadoop01操作)(yarn配置文件) #####

默认配置文件路径：[https://hadoop.apache.org/docs/current/hadoop-yarn/hadoop-yarn-common/yarn-default.xml][https_hadoop.apache.org_docs_current_hadoop-yarn_hadoop-yarn-common_yarn-default.xml]

`vim /opt/bigdata/hadoop-3.3.4/etc/hadoop/yarn-site.xml`

<configuration>
    
    	
    	
    	<property>
    	    <name>yarn.resourcemanager.hostname</name>
    	    <value>hadoop02</value>
    	</property>
    	
    	
    	<property>
    	    <name>yarn.nodemanager.aux-services</name>
    	    <value>mapreduce_shuffle</value>
    	</property>
    	
    	
    	<property>
    	    <name>yarn.nodemanager.pmem-check-enabled</name>
    	    <value>false</value>
    	</property>
    	
    	
    	<property>
    	    <name>yarn.nodemanager.vmem-check-enabled</name>
    	    <value>false</value>
    	</property>
    	
    	
    	<property>
    	    <name>yarn.log.server.url</name>
    	    <value>http://hadoop02:19888/jobhistory/logs</value>
    	</property>
    	
    	
    	<property>
    	    <name>yarn.log-aggregation-enable</name>
    	    <value>true</value>
    	</property>
    	
    	
    	<property>
    	    <name>yarn.log-aggregation.retain-seconds</name>
    	    <value>604800</value>
    	</property>
    </configuration>

##### 3.7.9 配置mapred-site.xml文件(hadoop01操作)(mapreduce配置文件) #####

默认配置文件路径：[https://hadoop.apache.org/docs/current/hadoop-mapreduce-client/hadoop-mapreduce-client-core/mapred-default.xml][https_hadoop.apache.org_docs_current_hadoop-mapreduce-client_hadoop-mapreduce-client-core_mapred-default.xml]

`vim /opt/bigdata/hadoop-3.3.4/etc/hadoop/yarn-site.xml`

<configuration>
    	
    	<property>
    	    <name>mapreduce.framework.name</name>
    	    <value>yarn</value>
    	</property>
    	
    	
    	<property>
    	    <name>mapreduce.jobhistory.address</name>
    	    <value>hadoop01:10020</value>
    	</property>
    	
    	
    	<property>
    	    <name>mapreduce.jobhistory.webapp.address</name>
    	    <value>hadoop01:19888</value>
    	</property>
    	
    	<property>
    	    <name>yarn.app.mapreduce.am.env</name>
    	    <value>HADOOP_MAPRED_HOME=${HADOOP_HOME}</value>
    	</property>
    	
    	<property>
    	    <name>mapreduce.map.env</name>
    	    <value>HADOOP_MAPRED_HOME=${HADOOP_HOME}</value>
    	</property>
    	
    	<property>
    	    <name>mapreduce.reduce.env</name>
    	    <value>HADOOP_MAPRED_HOME=${HADOOP_HOME}</value>
    	</property>
    </configuration>

##### 3.7.10 配置workers文件(hadoop01操作) #####

配置`DataNode`节点。  
`vim /opt/bigdata/hadoop-3.3.4/etc/hadoop/workers`

hadoop01
    hadoop02
    hadoop03

`workers`配置文件中不要有多余的空格或换行。

##### 3.7.11 3台机器hadoop配置同步(hadoop01操作) #####

###### 1、同步hadoop文件 ######

# 同步 hadoop 文件
    [hadoopdeploy@hadoop01 hadoop]$ scp -r /opt/bigdata/hadoop-3.3.4/ hadoopdeploy@hadoop02:/opt/bigdata/hadoop-3.3.4
    [hadoopdeploy@hadoop01 hadoop]$ scp -r /opt/bigdata/hadoop-3.3.4/ hadoopdeploy@hadoop03:/opt/bigdata/hadoop-3.3.4

###### 2、hadoop02和hadoop03设置hadoop的环境变量 ######

[hadoopdeploy@hadoop03 bigdata]$ su - root
    Password:
    Last login: Sun Feb 19 13:07:40 CST 2023 on pts/0
    [root@hadoop03 ~]# vim /etc/profile
    [root@hadoop03 ~]# tail -n 4 /etc/profile
    
    # 配置HADOOP
    export HADOOP_HOME=/opt/bigdata/hadoop-3.3.4/
    export PATH=${HADOOP_HOME}/bin:${HADOOP_HOME}/sbin:$PATH
    [root@hadoop03 ~]# source /etc/profile

## 3、启动集群 ##

### 3.1 集群格式化 ###

当是`第一次`启动集群时，需要对`hdfs`进行格式化，在`NameNode`节点操作。

[hadoopdeploy@hadoop01 hadoop]$ hdfs namenode -format

### 3.2 集群启动 ###

启动集群有2种方式

*  `方式一：` 每台机器逐个启动进程，比如：启动NameNode,启动DataNode，可以做到精确控制每个进程的启动。
 *  `方式二：` 配置好各个机器之间的免密登录并且配置好 workers 文件，通过脚本一键启动。

#### 3.2.1 逐个启动进程 ####

# HDFS 集群
    [hadoopdeploy@hadoop01 hadoop]$ hdfs --daemon start namenode | datanode | secondarynamenode
    
    # YARN 集群
    [hadoopdeploy@hadoop01 hadoop]$ hdfs yarn --daemon start resourcemanager | nodemanager | proxyserver

#### 3.2.2 脚本一键启动 ####

*  `start-dfs.sh` 一键启动hdfs集群的所有进程
 *  `start-yarn.sh` 一键启动yarn集群的所有进程
 *  `start-all.sh` 一键启动hdfs和yarn集群的所有进程

### 3.3 启动集群 ###

#### 3.3.1 启动hdfs集群 ####

需要在`NameNode`这台机器上启动

# 改脚本启动集群中的 NameNode、DataNode和SecondaryNameNode
    [hadoopdeploy@hadoop01 hadoop]$ start-dfs.sh

#### 3.3.2 启动yarn集群 ####

需要在`ResourceManager`这台机器上启动

# 该脚本启动集群中的 ResourceManager 和 NodeManager 进程
    [hadoopdeploy@hadoop02 hadoop]$ start-yarn.sh

#### 3.3.3 启动JobHistoryServer ####

[hadoopdeploy@hadoop01 hadoop]$ mapred --daemon start historyserver

### 3.4 查看各个机器上启动的服务是否和我们规划的一致 ###

![查看各个机器上启动的服务是否和我们规划的一致][d5a17e386d644ac2a90297ecbda4319f.png]  
可以看到是一致的。

### 3.5 访问页面 ###

#### 3.5.1 访问NameNode ui (hdfs集群) ####

![访问NameNode ui][NameNode ui]  
`如果这个时候通过 hadoop fs 命令可以上传文件，但是在这个web界面上可以创建文件夹，但是上传文件报错，此处就需要在访问ui界面的这个电脑的hosts文件中，将部署hadoop的那几台的电脑的ip 和hostname 在本机上进行映射`。

#### 3.5.2 访问SecondaryNameNode ui ####

![访问SecondaryNameNode ui][SecondaryNameNode ui]

#### 3.5.3 查看ResourceManager ui(yarn集群) ####

![查看ResourceManager ui][ResourceManager ui]

#### 3.5.4 访问jobhistory ####

![访问jobhistory][jobhistory]

## 4、参考链接 ##

1、[https://cwiki.apache.org/confluence/display/HADOOP/Hadoop+Java+Versions][https_cwiki.apache.org_confluence_display_HADOOP_Hadoop_Java_Versions]  
2、[https://hadoop.apache.org/docs/current/hadoop-project-dist/hadoop-common/ClusterSetup.html][https_hadoop.apache.org_docs_current_hadoop-project-dist_hadoop-common_ClusterSetup.html]

[https_cwiki.apache.org_confluence_display_HADOOP_Hadoop_Java_Versions]: https://cwiki.apache.org/confluence/display/HADOOP/Hadoop+Java+Versions
[host]: https://image.dandelioncloud.cn/pgy_files/images/2024/03/26/52c2071dd7684a7ab8e2a7571087302f.png
[hadoop]: https://image.dandelioncloud.cn/pgy_files/images/2024/03/26/58c84a7a67594d88a79d29e97f653bc7.png
[hadoop 1]: https://image.dandelioncloud.cn/pgy_files/images/2024/03/26/aa4a7932c6004b72b2f91abf62762488.png
[hadoop 2]: https://image.dandelioncloud.cn/pgy_files/images/2024/03/26/2ccb30ff11ca41c2a993e9879590968b.png
[https_hadoop.apache.org_docs_current_hadoop-project-dist_hadoop-common_core-default.xml]: https://hadoop.apache.org/docs/current/hadoop-project-dist/hadoop-common/core-default.xml
[https_hadoop.apache.org_docs_current_hadoop-project-dist_hadoop-hdfs_hdfs-default.xml]: https://hadoop.apache.org/docs/current/hadoop-project-dist/hadoop-hdfs/hdfs-default.xml
[https_hadoop.apache.org_docs_current_hadoop-yarn_hadoop-yarn-common_yarn-default.xml]: https://hadoop.apache.org/docs/current/hadoop-yarn/hadoop-yarn-common/yarn-default.xml
[https_hadoop.apache.org_docs_current_hadoop-mapreduce-client_hadoop-mapreduce-client-core_mapred-default.xml]: https://hadoop.apache.org/docs/current/hadoop-mapreduce-client/hadoop-mapreduce-client-core/mapred-default.xml
[d5a17e386d644ac2a90297ecbda4319f.png]: https://image.dandelioncloud.cn/pgy_files/images/2024/03/26/2511da9cf18843fda438b7a924d7d8b5.png
[NameNode ui]: https://image.dandelioncloud.cn/pgy_files/images/2024/03/26/5183a9ee12cd4234a2779121556853e9.png
[SecondaryNameNode ui]: https://image.dandelioncloud.cn/pgy_files/images/2024/03/26/9e883485b513488cab9f731281a0884f.png
[ResourceManager ui]: https://image.dandelioncloud.cn/pgy_files/images/2024/03/26/f08d803137df4465817572b56aab96e7.png
[jobhistory]: https://image.dandelioncloud.cn/pgy_files/images/2024/03/26/91f9b63e421440fbb5008b260e3dea3b.png
[https_hadoop.apache.org_docs_current_hadoop-project-dist_hadoop-common_ClusterSetup.html]: https://hadoop.apache.org/docs/current/hadoop-project-dist/hadoop-common/ClusterSetup.html