hadoop系列——linux hadoop安装

梦里梦外; 2021-09-21 07:46 417阅读 0赞

一、安装模式

1.单机版本

2.伪分布式

3.完全分布式

二、安装过程

1.java jdk 安装

![20200521092433791.png][]

2.hadoop安装

(1)单机版 standalone

步骤一：下载 [https://hadoop.apache.org/releases.html][https_hadoop.apache.org_releases.html]

![watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3dlaXhpbl80MzI5MTA1NQ_size_16_color_FFFFFF_t_70][]

步骤二：配置使用java

/Users/xiaoqiu/alibaba/soft/bigData/hadoop-2.9.2/etc/hadoop/hadoop-env.sh

![watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3dlaXhpbl80MzI5MTA1NQ_size_16_color_FFFFFF_t_70 1][]

步骤三：修改hdfs的配置文件

/Users/xiaoqiu/alibaba/soft/bigData/hadoop-2.9.2/etc/hadoop/core-site.xml

<name>fs.defaultFS</name>

<value>hdfs://localhost:9000</value>

</property>

<name>hadoop.tmp.dir</name>

<value>/Users/xiaoqiu/alibaba/soft/bigData/tmp</value>

</property>

</configuration>

步骤四：设置

/Users/xiaoqiu/alibaba/soft/bigData/hadoop-2.9.2/etc/hadoop/hdfs-site.xml

<name>dfs.replication</name>

</property>

</configuration>

步骤五：ssh localhost配置

步骤五：启动与停止

第一次启动得格式化

/Users/xiaoqiu/alibaba/soft/bigData/hadoop-2.9.2/bin/hdfs namenode -format

![watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3dlaXhpbl80MzI5MTA1NQ_size_16_color_FFFFFF_t_70 2][]

/Users/xiaoqiu/alibaba/soft/bigData/hadoop-2.9.2/sbin/start-dfs.s

![watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3dlaXhpbl80MzI5MTA1NQ_size_16_color_FFFFFF_t_70 3][]

jps

![20200522093339122.png][]

成功：

[http://localhost:50070/][http_localhost_50070]

参考：

[https://www.cnblogs.com/Hephaestus/p/12061581.html][https_www.cnblogs.com_Hephaestus_p_12061581.html]

[https://www.linuxidc.com/Linux/2017-01/140050.htm][https_www.linuxidc.com_Linux_2017-01_140050.htm]

[https://my.oschina.net/u/1456911/blog/685078][https_my.oschina.net_u_1456911_blog_685078]

[20200521092433791.png]: /images/20210920/0ae5f5f7f1f44bcaa0372f302d87b920.png
[https_hadoop.apache.org_releases.html]: https://hadoop.apache.org/releases.html
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3dlaXhpbl80MzI5MTA1NQ_size_16_color_FFFFFF_t_70]: /images/20210920/9f721ae9bea74f1faac8338ebd10a91a.png
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3dlaXhpbl80MzI5MTA1NQ_size_16_color_FFFFFF_t_70 1]: /images/20210920/f28f5f5935984b1fa0e1c1fc8c94dea0.png
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3dlaXhpbl80MzI5MTA1NQ_size_16_color_FFFFFF_t_70 2]: /images/20210920/1fa6af8e9c204c70bade7df2a4b3e374.png
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3dlaXhpbl80MzI5MTA1NQ_size_16_color_FFFFFF_t_70 3]: /images/20210920/1f79b2cbc00b4cfe9e820b31c49250e6.png
[20200522093339122.png]: /images/20210920/4c093280d2f24c89a870ad4038153019.png
[http_localhost_50070]: http://localhost:50070/
[https_www.cnblogs.com_Hephaestus_p_12061581.html]: https://www.cnblogs.com/Hephaestus/p/12061581.html
[https_www.linuxidc.com_Linux_2017-01_140050.htm]: https://www.linuxidc.com/Linux/2017-01/140050.htm
[https_my.oschina.net_u_1456911_blog_685078]: https://my.oschina.net/u/1456911/blog/685078