设置hadoop+安装java环境

布满荆棘的人生 2024-02-29 01:50 24阅读 0赞

[http://t.csdnimg.cn/K3MFS][http_t.csdnimg.cn_K3MFS]

##  ##

## 基本操作 ##

接着上一篇 先导入之前导出的虚拟机

![93dc643b393b4682b6a3bbe616213415.png][]

选择导出到对应的文件夹中

![0dd24b4cf9fe4ec688f6ba2edc536e75.png][]

这里修改一下保存虚拟机的位置（当然你默认也可以）

![5eca522b2d0643a4a86342a1cc277f94.png][]

改一个名字

![a6215d0404464d3385d870bf43533367.png][]

新建一个share文件夹用来存放共享软件的文件夹

![eada93ce912e4ec1ab2fc13cd7d9b70b.png][]

在虚拟机的设置中找到这个设置

![de9a488e00e740dda06200d400f4186c.png][]这样就把需要共享的文件放在一个文件夹，要下载其他软件会快很多，自动挂载就是启动就会加载文件夹里的文件

![2fa663c7f1834e64ac42c8c30cc57d9b.png][] 都按确定之后就可以进行启动,可以看到桌面有个sf\_share就说明配置成功

![030731da9f3c47bc9d8cd970683b67fa.png][]

设置用户并配置权限组

> //从bash这个文件夹启动hadoop
> 
> sudo useradd -m hadoop -s /bin/bash
> 
> 设置hadoop这个账户的密码
> 
> //sudo passwd hadoop
> 
> //增加权限组到sudo组
> 
> sudo adduser hadoop sudo
> 
> //重启一下
> 
> sudo reboot

注意输入sudo useradd -m hadoop -s /bin/bash后他会先让你输入的是账户的密码是1234

之后输入sudo passwd hadoop后 才是输入你要设置的密码，我这里设置为了hadoop

![8ac402a033754e249c149c4f8a530ada.png][] ![ca8e61dc8cad4504aeeeac0b3e2b3ac6.png][]

选择进入到hadoop那个的用户名

![caf708df160c41e5ad03be370b63383f.png][] 更新一下软件源

> sudo apt-get update

![3d911926a2824394a276fdd8ce9d03b8.png][]

输入以下命令删除锁即可

> sudo rm /var/cache/apt/archives/lock  
> sudo rm /var/lib/dpkg/lock

实在不行可以输入sudo reboot重启一下

## 安装vim ##

> sudo apt-get install vim

一路yes即可

![45ced977cbf844918d244b325c216629.png][]

## 安装ssh ##

> sudo apt-get install openssh-server

![698063d9b6c9455f8c4edbd4ba69eeaa.png][]

输入ssh localhost表示连接到ssh进行登录

![e89c39ba1db242dca8d46afa3667d3ba.png][]

hadoop的登录是无感知的 基本这样就算成功了

## ![58ce52aacfca43e5ae0f4755713e730b.png][] ##

也可以输入exit看看是否退出成功来看是否登录成功

![7768222bca3348e9b4001a2af2e17316.png][]

## 设置登录不用密码 ##

先进入到ssh目录中

![42c29848424548618381c90fa7527a9a.png][]

利用ssh的密码生成工具去生成 直接不停回车即可

![4a8c09b582504854bbcdd4d69f157244.png][]

将这个key放到authorized.keys中，可以看到已经存在在里面了

![4ff98a367a3e4d81a9dbcd5e146c64c3.png][]

这时候回到根目录登录就不需要密码了

![6b852c07fba64fcaa281d188bcfab380.png][]

## 下载配置JAVA环境和hadoop环境 ##

先从这个地方下载jdk和hadoop

[Java Archive Downloads - Java SE 8 (oracle.com)][Java Archive Downloads - Java SE 8 _oracle.com]

[Index of /dist/hadoop/common/hadoop-3.1.3 (apache.org)][Index of _dist_hadoop_common_hadoop-3.1.3 _apache.org]

![7ba616144b124a1a9bb558f05982a556.png][]

提示需要账号的可以点击这个

[Oracle公共账号和密码\_oracle账号密码-CSDN博客][Oracle_oracle_-CSDN]

将下载好的文件放入到share文件夹中

![f26c809d54fb487f9e700702284a8dba.png][]

先要设置root的密码这里我设置为了1234，然后通过su root这个命令切换到root这个用户

![fcf218cda4bf47d58e03e755893d8245.png][]

将jdk和hadoop从/media/sf\_share复制到./中，然后就可以exit退出了

![cf22142fc6b34d7db9b1e3028a90fded.png][]

![25a8f87f4ba24abdbadfaccc33e97373.png][]

在/usr/lib包下 创建jvm包，然后进入到jvm包

![95515f3048954b00924b50d5ac92cbc0.png][]

在里面解压jdk

![78398de5fc944bb18282e5fdca82a46d.png][]

进入到.bashrc编辑信息

![07e98825316c45dea7099ea1dbcb36bb.png][]

这里不熟悉vim命令的可以先去搜搜看 这里不做解释，输入以下信息即可

![c1224ce7611347218db2eca65a9ef316.png][]

source启动一下该文件，然后输入java -version看看是否成功配置![d789c740e5a044f694dde3f98897bd55.png][]

还可以输入env看看环境变量的配置

![6fc66a65d5714caea76ee8793fea70fe.png][]

回到~目录，解压一下hadoop文件

![bda335711d52493292f257e9d88f5c56.png][]

改名

![9359a79a8d5149588c901a39cc77b49e.png][] 修改权限

![58f9809068ce45ba9bf4bb9e8d884e75.png][]

进入到hadoop文件夹查看version是否正确输出

## ![2fe49e87f48c42fa98541b2f6008c2d1.png][] 测试hadoop命令 ##

先创建一个input的输入文件夹 再将hadoop里的文件传入到input下

![1424461721c74cc6a3c8e467e9892065.png][]

用搜索dfs将开头a-z的文件从input输入到output中

![b65bac756e544a49808d98d3cef29b9f.png][]

可以检查到已经有了这个文件

![098dee5eed514eeaa5a61d45f9bed7d9.png][]

然后就可以删除

![da03b0d5f9c34c73bd91087690fc40e7.png][]

[http_t.csdnimg.cn_K3MFS]: http://t.csdnimg.cn/K3MFS
[93dc643b393b4682b6a3bbe616213415.png]: https://image.dandelioncloud.cn/pgy_files/images/2024/02/29/484bb0ac8f95410b9e08d635f835397e.png
[0dd24b4cf9fe4ec688f6ba2edc536e75.png]: https://image.dandelioncloud.cn/pgy_files/images/2024/02/29/b27e1f75c95f4252acd41e653e3ec5f9.png
[5eca522b2d0643a4a86342a1cc277f94.png]: https://image.dandelioncloud.cn/pgy_files/images/2024/02/29/bc08712e148c4d1da367b3fc0665fb99.png
[a6215d0404464d3385d870bf43533367.png]: https://image.dandelioncloud.cn/pgy_files/images/2024/02/29/68efa2188dfc4e6ab41cf1e65defd455.png
[eada93ce912e4ec1ab2fc13cd7d9b70b.png]: https://image.dandelioncloud.cn/pgy_files/images/2024/02/29/0b821aafa0094e8fb95b4a88565fed43.png
[de9a488e00e740dda06200d400f4186c.png]: https://image.dandelioncloud.cn/pgy_files/images/2024/02/29/6e3eadfc887d49d08ff8c39aa843bdab.png
[2fa663c7f1834e64ac42c8c30cc57d9b.png]: https://image.dandelioncloud.cn/pgy_files/images/2024/02/29/8eeb04c1c79547f1b7cf5ccf53565f27.png
[030731da9f3c47bc9d8cd970683b67fa.png]: https://image.dandelioncloud.cn/pgy_files/images/2024/02/29/3d61489304ff48f199644c5da8089fd8.png
[8ac402a033754e249c149c4f8a530ada.png]: https://img-blog.csdnimg.cn/8ac402a033754e249c149c4f8a530ada.png
[ca8e61dc8cad4504aeeeac0b3e2b3ac6.png]: https://image.dandelioncloud.cn/pgy_files/images/2024/02/29/8a30fd18e3fd479c802aad8fa03f9394.png
[caf708df160c41e5ad03be370b63383f.png]: https://image.dandelioncloud.cn/pgy_files/images/2024/02/29/28e5b985fd864085ad30df3409ed5b0d.png
[3d911926a2824394a276fdd8ce9d03b8.png]: https://image.dandelioncloud.cn/pgy_files/images/2024/02/29/ef1c99b7626a4707b5838b688a302a5a.png
[45ced977cbf844918d244b325c216629.png]: https://image.dandelioncloud.cn/pgy_files/images/2024/02/29/bbfe0d9746284646bb2b5e69cff47a3f.png
[698063d9b6c9455f8c4edbd4ba69eeaa.png]: https://image.dandelioncloud.cn/pgy_files/images/2024/02/29/14295a4f4ddf4d2b80132cd36dba3723.png
[e89c39ba1db242dca8d46afa3667d3ba.png]: https://image.dandelioncloud.cn/pgy_files/images/2024/02/29/5e3a0ab0623643a4bf9971cef590aa44.png
[58ce52aacfca43e5ae0f4755713e730b.png]: https://image.dandelioncloud.cn/pgy_files/images/2024/02/29/57c03f957af942ad81cd61e5bc16cb39.png
[7768222bca3348e9b4001a2af2e17316.png]: https://image.dandelioncloud.cn/pgy_files/images/2024/02/29/afdc5336fd184584b4aeefee41339130.png
[42c29848424548618381c90fa7527a9a.png]: https://image.dandelioncloud.cn/pgy_files/images/2024/02/29/013ca7f435cb4fffb8a16e9b4744e1f8.png
[4a8c09b582504854bbcdd4d69f157244.png]: https://image.dandelioncloud.cn/pgy_files/images/2024/02/29/83266ed45262435fa0c5c7d8b1c45c06.png
[4ff98a367a3e4d81a9dbcd5e146c64c3.png]: https://image.dandelioncloud.cn/pgy_files/images/2024/02/29/d6920899a23b4ea28de31223b985ab0b.png
[6b852c07fba64fcaa281d188bcfab380.png]: https://image.dandelioncloud.cn/pgy_files/images/2024/02/29/792ee8a72d6043cb982d749ea5810684.png
[Java Archive Downloads - Java SE 8 _oracle.com]: https://www.oracle.com/java/technologies/javase/javase8-archive-downloads.html
[Index of _dist_hadoop_common_hadoop-3.1.3 _apache.org]: https://archive.apache.org/dist/hadoop/common/hadoop-3.1.3/
[7ba616144b124a1a9bb558f05982a556.png]: https://image.dandelioncloud.cn/pgy_files/images/2024/02/29/23347a8a05094dd9a02428f0d93b3bb1.png
[Oracle_oracle_-CSDN]: https://blog.csdn.net/AReallyMan/article/details/89429673
[f26c809d54fb487f9e700702284a8dba.png]: https://image.dandelioncloud.cn/pgy_files/images/2024/02/29/881fbd435bd940218f19d52d9cbeb572.png
[fcf218cda4bf47d58e03e755893d8245.png]: https://image.dandelioncloud.cn/pgy_files/images/2024/02/29/a49e8ade56824de29fb0a899476a90e1.png
[cf22142fc6b34d7db9b1e3028a90fded.png]: https://image.dandelioncloud.cn/pgy_files/images/2024/02/29/f2b1534de4fe45eca5847e7507577eaf.png
[25a8f87f4ba24abdbadfaccc33e97373.png]: https://image.dandelioncloud.cn/pgy_files/images/2024/02/29/b3ba1564542c4834bf973e67561c1518.png
[95515f3048954b00924b50d5ac92cbc0.png]: https://image.dandelioncloud.cn/pgy_files/images/2024/02/29/f0f3f2034ab44b6ca6ae71309d2d7300.png
[78398de5fc944bb18282e5fdca82a46d.png]: https://image.dandelioncloud.cn/pgy_files/images/2024/02/29/6a2c2edcaceb4fff8cad40e16be85c74.png
[07e98825316c45dea7099ea1dbcb36bb.png]: https://image.dandelioncloud.cn/pgy_files/images/2024/02/29/4ca98b372ad047b1b26081d9bf9710f8.png
[c1224ce7611347218db2eca65a9ef316.png]: https://image.dandelioncloud.cn/pgy_files/images/2024/02/29/811bc5faad3c43479def80637a7cfba7.png
[d789c740e5a044f694dde3f98897bd55.png]: https://image.dandelioncloud.cn/pgy_files/images/2024/02/29/647c99a0626e429d90eaeb8a24a94ce0.png
[6fc66a65d5714caea76ee8793fea70fe.png]: https://image.dandelioncloud.cn/pgy_files/images/2024/02/29/5ef3d5414e1f4092948facd6a23e41bc.png
[bda335711d52493292f257e9d88f5c56.png]: https://image.dandelioncloud.cn/pgy_files/images/2024/02/29/911cd07a6d3d40009ee13f67ab93dc02.png
[9359a79a8d5149588c901a39cc77b49e.png]: https://image.dandelioncloud.cn/pgy_files/images/2024/02/29/03a9fe61d8fe4525a258d375f78bceeb.png
[58f9809068ce45ba9bf4bb9e8d884e75.png]: https://image.dandelioncloud.cn/pgy_files/images/2024/02/29/d0963a15d63c4201af831b1bbf438138.png
[2fe49e87f48c42fa98541b2f6008c2d1.png]: https://image.dandelioncloud.cn/pgy_files/images/2024/02/29/f218a48464214705b77e892d9686a71a.png
[1424461721c74cc6a3c8e467e9892065.png]: https://image.dandelioncloud.cn/pgy_files/images/2024/02/29/5d6e59f068e34f5a976424e59f2f8f8e.png
[b65bac756e544a49808d98d3cef29b9f.png]: https://image.dandelioncloud.cn/pgy_files/images/2024/02/29/0ace21a64f1446eeb52da59f91f426b0.png
[098dee5eed514eeaa5a61d45f9bed7d9.png]: https://image.dandelioncloud.cn/pgy_files/images/2024/02/29/4aeb5c205e7f411284373ae6f469cdff.png
[da03b0d5f9c34c73bd91087690fc40e7.png]: https://image.dandelioncloud.cn/pgy_files/images/2024/02/29/1b83545f73364947bd78336af109c3da.png