Install Hadoop on Ubuntu with two computers

「爱情、让人受尽委屈。」 2022-02-12 13:43 221阅读 0赞

This post is about the installation of Hadoop on Ubuntu with two computers. The system environment is Ubuntu 12.04, JDK 6, Hadoop 1.0.3. The information of two computers detail as follow:

<table style="height:78px; width:549px"> 
 <tbody> 
  <tr> 
   <td>hostname</td> 
   <td>IP address</td> 
   <td>Role</td> 
  </tr> 
  <tr> 
   <td>master</td> 
   <td>192.168.0.10</td> 
   <td>Namenode, Jobtracker, SecondaryNameNode</td> 
  </tr> 
  <tr> 
   <td>slave01</td> 
   <td>192.168.0.11</td> 
   <td>Datanode, Tasktracker</td> 
  </tr> 
 </tbody> 
</table>

Supposing that the hadoop is installed, detail information : [ http://blog.csdn.net/hero\_hegang/article/details/8910438][http_blog.csdn.net_hero_hegang_article_details_8910438].

Copying the virtual machine with hadoop to other physical machine. You had better configure the static IP address.

**Step 1: modify the hosts mapping**

$ sudo vi /etc/hosts

\#type and add the contents as follows:

192.168.0.10 master
    192.168.0.11 slave01

**Step 2: modify the hostname**

$ sudo vi /etc/hostname

\#type and add the contents respectively as follows:

\# the hostname of 192.168.0.10 is master.

\# the hostname of 192.168.0.11 is slave01.

**Step 3: test the ssh in master shell**

$ ssh slave01

\#If you don't enter the password, configure successfully.

**Step 4: modify the hadoop configure file in master and slave with same confiurations**

\# modify  core-site.xml, mapred-site.xml,masters, slaves as follows:

\# modify the property fs.default.name tohdfs://master:9000 in core-site.xml.

\# modify the property mapred.job.tracker to master:9001 in core-site.xml.

\# modify the content of masters file to master.

\# modify the content of slaves file to slave01.

**Step 5: delete the contents of directory of dfs.data.dir in hdfs-site.xml in master and slave machines**

$sudo rm -r /home/hadoop/data1/*
    
    $sudo rm -r /home/hadoop/data2/*

**Step 6: close the firewall in master and slave machines**

$ sudo ufw disable

**Step 7: reformat the namenode in master**

$ bin/hadoop namenode -format

**Step 8: see the process in masters and slave machines**

$ jps
    
    $ ssh slave01
    
    $ jps

**Step 9: see the report of hadoop**

$ bin/hadoop dfsadmin -report

![20130523153625712][]

[http_blog.csdn.net_hero_hegang_article_details_8910438]: http://blog.csdn.net/hero_hegang/article/details/8910438
[20130523153625712]: /images/20220212/bb112898d5d744b6a495ca6447d9bf75.png