HDFS漫画

灰太狼 2022-05-21 13:46 172阅读 0赞

http://blog.chinaunix.net/uid-27105712-id-3274395.html

分布式文件系统比较出名的有HDFS 和 GFS，其中HDFS比较简单一点。本文是一篇描述非常简洁易懂的漫画形式讲解HDFS的原理。比一般PPT要通俗易懂很多。不难得的学习资料。

1、三个部分: 客户端、nameserver（可理解为主控和文件索引类似linux的inode）、datanode（存放实际数据的存server）

[![image][]][image 1]

2、如何写数据过程

[![image][image 2]][image_image 2]

[![image][image 3]][image_image 3]

[![image][image 4]][image_image 4]

3、读取数据过程

[![image][image 5]][image_image 5]

4、容错：第一部分：故障类型及其检测方法（nodeserver 故障，和网络故障，和脏数据问题）

[![image][image 6]][image_image 6]

[![image][image 7]][image_image 7]

5、容错第二部分：读写容错

[![image][image 8]][image_image 8]

6、容错第三部分：dataNode 失效

[![image][image 9]][image_image 9]

7、备份规则

[![image][image 10]][image_image 10]

8、结束语

[![image][image 11]][image_image 11]

[image]: http://blog.chinaunix.net/attachment/201207/14/27105712_1342275494fwjW.png
[image 1]: http://blog.chinaunix.net/attachment/201207/14/27105712_1342275491EUuz.png
[image 2]: http://blog.chinaunix.net/attachment/201207/14/27105712_1342275503C707.png
[image_image 2]: http://blog.chinaunix.net/attachment/201207/14/27105712_1342275498Z1oo.png
[image 3]: http://blog.chinaunix.net/attachment/201207/14/27105712_13422755124jZ4.png
[image_image 3]: http://blog.chinaunix.net/attachment/201207/14/27105712_1342275507R78E.png
[image 4]: http://blog.chinaunix.net/attachment/201207/14/27105712_13422755190MI6.png
[image_image 4]: http://blog.chinaunix.net/attachment/201207/14/27105712_1342275516IB54.png
[image 5]: http://blog.chinaunix.net/attachment/201207/14/27105712_1342275531HHQ6.png
[image_image 5]: http://blog.chinaunix.net/attachment/201207/14/27105712_1342275526ud42.png
[image 6]: http://blog.chinaunix.net/attachment/201207/14/27105712_1342275547E33k.png
[image_image 6]: http://blog.chinaunix.net/attachment/201207/14/27105712_1342275539Te06.png
[image 7]: http://blog.chinaunix.net/attachment/201207/14/27105712_1342275559488f.png
[image_image 7]: http://blog.chinaunix.net/attachment/201207/14/27105712_13422755514VTl.png
[image 8]: http://blog.chinaunix.net/attachment/201207/14/27105712_1342275570VqbB.png
[image_image 8]: http://blog.chinaunix.net/attachment/201207/14/27105712_13422755647m0M.png
[image 9]: http://blog.chinaunix.net/attachment/201207/14/27105712_134227558030Ek.png
[image_image 9]: http://blog.chinaunix.net/attachment/201207/14/27105712_13422755744TT0.png
[image 10]: http://blog.chinaunix.net/attachment/201207/14/27105712_1342275597rqxO.png
[image_image 10]: http://blog.chinaunix.net/attachment/201207/14/27105712_13422755887K2V.png
[image 11]: http://blog.chinaunix.net/attachment/201207/14/27105712_1342275603yedb.png
[image_image 11]: http://blog.chinaunix.net/attachment/201207/14/27105712_1342275600Tfg3.png