Hadoop3.2.x HDFS源码分析目录汇总 [完结]

拼搏现实的明天。 2022-12-10 14:56 192阅读 0赞

[Hadoop3.2.0 源码编译 \[ 一 \]][Hadoop3.2.0 _ _ _]

[Hadoop3.2.0 源码编译 \[ 二 \]][Hadoop3.2.0 _ _ _ 1]

[Hadoop3.2.0 源码分析: SHELL启动脚本 DEBUG 模式][Hadoop3.2.0 _ SHELL_ DEBUG]

[Hadoop3.2.0 源码分析: namenode 启动][Hadoop3.2.0 _ namenode]

[Hadoop3.2.0 源码分析: datanode 启动][Hadoop3.2.0 _ datanode]

[Hadoop3.2.0 源码分析: ResourceManager启动][Hadoop3.2.0 _ ResourceManager]

[Hadoop3.2.0 源码分析: NodeManager][Hadoop3.2.0 _ NodeManager]

[Hadoop3.2.0 源码分析: Container 之 DefaultContainerExecutor 与 LinuxContainerExecutor][Hadoop3.2.0 _ Container _ DefaultContainerExecutor _ LinuxContainerExecutor]

[Hadoop3.2.0 源码分析: ResourceManager 调度 CapacityScheduler 理论][Hadoop3.2.0 _ ResourceManager _ CapacityScheduler]

[Hadoop3.2.0 源码分析: ResourceManager 调度 CapacityScheduler][Hadoop3.2.0 _ ResourceManager _ CapacityScheduler 1]

\-----------------------------------------------------------------------------------------------------------------------

**RPC系列**

[Hadoop3.2.1 【 HDFS 】源码分析 : RPC实现 \[一\] proto接口协议][Hadoop3.2.1 _ HDFS _ _ RPC_ _ proto]

[Hadoop3.2.1 【 HDFS 】源码分析 : RPC实现 \[二\] 概述&使用][Hadoop3.2.1 _ HDFS _ _ RPC_ _]

[Hadoop3.2.1 【 HDFS 】源码分析 : RPC原理 \[三\] 概述&原理][Hadoop3.2.1 _ HDFS _ _ RPC_ _ 1]

[Hadoop3.2.1 【 HDFS 】源码分析 : RPC原理 \[四\] RpcEngine父类][Hadoop3.2.1 _ HDFS _ _ RPC_ _ RpcEngine]

[Hadoop3.2.1 【 HDFS 】源码分析 : RPC原理 \[五\] WritableRpcEngine 使用][Hadoop3.2.1 _ HDFS _ _ RPC_ _ WritableRpcEngine]

[Hadoop3.2.1 【 HDFS 】源码分析 : RPC原理 \[六\] ProtobufRpcEngine 使用][Hadoop3.2.1 _ HDFS _ _ RPC_ _ ProtobufRpcEngine]

[Hadoop3.2.1 【 HDFS 】源码分析 : RPC原理 \[七\] Server端实现&源码][Hadoop3.2.1 _ HDFS _ _ RPC_ _ Server]

[Hadoop3.2.1 【 HDFS 】源码分析 : RPC原理 \[八\] Client端实现&源码][Hadoop3.2.1 _ HDFS _ _ RPC_ _ Client]

[Hadoop3.2.1 【 HDFS 】源码分析 : RPC原理 \[九\] RPC 请求格式][Hadoop3.2.1 _ HDFS _ _ RPC_ _ RPC]

\-----------------------------------------------------------------------------------------------------------------------

**NameNode系列**

[Hadoop3.2.1 【 HDFS 】源码分析 : Namenode\[非HA\]启动解析][Hadoop3.2.1 _ HDFS _ _ Namenode_HA]

[Hadoop3.2.1 【 HDFS 】源码分析 : NameNode -format 解析][Hadoop3.2.1 _ HDFS _ _ NameNode -format]

[Hadoop3.2.1 【 HDFS 】源码分析 : FileSystem 解析][Hadoop3.2.1 _ HDFS _ _ FileSystem]

[Hadoop3.2.1 【 HDFS 】源码分析 : INode相关类/接口 解析][Hadoop3.2.1 _ HDFS _ _ INode_]

[Hadoop3.2.1 【 HDFS 】源码分析 :FSEditLog 解析][Hadoop3.2.1 _ HDFS _ _FSEditLog]

[Hadoop3.2.1 【 HDFS 】源码分析 : 文件系统FSImage解析][Hadoop3.2.1 _ HDFS _ _ _FSImage]

[Hadoop3.2.1 【 HDFS 】源码分析 : BlocksMap解析][Hadoop3.2.1 _ HDFS _ _ BlocksMap]

[Hadoop3.2.1 【 HDFS 】源码分析 :FSDirectory类解析][Hadoop3.2.1 _ HDFS _ _FSDirectory]

[Hadoop3.2.1 【 HDFS 】源码分析 : Secondary Namenode解析][Hadoop3.2.1 _ HDFS _ _ Secondary Namenode]

[Hadoop3.2.1 【 HDFS 】源码分析 : Standby Namenode解析][Hadoop3.2.1 _ HDFS _ _ Standby Namenode]

[Hadoop3.2.1 【 HDFS 】源码分析 :数据块管理解析][Hadoop3.2.1 _ HDFS _]

[Hadoop3.2.1 【 HDFS 】源码分析 :BlockManager解析 \[一\]][Hadoop3.2.1 _ HDFS _ _BlockManager_]

[Hadoop3.2.1 【 HDFS 】源码分析 :BlockManager解析 \[二\]][Hadoop3.2.1 _ HDFS _ _BlockManager_ 1]

[Hadoop3.2.1 【 HDFS 】源码分析 : LeaseManager解析][Hadoop3.2.1 _ HDFS _ _ LeaseManager]

[Hadoop3.2.1 【 HDFS 】源码分析 : CacheManager解析][Hadoop3.2.1 _ HDFS _ _ CacheManager]

[Hadoop3.2.1 【 HDFS 】源码分析 : block放置策略][Hadoop3.2.1 _ HDFS _ _ block]

[Hadoop3.2.1 【 HDFS 】源码分析 : ZKFailoverController解析][Hadoop3.2.1 _ HDFS _ _ ZKFailoverController]

\-----------------------------------------------------------------------------------------------------------------------

**DataNode系列**

[Hadoop3.2.1 【 HDFS 】源码分析 : Datanode 启动][Hadoop3.2.1 _ HDFS _ _ Datanode]

[Hadoop3.2.1 【 HDFS 】源码分析 : Datanode 存储\[一\]][Hadoop3.2.1 _ HDFS _ _ Datanode 1]

[Hadoop3.2.1 【 HDFS 】源码分析 : Datanode 存储\[二\]][Hadoop3.2.1 _ HDFS _ _ Datanode 2]

[Hadoop3.2.1 【 HDFS 】源码分析 : Datanode升级、回滚、提交][Hadoop3.2.1 _ HDFS _ _ Datanode 3]

[Hadoop3.2.1 【 HDFS 】源码分析 : 文件系统数据集 \[一\]][Hadoop3.2.1 _ HDFS _ _ _]

[Hadoop3.2.1 【 HDFS 】源码分析 : 文件系统数据集 \[二\]][Hadoop3.2.1 _ HDFS _ _ _ 1]

[Hadoop3.2.1 【 HDFS 】源码分析 : 文件系统数据集 \[三\]][Hadoop3.2.1 _ HDFS _ _ _ 2]

[Hadoop3.2.1 【 HDFS 】源码分析 : ReplicaInfo 解析][Hadoop3.2.1 _ HDFS _ _ ReplicaInfo]

[Hadoop3.2.1 【 HDFS 】源码分析 : FsDatasetCache 缓存操作方法][Hadoop3.2.1 _ HDFS _ _ FsDatasetCache]

[Hadoop3.2.1 【 HDFS 】源码分析 : BPServiceActor 解析][Hadoop3.2.1 _ HDFS _ _ BPServiceActor]

[Hadoop3.2.1 【 HDFS 】源码分析 : BPOfferService 解析][Hadoop3.2.1 _ HDFS _ _ BPOfferService]

[Hadoop3.2.1 【 HDFS 】源码分析 : BlockPoolManager 解析][Hadoop3.2.1 _ HDFS _ _ BlockPoolManager]

[Hadoop3.2.1 【 HDFS 】源码分析 : DataTransferProtocol解析][Hadoop3.2.1 _ HDFS _ _ DataTransferProtocol]

[Hadoop3.2.1 【 HDFS 】源码分析 Sender和Receiver解析][Hadoop3.2.1 _ HDFS _ Sender_Receiver]

[Hadoop3.2.1 【 HDFS 】源码分析 : DataXceiverServer 解析][Hadoop3.2.1 _ HDFS _ _ DataXceiverServer]

[Hadoop3.2.1 【 HDFS 】源码分析 : DataXceiver 解析 \[一\]][Hadoop3.2.1 _ HDFS _ _ DataXceiver _]

[Hadoop3.2.1 【 HDFS 】源码分析 : DataXceiver: 读取数据块 解析 \[二\]][Hadoop3.2.1 _ HDFS _ _ DataXceiver_ _ _]

[Hadoop3.2.1 【 HDFS 】源码分析 : 零拷贝数据传输][Hadoop3.2.1 _ HDFS _ _]

[Hadoop3.2.1 【 HDFS 】源码分析 : DataTransferThrottler\[限流\] 解析][Hadoop3.2.1 _ HDFS _ _ DataTransferThrottler_]

[Hadoop3.2.1 【 HDFS 】源码分析 : 写数据][Hadoop3.2.1 _ HDFS _ _ 1]

[Hadoop3.2.1 【 HDFS 】源码分析 : BlockScanner & VolumeScanner 实现][Hadoop3.2.1 _ HDFS _ _ BlockScanner _ VolumeScanner]

[Hadoop3.2.1 【 HDFS 】源码分析 : DirectoryScanner 实现][Hadoop3.2.1 _ HDFS _ _ DirectoryScanner]

\-----------------------------------------------------------------------------------------------------------------------

[为什么HDFS文件块（block）大小设定为128M解析.][HDFS_block_128M_.]

[怎么做 HDFS 的原地平滑缩容？][HDFS]

[Hadoop3.2.1 【 HDFS 】源码分析 : 如果通过blockId确定物理存储位置][Hadoop3.2.1 _ HDFS _ _ _blockId]

\-----------------------------------------------------------------------------------------------------------------------

todo list:

发送block 和发送 packet的头信息计算方式需要整理.

机架感知\[DFSNetworkTopology  /  NetworkTopology\]

\-----------------------------------------------------------------------------------------------------------------------

未完结, 持续更新中............

参考:  
Hadoop 2.X HDFS源码剖析 -- 徐鹏

[Hadoop3.2.0 _ _ _]: https://zhangboyi.blog.csdn.net/article/details/89266116
[Hadoop3.2.0 _ _ _ 1]: https://zhangboyi.blog.csdn.net/article/details/89388958
[Hadoop3.2.0 _ SHELL_ DEBUG]: https://zhangboyi.blog.csdn.net/article/details/89477053
[Hadoop3.2.0 _ namenode]: https://zhangboyi.blog.csdn.net/article/details/89474691
[Hadoop3.2.0 _ datanode]: https://zhangboyi.blog.csdn.net/article/details/89478776
[Hadoop3.2.0 _ ResourceManager]: https://zhangboyi.blog.csdn.net/article/details/89371667
[Hadoop3.2.0 _ NodeManager]: https://zhangboyi.blog.csdn.net/article/details/89377675
[Hadoop3.2.0 _ Container _ DefaultContainerExecutor _ LinuxContainerExecutor]: https://zhangboyi.blog.csdn.net/article/details/89380307
[Hadoop3.2.0 _ ResourceManager _ CapacityScheduler]: https://zhangboyi.blog.csdn.net/article/details/89471225
[Hadoop3.2.0 _ ResourceManager _ CapacityScheduler 1]: https://zhangboyi.blog.csdn.net/article/details/89376137
[Hadoop3.2.1 _ HDFS _ _ RPC_ _ proto]: https://zhangboyi.blog.csdn.net/article/details/105586527
[Hadoop3.2.1 _ HDFS _ _ RPC_ _]: https://zhangboyi.blog.csdn.net/article/details/105591336
[Hadoop3.2.1 _ HDFS _ _ RPC_ _ 1]: https://zhangboyi.blog.csdn.net/article/details/105607870
[Hadoop3.2.1 _ HDFS _ _ RPC_ _ RpcEngine]: https://zhangboyi.blog.csdn.net/article/details/105608092
[Hadoop3.2.1 _ HDFS _ _ RPC_ _ WritableRpcEngine]: https://zhangboyi.blog.csdn.net/article/details/105629868
[Hadoop3.2.1 _ HDFS _ _ RPC_ _ ProtobufRpcEngine]: https://zhangboyi.blog.csdn.net/article/details/105630023
[Hadoop3.2.1 _ HDFS _ _ RPC_ _ Server]: https://zhangboyi.blog.csdn.net/article/details/105634160
[Hadoop3.2.1 _ HDFS _ _ RPC_ _ Client]: https://zhangboyi.blog.csdn.net/article/details/105669375
[Hadoop3.2.1 _ HDFS _ _ RPC_ _ RPC]: https://zhangboyi.blog.csdn.net/article/details/105769434
[Hadoop3.2.1 _ HDFS _ _ Namenode_HA]: https://zhangboyi.blog.csdn.net/article/details/108416995
[Hadoop3.2.1 _ HDFS _ _ NameNode -format]: https://zhangboyi.blog.csdn.net/article/details/108422723
[Hadoop3.2.1 _ HDFS _ _ FileSystem]: https://zhangboyi.blog.csdn.net/article/details/108309109
[Hadoop3.2.1 _ HDFS _ _ INode_]: https://zhangboyi.blog.csdn.net/article/details/108444416
[Hadoop3.2.1 _ HDFS _ _FSEditLog]: https://zhangboyi.blog.csdn.net/article/details/108469062
[Hadoop3.2.1 _ HDFS _ _ _FSImage]: https://zhangboyi.blog.csdn.net/article/details/108444392
[Hadoop3.2.1 _ HDFS _ _ BlocksMap]: https://zhangboyi.blog.csdn.net/article/details/105943610
[Hadoop3.2.1 _ HDFS _ _FSDirectory]: https://zhangboyi.blog.csdn.net/article/details/108860314
[Hadoop3.2.1 _ HDFS _ _ Secondary Namenode]: https://zhangboyi.blog.csdn.net/article/details/108824722
[Hadoop3.2.1 _ HDFS _ _ Standby Namenode]: https://zhangboyi.blog.csdn.net/article/details/108840116
[Hadoop3.2.1 _ HDFS _]: https://zhangboyi.blog.csdn.net/article/details/109018629
[Hadoop3.2.1 _ HDFS _ _BlockManager_]: https://zhangboyi.blog.csdn.net/article/details/109053865
[Hadoop3.2.1 _ HDFS _ _BlockManager_ 1]: https://zhangboyi.blog.csdn.net/article/details/109029370
[Hadoop3.2.1 _ HDFS _ _ LeaseManager]: https://zhangboyi.blog.csdn.net/article/details/109409016
[Hadoop3.2.1 _ HDFS _ _ CacheManager]: https://zhangboyi.blog.csdn.net/article/details/109431962
[Hadoop3.2.1 _ HDFS _ _ block]: https://zhangboyi.blog.csdn.net/article/details/109435228
[Hadoop3.2.1 _ HDFS _ _ ZKFailoverController]: https://zhangboyi.blog.csdn.net/article/details/109442064
[Hadoop3.2.1 _ HDFS _ _ Datanode]: https://zhangboyi.blog.csdn.net/article/details/109508677
[Hadoop3.2.1 _ HDFS _ _ Datanode 1]: https://zhangboyi.blog.csdn.net/article/details/109460115
[Hadoop3.2.1 _ HDFS _ _ Datanode 2]: https://zhangboyi.blog.csdn.net/article/details/109482128
[Hadoop3.2.1 _ HDFS _ _ Datanode 3]: https://zhangboyi.blog.csdn.net/article/details/109586774
[Hadoop3.2.1 _ HDFS _ _ _]: https://zhangboyi.blog.csdn.net/article/details/109589382
[Hadoop3.2.1 _ HDFS _ _ _ 1]: https://zhangboyi.blog.csdn.net/article/details/109610782
[Hadoop3.2.1 _ HDFS _ _ _ 2]: https://zhangboyi.blog.csdn.net/article/details/109625461
[Hadoop3.2.1 _ HDFS _ _ ReplicaInfo]: https://zhangboyi.blog.csdn.net/article/details/109696382
[Hadoop3.2.1 _ HDFS _ _ FsDatasetCache]: https://zhangboyi.blog.csdn.net/article/details/109733740
[Hadoop3.2.1 _ HDFS _ _ BPServiceActor]: https://zhangboyi.blog.csdn.net/article/details/109738535
[Hadoop3.2.1 _ HDFS _ _ BPOfferService]: https://zhangboyi.blog.csdn.net/article/details/109765427
[Hadoop3.2.1 _ HDFS _ _ BlockPoolManager]: https://zhangboyi.blog.csdn.net/article/details/109846974
[Hadoop3.2.1 _ HDFS _ _ DataTransferProtocol]: https://zhangboyi.blog.csdn.net/article/details/109860881
[Hadoop3.2.1 _ HDFS _ Sender_Receiver]: https://zhangboyi.blog.csdn.net/article/details/109860988
[Hadoop3.2.1 _ HDFS _ _ DataXceiverServer]: https://zhangboyi.blog.csdn.net/article/details/109876599
[Hadoop3.2.1 _ HDFS _ _ DataXceiver _]: https://zhangboyi.blog.csdn.net/article/details/109902910
[Hadoop3.2.1 _ HDFS _ _ DataXceiver_ _ _]: https://zhangboyi.blog.csdn.net/article/details/109912960
[Hadoop3.2.1 _ HDFS _ _]: https://zhangboyi.blog.csdn.net/article/details/109989323
[Hadoop3.2.1 _ HDFS _ _ DataTransferThrottler_]: https://zhangboyi.blog.csdn.net/article/details/109991232
[Hadoop3.2.1 _ HDFS _ _ 1]: https://zhangboyi.blog.csdn.net/article/details/109995778
[Hadoop3.2.1 _ HDFS _ _ BlockScanner _ VolumeScanner]: https://zhangboyi.blog.csdn.net/article/details/110112010
[Hadoop3.2.1 _ HDFS _ _ DirectoryScanner]: https://zhangboyi.blog.csdn.net/article/details/110137679
[HDFS_block_128M_.]: https://zhangboyi.blog.csdn.net/article/details/109018998
[HDFS]: https://zhangboyi.blog.csdn.net/article/details/109462008
[Hadoop3.2.1 _ HDFS _ _ _blockId]: https://zhangboyi.blog.csdn.net/article/details/109609903