ambari Capacity Scheduler 调度排序策略

r囧r小猫 2023-05-30 15:56 15阅读 0赞

在amabri中，设置Capacity Scheduler 的调度排序策略如下图  
![在这里插入图片描述][watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3dlaXhpbl8zODc1MTUxMw_size_16_color_FFFFFF_t_70]  
![在这里插入图片描述][watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3dlaXhpbl8zODc1MTUxMw_size_16_color_FFFFFF_t_70 1]  
![在这里插入图片描述][watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3dlaXhpbl8zODc1MTUxMw_size_16_color_FFFFFF_t_70 2]  
![在这里插入图片描述][watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3dlaXhpbl8zODc1MTUxMw_size_16_color_FFFFFF_t_70 3]  
若通过配置文件设置为：  
capacity-scheduler.xml文件下

<property>
      <name>yarn.scheduler.capacity.<queue-path>.ordering-policy</name>
      <value>fair</value>
    </property>

Capacity Scheduler中的默认排序策略是FIFO（先进先出）。FIFO通常可以很好地用于可预测的周期性批处理作业。但有时对于按需或探索性工作负载而言效果不佳。对于这些类型的工作，公平共享通常是更好的选择。灵活的调度策略使您可以在每个队列的基础上为不同类型的工作负载分配FIFO或公平排序策略。

官方教程地址为：  
https://docs.cloudera.com/HDPDocuments/HDP2/HDP-2.3.4/bk\_yarn\_resource\_mgt/content/flexible\_scheduling\_policies.html

[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3dlaXhpbl8zODc1MTUxMw_size_16_color_FFFFFF_t_70]: https://img-blog.csdnimg.cn/20191111105403430.png?x-oss-process=image/watermark,type_ZmFuZ3poZW5naGVpdGk,shadow_10,text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3dlaXhpbl8zODc1MTUxMw==,size_16,color_FFFFFF,t_70
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3dlaXhpbl8zODc1MTUxMw_size_16_color_FFFFFF_t_70 1]: https://img-blog.csdnimg.cn/20191111105420263.png?x-oss-process=image/watermark,type_ZmFuZ3poZW5naGVpdGk,shadow_10,text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3dlaXhpbl8zODc1MTUxMw==,size_16,color_FFFFFF,t_70
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3dlaXhpbl8zODc1MTUxMw_size_16_color_FFFFFF_t_70 2]: https://img-blog.csdnimg.cn/20191111105453954.png?x-oss-process=image/watermark,type_ZmFuZ3poZW5naGVpdGk,shadow_10,text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3dlaXhpbl8zODc1MTUxMw==,size_16,color_FFFFFF,t_70
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3dlaXhpbl8zODc1MTUxMw_size_16_color_FFFFFF_t_70 3]: https://img-blog.csdnimg.cn/20191111105503157.png?x-oss-process=image/watermark,type_ZmFuZ3poZW5naGVpdGk,shadow_10,text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3dlaXhpbl8zODc1MTUxMw==,size_16,color_FFFFFF,t_70