Netflix Conductor fork 扩展

待我称王封你为后i 2022-05-26 23:42 206阅读 0赞

#  #

定义：调度并行任务集

参数：

<table style="margin:0px;padding:0px;">     
 <thead style="margin-top:0px;width:577px;"> 
  <tr> 
   <th style="padding:7px 15px 7px 10px;vertical-align:top;min-width:8px;background:rgb(240,240,240) no-repeat right center;color:rgb(51,51,51);"> 
    <div style="margin:0px;padding:0px;">
      名称 
    </div></th> 
   <th style="padding:7px 15px 7px 10px;vertical-align:top;min-width:8px;background:rgb(240,240,240) no-repeat right center;color:rgb(51,51,51);"> 
    <div style="margin:0px;padding:0px;">
      描述 
    </div></th> 
  </tr> 
 </thead> 
 <tbody> 
  <tr> 
   <td style="padding:7px 10px;vertical-align:top;min-width:8px;"><span style="color:rgb(64,64,64);">forkTasks</span></td> 
   <td style="padding:7px 10px;vertical-align:top;min-width:8px;">任务列表。每一个子列表并行执行，子列表中的任务是以串行方式进行执行的</td> 
  </tr> 
 </tbody> 
</table>

例子：

{
      "name": "fork_join",
      "taskReferenceName": "forkx",
      "type": "FORK_JOIN",
      "forkTasks": [
        [
          {
            "name": "task_10",
            "taskReferenceName": "task_10",
            "type": "SIMPLE"
          },
          {
            "name": "sub_workflow_x",
            "taskReferenceName": "wf3",
            "inputParameters": {
              "mod": "${task_1.output.mod}",
              "oddEven": "${task_1.output.oddEven}"
            },
            "type": "SUB_WORKFLOW",
            "subWorkflowParam": {
              "name": "sub_flow_1",
              "version": 1
            }
          }
        ],
        [
          {
            "name": "task_11",
            "taskReferenceName": "task_11",
            "type": "SIMPLE"
          },
          {
            "name": "sub_workflow_x",
            "taskReferenceName": "wf4",
            "inputParameters": {
              "mod": "${task_1.output.mod}",
              "oddEven": "${task_1.output.oddEven}"
            },
            "type": "SUB_WORKFLOW",
            "subWorkflowParam": {
              "name": "sub_flow_1",
              "version": 1
            }
          }
        ]
      ]
    }

当执行时；task10和task11同时执行

![image2018-4-4_16-36-52.png_version_1_modificationDate_1522829367000_api_v2][]

如果并行的数量不明确，则需要使用动态fork

# 动态fork #

定义：和FORK\_JOIN 任务功能类似，需要并行的数量不确定时使用

参数

<table style="margin:0px;width:620px;padding:0px;">     
 <thead style="margin-top:0px;width:620px;"> 
  <tr> 
   <th style="padding:7px 15px 7px 10px;vertical-align:top;min-width:8px;background:rgb(240,240,240) no-repeat right center;color:rgb(51,51,51);"> 
    <div style="margin:0px;padding:0px;">
      名称 
    </div></th> 
   <th style="padding:7px 15px 7px 10px;vertical-align:top;min-width:8px;background:rgb(240,240,240) no-repeat right center;color:rgb(51,51,51);"> 
    <div style="margin:0px;padding:0px;">
      描述 
    </div></th> 
  </tr> 
 </thead> 
 <tbody> 
  <tr> 
   <td style="padding:7px 10px;vertical-align:top;min-width:8px;"><span style="color:rgb(64,64,64);">dynamicForkTasksParam</span></td> 
   <td style="padding:7px 10px;vertical-align:top;min-width:8px;">并行执行工作流任务配置列表参数的名称</td> 
  </tr> 
  <tr> 
   <td colspan="1" style="padding:7px 10px;vertical-align:top;min-width:8px;"><span style="color:rgb(64,64,64);">dynamicForkTasksInputParamName<br></span></td> 
   <td colspan="1" style="padding:7px 10px;vertical-align:top;min-width:8px;">参数的名称该参数的值映射入如参数的名称，作为fork任务的引用名称和值</td> 
  </tr> 
 </tbody> 
</table>

例子：

{
      "inputParameters": {
         "dynamicTasks": "${taskA.output.dynamicTasksJSON}",
         "dynamicTasksInput": "${taskA.output.dynamicTasksInputJSON}"
      }
      "type": "FORK_JOIN_DYNAMIC",
      "dynamicForkTasksParam": "dynamicTasks",
      "dynamicForkTasksInputParamName": "dynamicTasksInput"
    }

dynamicForkTasksInputParamName 引用inputParameters的值

包含的taskA如下

{
      "dynamicTasksInputJSON": {
        "forkedTask1": {
          "width": 100,
          "height": 100,
          "params": {
            "recipe": "jpg"
          }
        },
        "forkedTask2": {
          "width": 200,
          "height": 200,
          "params": {
            "recipe": "jpg"
          }
        }
      },
      "dynamicTasksJSON": [
        {
          "name": "encode_task",
          "taskReferenceName": "forkedTask1",
          "type": "SIMPLE"
        },
        {
          "name": "encode_task",
          "taskReferenceName": "forkedTask2",
          "type": "SIMPLE"
        }
      ]
    }

[image2018-4-4_16-36-52.png_version_1_modificationDate_1522829367000_api_v2]: http://e-proxy.yfb.sunline.cn:8090/download/attachments/13639625/image2018-4-4_16-36-52.png?version=1&modificationDate=1522829367000&api=v2