CDH添加第三方服务的方法

秒速五厘米 2022-03-26 10:16 636阅读 0赞

# 前瞻导读 #

CDH可以很方便的添加一些大数据相关服务，但这仅限于cloudera公司提供。若想将第三方服务（如公司自己开发的组件）添加到CDH集群（托管在CDH上），需要按照一定的规则流程制作相关程序包，最后发布到CDH上。

本文就是指导大家如何打包自己的服务，发布到CDH上，并且由CDH控制服务的运行、监控服务的基本运行状态。

# 制作相关介绍 #

## 名词介绍 ##

parcel:以“.parcel”结尾的gz格式的压缩文件。它必须为一个固定规则的文件名。

命名规则必须如下：

文件名称格式为三段，第一段是包名，第二段是版本号，第三段是运行平台。

例如：FLINK-1.6.0-hadoop\_2.6-scala\_2.11-el7.parcel

包名：FLINK

版本号：1.6.0-hadoop\_2.6-scala\_2.11

运行环境：el7

el6是代表centos6系统，centos7则用el7表示

parcel包内包含了你的服务组件，同时包含一个重要的描述性文件parcel.json：

这个文件记录了你的服务信息，如版本、所属用户、适用的CDH平台版本等

parcel必须包置于/opt/cloudera/parcel-repo/目录下才可以被CDH发布程序时识别到。

csd：csd文件是一个jar包，它记录了你的服务在CDH上的管理规则

如你的服务在CDH页面上显示的图标、依赖的服务、暴露的端口、启动规则等。

csd的jar包必须置于/opt/cloudera/csd/目录才可以在添加集群服务时被识别到。

## 相关下载 ##

> [https://github.com/cloudera/cm\_csds][https_github.com_cloudera_cm_csds]

> [https://github.com/cloudera/cm\_ext][https_github.com_cloudera_cm_ext]

# 制作CDH组件 #

## 整理预发布组件 ##

将你通过测试的服务整理到一个目录内，目录内的子目录结构就是你的工程项目结构，不需要作任何变化。依赖的相关库文件可以由系统环境提供，也可以直接放置在该工程目录下。

任何语言编写的服务都可以托管到CDH。

## 制作flink组件包 ##

### 下载flink包 ###

> [https://archive.apache.org/dist/flink/flink-1.6.0/flink-1.6.0-bin-hadoop26-scala\_2.11.tgz][https_archive.apache.org_dist_flink_flink-1.6.0_flink-1.6.0-bin-hadoop26-scala_2.11.tgz]

### 制作parcel ###

parcel包的根目录结构如下：

![在这里插入图片描述][watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3RvbnlfMzI4NDI3Njg1_size_16_color_FFFFFF_t_70]

parcel包目录结构由你的服务目录(lib/flink)和一个meta目录组成。

meta目录组成文件如下：

![在这里插入图片描述][20190116195624256.png]

flink\_env.sh文件可以声明你的服务运行时的bash环境下的一些变量环境，根据你的服务需要可以自行添加设置。

创建flink\_env.sh文件：

> vi FLINK-1.6.0-hadoop\_2.6-scala\_2.11/meta/flink\_env.sh

FLINK-1.6.0-hadoop\_2.6-scala\_2.11/meta/flink\_env.sh内容:

> \#!/bin/bash  
> FLINK\_DIRNAME=$\{PARCEL\_DIRNAME:-“FLINK-1.6.0-hadoop\_2.6-scala\_2.11”\}  
> export FLINK\_HOME=$PARCELS\_ROOT/$FLINK\_DIRNAME/lib/flink

parcel.json文件需要填写好相关的parcel包名、兼容的CDH平台版本信息。

创建parcel.json文件(parcel包描述)：

> vi FLINK-1.6.0-hadoop\_2.6-scala\_2.11/meta/parcel.json

FLINK-1.6.0-hadoop_2.6-scala_2.11/meta/parcel.json内容：

> \{  
> “schema\_version”: 1,  
> “name”: “FLINK”,  
> “version”: “1.6.0-hadoop\_2.6-scala\_2.11”,  
> “depends”: “CDH (>= 5.2), CDH (<< 6.0)”,  
> “setActiveSymlink”: true,  
> “replaces”: “FLINK”,  
> “scripts”: \{  
> “defines”: “flink\_env.sh”  
> \},  
> “packages”: \[\{  
> “name”: “flink-master”,  
> “version”: “1.6.0+flink1.6.0”  
> \},  
> \{  
> “name”: “flink-worker”,  
> “version”: “1.6.0+flink1.6.0”  
> \}\],  
> “components”: \[\{  
> “name”: “flink”,  
> “version”: “1.6.0-flink1.6.0”,  
> “pkg\_version”: “1.6.0+flink1.6.0”,  
> “pkg\_release”: “hadoop\_2.6-scala\_2.11”  
> \}\],  
> “provides”: \[“flink”\],  
> “users”: \{  
> “flink”: \{  
> “longname”: “Flink”,  
> “home”: “/var/lib/flink”,  
> “shell”: “/bin/bash”,  
> “extra\_groups”: \[\]  
> \}  
> \},  
> “groups”: \[“flink”\]  
> \}

注意：务必注意文件内容的大小写，否则可能造成parcel包无法发布的情况。

创建flink-master.sh文件：

> vi FLINK-1.6.0-hadoop\_2.6-scala\_2.11/lib/flink/bin/flink-master.sh

FLINK-1.6.0-hadoop\_2.6-scala\_2.11/lib/flink/bin/flink-master.sh内容：

> \#!/bin/bash  
> \# Flink Master.  
> USAGE=“Usage: [flink-master.sh][] (start|stop)”  
> bin=\`dirname “$0”\`  
> bin=\`cd “$bin”; pwd\`  
> . “$bin”/config.sh  
> if \[ ! -z “$\{FLINK\_JM\_HEAP\_MB\}” \] && \[ “$\{FLINK\_JM\_HEAP\}” == 0 \]; then  
> echo “used deprecated key \\\`$\{KEY\_JOBM\_MEM\_MB\}\\\`, please replace with  
> key \\\`$\{KEY\_JOBM\_MEM\_SIZE\}\\\`”  
> else  
> flink\_jm\_heap\_bytes=$(parseBytes $\{FLINK\_JM\_HEAP\})  
> FLINK\_JM\_HEAP\_MB=$(getMebiBytes $\{flink\_jm\_heap\_bytes\})  
> fi  
> if \[\[ ! $\{FLINK\_JM\_HEAP\_MB\} =~ $IS\_NUMBER \]\] || \[\[  
> “$\{FLINK\_JM\_HEAP\_MB\}” -lt “0” \]\]; then  
> echo “\[ERROR\] Configured JobManager memory size is not a valid value. Please  
> set ‘$\{KEY\_JOBM\_MEM\_SIZE\}’ in $\{FLINK\_CONF\_FILE\}.”  
> exit 1  
> fi  
> if \[ “$\{FLINK\_JM\_HEAP\_MB\}” -gt “0” \]; then  
> export JVM\_ARGS="$JVM\_ARGS -Xms"$FLINK\_JM\_HEAP\_MB"m  
> \-Xmx"$FLINK\_JM\_HEAP\_MB"m"  
> fi  
> \# Add JobManager-specific JVM options  
> export FLINK\_ENV\_JAVA\_OPTS="$\{FLINK\_ENV\_JAVA\_OPTS\}  
> $\{FLINK\_ENV\_JAVA\_OPTS\_JM\}"  
> \# Startup parameters  
> ARGS=("–configDir" “$\{FLINK\_CONF\_DIR\}” “–executionMode” “cluster”  
> “–host” “$\{FLINK\_MASTER\_HOST\}” “–webui-port” “$\{FLINK\_WEB\_UI\_PORT\}”)  
> echo “FLINK\_MASTER\_HOST: $FLINK\_MASTER\_HOST”  
> echo “FLINK\_WEB\_UI\_PORT: $FLINK\_WEB\_UI\_PORT”  
> echo “FLINK\_LOG\_DIR: $\{FLINK\_LOG\_DIR\}”  
> echo “MASTER\_ARGS: $\{ARGS\[@\]\}”  
> CLASS\_TO\_RUN=org.apache.flink.runtime.entrypoint.StandaloneSessionClusterEntrypoint  
> FLINK\_TM\_CLASSPATH=\`constructFlinkClassPath\`  
> FLINK\_LOG\_PREFIX="$\{FLINK\_LOG\_DIR\}/flink-master"  
> log="$\{FLINK\_LOG\_PREFIX\}.log"  
> out="$\{FLINK\_LOG\_PREFIX\}.out"  
> log\_setting=("-Dlog.file=$\{log\}"  
> “-Dlog4j.configuration=file:$\{FLINK\_CONF\_DIR\}/log4j.properties”  
> “-Dlogback.configurationFile=file:$\{FLINK\_CONF\_DIR\}/logback.xml”)  
> JAVA\_VERSION=$($\{JAVA\_RUN\} -version 2>&1 | sed ‘s/.\*version  
> “\$.\*\$\\.\$.\*\$\\…\*”/\\1\\2/; 1q’)  
> \# Only set JVM 8 arguments if we have correctly extracted the version  
> if \[\[ $\{JAVA\_VERSION\} =~ $\{IS\_NUMBER\} \]\]; then  
> if \[ “$JAVA\_VERSION” -lt 18 \]; then  
> JVM\_ARGS="$JVM\_ARGS -XX:MaxPermSize=256m"  
> fi  
> fi  
> MY\_PID=$(ps -ef | grep “$CLASS\_TO\_RUN” | grep -v grep | awk ‘\{print  
> $2\}’)  
> if \[ “$\{MY\_PID\}” = “” \];then  
> \# Rotate log files  
> rotateLogFilesWithPrefix “$FLINK\_LOG\_DIR” “$FLINK\_LOG\_PREFIX”  
> \# Evaluate user options for local variable expansion  
> FLINK\_ENV\_JAVA\_OPTS=$(eval echo $\{FLINK\_ENV\_JAVA\_OPTS\})  
> CLASS\_PATH=\`manglePathList “$FLINK\_TM\_CLASSPATH:$(hadoop classpath)”\`  
> CLASS\_PATH=$(echo “$\{CLASS\_PATH\}” | sed  
> “s\#”$FLINK\_HOME"/lib/slf4j-log4j12-1.7.7.jar:\#\#g")  
> echo “Starting $DAEMON daemon (pid: $!) on host $HOSTNAME.”  
> exec $JAVA\_RUN $JVM\_ARGS $\{FLINK\_ENV\_JAVA\_OPTS\} “$\{log\_setting\[@\]\}”  
> \-classpath “$\{CLASS\_PATH\}” $\{CLASS\_TO\_RUN\} “$\{ARGS\[@\]\}” > “$out” 2>&1  
> else  
> echo “$DAEMON daemon (pid: $MY\_PID) is running on host $HOSTNAME.”  
> fi

flink-master.sh文件用于启动flink的master管理节点。

注意：flink-master.sh脚本中的exec命令是必须的。

创建flink-worker.sh文件：

> vi FLINK-1.6.0-hadoop\_2.6-scala\_2.11/lib/flink/bin/flink- [worker.sh][]

FLINK-1.6.0-hadoop\_2.6-scala\_2.11/lib/flink/bin/flink- worker.sh内容：

> \#!/bin/bash  
> \#Flink Worker.  
> USAGE=“Usage: [flink-worker.sh][] (start|stop)”  
> OPERATION=$1  
> bin=\`dirname “$0”\`  
> bin=\`cd “$bin”; pwd\`  
> . “$bin”/config.sh  
> \# if memory allocation mode is lazy and no other JVM options are set,  
> \# set the ‘Concurrent Mark Sweep GC’  
> if \[\[ $FLINK\_TM\_MEM\_PRE\_ALLOCATE == “false” \]\] && \[ -z  
> “$\{FLINK\_ENV\_JAVA\_OPTS\}” \] && \[ -z “$\{FLINK\_ENV\_JAVA\_OPTS\_TM\}” \]; then  
> export JVM\_ARGS="$JVM\_ARGS -XX:+UseG1GC"  
> fi  
> if \[ ! -z “$\{FLINK\_TM\_HEAP\_MB\}” \] && \[ “$\{FLINK\_TM\_HEAP\}” == 0 \]; then  
> echo “used deprecated key \\\`$\{KEY\_TASKM\_MEM\_MB\}\\\`, pelase replace with  
> key \\\`$\{KEY\_TASKM\_MEM\_SIZE\}\\\`”  
> else  
> flink\_tm\_heap\_bytes=$(parseBytes $\{FLINK\_TM\_HEAP\})  
> FLINK\_TM\_HEAP\_MB=$(getMebiBytes $\{flink\_tm\_heap\_bytes\})  
> fi  
> if \[\[ ! $\{FLINK\_TM\_HEAP\_MB\} =~ $\{IS\_NUMBER\} \]\] || \[\[  
> “$\{FLINK\_TM\_HEAP\_MB\}” -lt “0” \]\]; then  
> echo “\[ERROR\] Configured TaskManager JVM heap size is not a number. Please  
> set ‘$\{KEY\_TASKM\_MEM\_SIZE\}’ in $\{FLINK\_CONF\_FILE\}.”  
> exit 1  
> fi  
> if \[ “$\{FLINK\_TM\_HEAP\_MB\}” -gt “0” \]; then  
> TM\_HEAP\_SIZE=$(calculateTaskManagerHeapSizeMB)  
> \# Long.MAX\_VALUE in TB: This is an upper bound, much less direct memory will be used  
> TM\_MAX\_OFFHEAP\_SIZE=“8388607T”  
> export JVM\_ARGS="$\{JVM\_ARGS\} -Xms$\{TM\_HEAP\_SIZE\}M -Xmx$\{TM\_HEAP\_SIZE\}M  
> \-XX:MaxDirectMemorySize=$\{TM\_MAX\_OFFHEAP\_SIZE\}"  
> fi  
> \# Add TaskManager-specific JVM options  
> export FLINK\_ENV\_JAVA\_OPTS="$\{FLINK\_ENV\_JAVA\_OPTS\}  
> $\{FLINK\_ENV\_JAVA\_OPTS\_TM\}"  
> \# Startup parameters  
> ARGS=("–configDir" “$\{FLINK\_CONF\_DIR\}”)  
> echo “FLINK\_LOG\_DIR: $\{FLINK\_LOG\_DIR\}”  
> echo “MASTER\_ARGS: $\{ARGS\[@\]\}”  
> CLASS\_TO\_RUN=org.apache.flink.runtime.taskexecutor.TaskManagerRunner  
> FLINK\_TM\_CLASSPATH=\`constructFlinkClassPath\`  
> FLINK\_LOG\_PREFIX="$\{FLINK\_LOG\_DIR\}/flink-worker"  
> log="$\{FLINK\_LOG\_PREFIX\}.log"  
> out="$\{FLINK\_LOG\_PREFIX\}.out"  
> log\_setting=("-Dlog.file=$\{log\}"  
> “-Dlog4j.configuration=file:$\{FLINK\_CONF\_DIR\}/log4j.properties”  
> “-Dlogback.configurationFile=file:$\{FLINK\_CONF\_DIR\}/logback.xml”)  
> JAVA\_VERSION=$($\{JAVA\_RUN\} -version 2>&1 | sed ‘s/.\*version  
> “\$.\*\$\\.\$.\*\$\\…\*”/\\1\\2/; 1q’)  
> \# Only set JVM 8 arguments if we have correctly extracted the version  
> if \[\[ $\{JAVA\_VERSION\} =~ $\{IS\_NUMBER\} \]\]; then  
> if \[ “$JAVA\_VERSION” -lt 18 \]; then  
> JVM\_ARGS="$JVM\_ARGS -XX:MaxPermSize=256m"  
> fi  
> fi  
> MY\_PID=$(ps -ef | grep “$CLASS\_TO\_RUN” | grep -v grep | awk ‘\{print  
> $2\}’)  
> if \[ “$\{MY\_PID\}” = “” \];then  
> \# Rotate log files  
> rotateLogFilesWithPrefix “$FLINK\_LOG\_DIR” “$FLINK\_LOG\_PREFIX”  
> \# Evaluate user options for local variable expansion  
> FLINK\_ENV\_JAVA\_OPTS=$(eval echo $\{FLINK\_ENV\_JAVA\_OPTS\})  
> CLASS\_PATH=\`manglePathList “$FLINK\_TM\_CLASSPATH:$(hadoop classpath)”\`  
> CLASS\_PATH=$(echo “$\{CLASS\_PATH\}” | sed  
> “s\#”$FLINK\_HOME"/lib/slf4j-log4j12-1.7.7.jar:\#\#g")  
> echo “Starting $DAEMON daemon (pid: $!) on host $HOSTNAME.”  
> exec $JAVA\_RUN $JVM\_ARGS $\{FLINK\_ENV\_JAVA\_OPTS\} “$\{log\_setting\[@\]\}”  
> \-classpath “$\{CLASS\_PATH\}” $\{CLASS\_TO\_RUN\} “$\{ARGS\[@\]\}” > “$out” 2>&1  
> else  
> echo “$DAEMON daemon (pid: $MY\_PID) is running on host $HOSTNAME.”  
> fi

flink-worker.sh文件用于启动flink的worker任务节点。

注意：flink-worker.sh脚本中的exec命令是必须的。

创建flink-yarn.sh文件：

> vi FLINK-1.6.0-hadoop\_2.6-scala\_2.11/lib/flink/bin/flink-yarn.sh

FLINK-1.6.0-hadoop\_2.6-scala\_2.11/lib/flink/bin/flink-yarn.sh内容：

> \#!/bin/bash  
> bin=\`dirname “$0”\`  
> bin=\`cd “$bin”; pwd\`  
> \# get Flink config  
> . “$bin”/config.sh  
> JVM\_ARGS="$JVM\_ARGS -Xmx512m"  
> CLASS\_TO\_RUN=org.apache.flink.yarn.cli.FlinkYarnSessionCli  
> log=$FLINK\_LOG\_DIR/flink-yarn.log  
> out=$FLINK\_LOG\_DIR/flink-yarn.out  
> log\_setting="-Dlog.file="$log"  
> \-Dlog4j.configuration=file:"$FLINK\_CONF\_DIR"/log4j-yarn-session.properties  
> \-Dlogback.configurationFile=file:"$FLINK\_CONF\_DIR"/logback-yarn.xml"  
> \# Rotate log files  
> rotateLogFilesWithPrefix “$FLINK\_LOG\_DIR” “$FLINK\_LOG\_PREFIX”  
> CLASS\_PATH=\`manglePathList $(constructFlinkClassPath)?(hadoop  
> classpath)\`  
> CLASS\_PATH=$(echo “$\{CLASS\_PATH\}” | sed  
> “s\#”$FLINK\_HOME"/lib/slf4j-log4j12-1.7.7.jar:\#\#g")  
> exec $JAVA\_RUN $JVM\_ARGS -classpath “$CLASS\_PATH” $log\_setting  
> $\{CLASS\_TO\_RUN\} -j “$FLINK\_LIB\_DIR”/flink-dist\*.jar “$@” > “$out”  
> 2>&1

flink-yarn.sh文件用于在yarn中启动flink。

注意：flink-yarn.sh脚本中的exec命令是必须的。

创建permissions.json文件：

> vi FLINK-1.6.0-hadoop\_2.6-scala\_2.11/meta/permissions.json

FLINK-1.6.0-hadoop\_2.6-scala\_2.11/meta/permissions.json内容：

> \{  
> “lib/flink/bin/config.sh”: \{  
> “user”: “flink”,  
> “group”: “flink”,  
> “permissions”: “0755”  
> \},  
> “lib/flink/bin/flink-master.sh”: \{  
> “user”: “flink”,  
> “group”: “flink”,  
> “permissions”: “0755”  
> \},  
> “lib/flink/bin/flink-worker.sh”: \{  
> “user”: “flink”,  
> “group”: “flink”,  
> “permissions”: “0755”  
> \},  
> “lib/flink/bin/flink-yarn.sh”: \{  
> “user”: “flink”,  
> “group”: “flink”,  
> “permissions”: “0755”  
> \}  
> \}

permissions.json文件用于授予文件或文件夹权限。

进入FLINK-1.6.0-hadoop\_2.6-scala\_2.11所在目录。

创建文件夹parcel-el6：

> mkdir parcel-el6

将目录FLINK-1.6.0-hadoop\_2.6-scala\_2.11打包，打包成标准名称的parcel文件。

执行以下命令：

> tar -czvf parcel-el6/FLINK-1.6.0-hadoop\_2.6-scala\_2.11-el6.parcel  
> FLINK-1.6.0-hadoop\_2.6-scala\_2.11

打包完Parcel文件，需要生成FLINK-1.6.0-hadoop\_2.6-scala\_2.11-el6.parcel.sha文件，作为FLINK-1.6.0-hadoop\_2.6-scala\_2.11-el6.parcel文件的hash校验值。

该校验值由make\_manifest.py生成，执行完该python命令，生成manifest.json文件，文件中包含hash校验值信息。

make\_manifest.py是一个python脚本

![在这里插入图片描述][20190116200213904.png]

执行以下命令：

> python cm\_ext-master/make\_manifest/make\_manifest.py parcel-el6

parcel-el6是FLINK-1.6.0-hadoop\_2.6-scala\_2.11-el6.parcel的父级目录。

上面的命令会在parcel-el6文件夹下生成一个文件manifest.json。

parcel-el6/manifest.json内容：

> \{  
> “parcels”: \[\{  
> “hash”: “b548e8b4be3db290933222e4bd517c903d36d453”,  
> “depends”: “CDH (>= 5.2), CDH (<< 6.0)”,  
> “replaces”: “FLINK”,  
> “parcelName”: “FLINK-1.6.0-hadoop\_2.6-scala\_2.11-el6.parcel”,  
> “components”: \[\{  
> “pkg\_version”: “1.6.0+flink1.6.0”,  
> “version”: “1.6.0-flink1.6.0”,  
> “name”: “flink”,  
> “pkg\_release”: “hadoop\_2.6-scala\_2.11”  
> \}\]  
> \}\],  
> “lastUpdated”: 1538048224076  
> \}

创建FLINK-1.6.0-hadoop\_2.6-scala\_2.11-el6.parcel.sha文件：

> echo $(cat parcel-el6/manifest.json | grep hash | awk -F"\\"" ‘\{print  
> $4\}’) > parcel-el6/FLINK-1.6.0-hadoop\_2.6-scala\_2.11-el6.parcel.sha

parcel-el6/FLINK-1.6.0-hadoop\_2.6-scala\_2.11-el6.parcel.sha内容：

> b548e8b4be3db290933222e4bd517c903d36d453

最终你会得到三个文件：

> FLINK-1.6.0-hadoop\_2.6-scala\_2.11-el6.parcel

> FLINK-1.6.0-hadoop\_2.6-scala\_2.11-el6.parcel.sha

> manifest.json

将这三个文件复制到/opt/cloudera/parcel-repo/目录下即可。

如果/opt/cloudera/parcel-repo/目录已存在manifest.json文件，需将以下内容：

> \{  
> “parcelName”: “FLINK-1.6.0-hadoop\_2.6-scala\_2.11-el7.parcel”,  
> “components”: \[\{  
> “pkg\_version”: “1.6.0+flink1.6.0”,  
> “version”: “1.6.0-flink1.6.0”,  
> “name”: “flink”,  
> “pkg\_release”: “hadoop\_2.6-scala\_2.11”  
> \}\],  
> “depends”: “CDH (>= 5.2), CDH (<< 6.0)”,  
> “hash”: “ce75a90cd57aecd7e31bef15dd1221c6182e38c6”  
> \}

添加到已有manifest.json文件中。

### 制作standlaone csd jar ###

csd文件的目录结构如下：

![在这里插入图片描述][2019011620034077.png]

descriptor 放服务的规则描述文件service.sdl。

images 放服务的图标文件，png格式。不放图标文件，则CDH页面不显示图标。

scripts  
放你的服务的启动脚本，你的服务如何启动在scripts目录下的control.sh中自行定义即可。

创建文件夹：

> mkdir -p FLINK-1.6.0/descriptor

> mkdir -p FLINK-1.6.0/images

> mkdir -p FLINK-1.6.0/scripts

创建service.sdl文件：

> vi FLINK-1.6.0/descriptor/service.sdl

FLINK-1.6.0/descriptor/service.sdl内容：

> \{  
> “name”: “FLINK”,  
> “label”: “Flink(Standalone)”,  
> “description”: “Apache Flink is a framework and distributed processing  
> engine for stateful computations over unbounded and bounded data streams.”,  
> “version”: “1.6.0”,  
> “compatibility”: \{  
> “generation”: 1,  
> “cdhVersion”: \{  
> “min”: “5”,  
> “max”: “5”  
> \}  
> \},  
> “runAs”: \{  
> “user”: “flink”,  
> “group”: “flink”  
> \},  
> “icon”: “images/flink.png”,  
> “serviceDependencies”: \[\{  
> “name”: “ZOOKEEPER”,  
> “required”: “true”  
> \},  
> \{  
> “name”: “HDFS”,  
> “required”: “true”  
> \}\],  
> “parameters”: \[\{  
> “name”: “high-availability.storageDir”,  
> “label”: “high-availability storageDir”,  
> “description”: “HDFS path (URI) where Flink persists metadata in  
> high-availability setups.”,  
> “type”: “string”,  
> “default”: “hdfs:///user/flink/ha”,  
> “configurableInWizard”: true  
> \},  
> \{  
> “name”: “high-availability.zookeeper.path.root”,  
> “label”: “high-availability zookeeper path root”,  
> “description”: “The root path under which Flink stores its entries in  
> ZooKeeper.”,  
> “type”: “string”,  
> “default”: “/flink”,  
> “configurableInWizard”: true  
> \},  
> \{  
> “name”: “high-availability.cluster-id”,  
> “label”: “high-availability cluster-id”,  
> “description”: “The ID of the Flink cluster, used to separate multiple Flink  
> clusters from each other.”,  
> “type”: “string”,  
> “default”: “cluster\_standalone”,  
> “configurableInWizard”: true  
> \},  
> \{  
> “name”: “state.checkpoints.dir”,  
> “label”: “state checkpoints dir”,  
> “description”: “HDFS path (URI) for checkpoints.”,  
> “type”: “string”,  
> “default”: “hdfs:///user/flink/cluster\_standalone/checkpoints”,  
> “configurableInWizard”: true  
> \},  
> \{  
> “name”: “state.savepoints.dir”,  
> “label”: “state savepoints dir”,  
> “description”: “HDFS path (URI) for savepoints.”,  
> “type”: “string”,  
> “default”: “hdfs:///user/flink/cluster\_standalone/savepoints”,  
> “configurableInWizard”: true  
> \},  
> \{  
> “name”: “parallelism.default”,  
> “label”: “parallelism default”,  
> “description”: “The parallelism used for programs that did not specify and  
> other parallelism.”,  
> “type”: “long”,  
> “default”: 1,  
> “configurableInWizard”: true  
> \}\],  
> “hdfsDirs”: \[\{  
> “name”: “CreateFlinkUserDirCommand”,  
> “label”: “Create Flink User Dir”,  
> “description”: “Creates the Flink user directory in HDFS.”,  
> “directoryDescription”: “Flink HDFS user directory”,  
> “path”: “/user/$\{user\}”,  
> “permissions”: “0751”  
> \}\],  
> “serviceInit”: \{  
> “preStartSteps”: \[\{  
> “commandName”: “CreateFlinkUserDirCommand”  
> \}\]\},  
> “roles”: \[\{  
> “name”: “FLINK\_MASTER”,  
> “label”: “Flink Master”,  
> “pluralLabel”: “Flink Masters”,  
> “startRunner”: \{  
> “program”: “scripts/control.sh”,  
> “args”: \[“master”\],  
> “environmentVariables”: \{  
> “FLINK\_MASTER\_HOST”: “$\{host\}”,  
> “FLINK\_WEB\_UI\_PORT”: “$\{rest.port\}”,  
> “FLINK\_RUN\_AS\_USER”: “$\{user\}”  
> \}  
> \},  
> “externalLink”: \{  
> “name”: “web\_dashboard”,  
> “label”: “Web Dashboard”,  
> “url”: “[http://$][http]\{host\}?\{rest.port\}”  
> \},  
> “parameters”: \[  
> \{  
> “name”: “jobmanager.heap.size”,  
> “label”: “jobmanager heap size”,  
> “description”: “The heap size for the JobManager JVM.”,  
> “type”: “string”,  
> “default”: “1024m”,  
> “configurableInWizard”: true  
> \},  
> \{  
> “name”: “rest.port”,  
> “label”: “rest port”,  
> “description”: “The port under which the web-based runtime monitor  
> listens.”,  
> “type”: “long”,  
> “default”: 8081,  
> “configurableInWizard”: true  
> \}\],  
> “topology”: \{  
> “minInstances”: 1  
> \},  
> “logging”: \{  
> “filename”: “flink-master.log”,  
> “isModifiable”: true,  
> “configName”: “env.log.dir”,  
> “loggingType”: “log4j”,  
> “dir”: “/var/log/flink”  
> \},  
> “configWriter”: \{  
> “generators”: \[\{  
> “filename”: “flink-conf.properties”,  
> “configFormat”: “properties”,  
> “includeParams”: \[  
> “high-availability.storageDir”,  
> “high-availability.zookeeper.path.root”,  
> “high-availability.cluster-id”,  
> “state.savepoints.dir”,  
> “state.checkpoints.dir”,  
> “jobmanager.heap.size”,  
> “parallelism.default”,  
> “rest.port”  
> \]  
> \}\]  
> \}  
> \},  
> \{  
> “name”: “FLINK\_WORKER”,  
> “label”: “Flink Worker”,  
> “pluralLabel”: “Flink Workers”,  
> “startRunner”: \{  
> “program”: “scripts/control.sh”,  
> “args”: \[“worker”\],  
> “environmentVariables”: \{  
> “FLINK\_RUN\_AS\_USER”: “$\{user\}”  
> \}  
> \},  
> “parameters”: \[\{  
> “name”: “taskmanager.heap.size”,  
> “label”: “taskmanager heap size”,  
> “description”: “The heap size for the TaskManager JVM.”,  
> “type”: “string”,  
> “default”: “1024m”,  
> “configurableInWizard”: true  
> \},  
> \{  
> “name”: “taskmanager.numberOfTaskSlots”,  
> “label”: “taskmanager numberOfTaskSlots”,  
> “description”: “The number of task slots that each TaskManager offers. Each  
> slot runs one parallel pipeline.”,  
> “type”: “long”,  
> “default”: 1,  
> “configurableInWizard”: true  
> \}\],  
> “topology”: \{  
> “minInstances”: 1  
> \},  
> “logging”: \{  
> “filename”: “flink-worker.log”,  
> “isModifiable”: true,  
> “configName”: “env.log.dir”,  
> “loggingType”: “log4j”,  
> “dir”: “/var/log/flink”  
> \},  
> “configWriter”: \{  
> “generators”: \[\{  
> “filename”: “flink-conf.properties”,  
> “configFormat”: “properties”,  
> “includeParams”: \[  
> “high-availability.storageDir”,  
> “high-availability.zookeeper.path.root”,  
> “high-availability.cluster-id”,  
> “state.savepoints.dir”,  
> “state.checkpoints.dir”,  
> “taskmanager.heap.size”,  
> “taskmanager.numberOfTaskSlots”,  
> “parallelism.default”  
> \]  
> \}\]  
> \}  
> \}\]  
> \}

运行用户配置：

![在这里插入图片描述][20190116201156801.png]

图标配置：

![在这里插入图片描述][20190116201210280.png]

依赖组件配置：

![在这里插入图片描述][watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3RvbnlfMzI4NDI3Njg1_size_16_color_FFFFFF_t_70 1]

通用参数配置：

![在这里插入图片描述][watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3RvbnlfMzI4NDI3Njg1_size_16_color_FFFFFF_t_70 2]

hdfs目录创建配置：

![在这里插入图片描述][watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3RvbnlfMzI4NDI3Njg1_size_16_color_FFFFFF_t_70 3]

Flink Master节点启动配置：

![在这里插入图片描述][watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3RvbnlfMzI4NDI3Njg1_size_16_color_FFFFFF_t_70 4]

WEB UI链接配置：

![在这里插入图片描述][20190116201317116.png]

Flink Master节点参数配置：

![在这里插入图片描述][watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3RvbnlfMzI4NDI3Njg1_size_16_color_FFFFFF_t_70 5]

Flink Master节点topology配置：

![在这里插入图片描述][2019011620134271.png]

Flink Master节点日志配置：

![在这里插入图片描述][watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3RvbnlfMzI4NDI3Njg1_size_16_color_FFFFFF_t_70 6]

Flink Master节点配置文件生成配置：

![在这里插入图片描述][watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3RvbnlfMzI4NDI3Njg1_size_16_color_FFFFFF_t_70 7]

创建control.sh文件：

> vi FLINK-1.6.0/scripts/control.sh

FLINK-1.6.0/scripts/control.sh内容：

> \#!/bin/bash  
> \# For better debugging  
> USAGE=“Usage: [control.sh][] ((master|worker) (start|stop))”  
> NODE\_TYPE=$1  
> NODE\_HOST=\`hostname -f\`  
> \#Determine if the directory exists  
> TEMP\_PATH=$CMF\_VAR/…/cloudera/parcels  
> if \[ ! -d “$TEMP\_PATH” \];then  
> TEMP\_PATH=$CMF\_VAR/…/…/cloudera/parcels  
> fi  
> PARCELS\_DIR=\`cd $TEMP\_PATH; pwd\`  
> FLINK\_HOME=$PARCELS\_DIR/FLINK-1.6.0-hadoop\_2.6-scala\_2.11/lib/flink  
> \#Determine if the configuration file directory exists  
> FLINK\_CONF\_DIR=$CONF\_DIR/flink-conf  
> if \[ ! -d “$FLINK\_CONF\_DIR” \];then  
> mkdir $FLINK\_CONF\_DIR  
> else  
> rm -rf $FLINK\_CONF\_DIR/\*  
> fi  
> cp $FLINK\_HOME/conf/\* $FLINK\_CONF\_DIR/  
> sed -i ‘s\#=\#: \#g’ $CONF\_DIR/flink-conf.properties  
> if \[ “$NODE\_TYPE” = “master” \]; then  
> RPC\_ADDRESS=\`cat $CONF\_DIR/flink-conf.properties | grep  
> “jobmanager.rpc.address:”\`  
> \#Determine if the variable RPC\_ADDRESS is empty  
> if \[ “$RPC\_ADDRESS” = “” \]; then  
> echo “jobmanager.rpc.address: $FLINK\_MASTER\_HOST” >>  
> $CONF\_DIR/flink-conf.properties  
> RPC\_ADDRESS=\`cat $CONF\_DIR/flink-conf.properties | grep  
> “jobmanager.rpc.address:”\`  
> echo “RPC\_ADDRESS: $RPC\_ADDRESS”  
> fi  
> fi  
> HIGH\_MODE=\`cat $CONF\_DIR/flink-conf.properties | grep  
> “high-availability:”\`  
> \#Determine if the variable HIGH\_MODE is empty  
> if \[ “$HIGH\_MODE” = “” \]; then  
> echo “high-availability: zookeeper” >> $CONF\_DIR/flink-conf.properties  
> HIGH\_MODE=\`cat $CONF\_DIR/flink-conf.properties | grep  
> “high-availability:”\`  
> echo “HIGH\_MODE: $HIGH\_MODE”  
> fi  
> HIGH\_ZK\_QUORUM=\`cat $CONF\_DIR/flink-conf.properties | grep  
> “high-availability.zookeeper.quorum:”\`  
> \#Determine if the variable HIGH\_ZK\_QUORUM is empty  
> if \[ “$HIGH\_ZK\_QUORUM” = “” \]; then  
> echo "high-availability.zookeeper.quorum: "$ZK\_QUORUM >>  
> $CONF\_DIR/flink-conf.properties  
> HIGH\_ZK\_QUORUM=\`cat $CONF\_DIR/flink-conf.properties | grep  
> “high-availability.zookeeper.quorum:”\`  
> echo “HIGH\_ZK\_QUORUM: $HIGH\_ZK\_QUORUM”  
> fi  
> cp $CONF\_DIR/flink-conf.properties $FLINK\_CONF\_DIR/flink-conf.yaml  
> HADOOP\_CONF\_DIR=$CONF\_DIR/hadoop-conf  
> export FLINK\_HOME FLINK\_CONF\_DIR HADOOP\_CONF\_DIR  
> echo “”  
> echo “Date: \`date\`”  
> echo “Host: $NODE\_HOST”  
> echo “NODE\_TYPE: $NODE\_TYPE”  
> echo “ZK\_QUORUM: $ZK\_QUORUM”  
> echo “FLINK\_HOME: $FLINK\_HOME”  
> echo “FLINK\_CONF\_DIR: $FLINK\_CONF\_DIR”  
> echo “”  
> exec $FLINK\_HOME/bin/flink-$NODE\_TYPE.sh

注意：control.sh脚本中的exec命令是必须的。

用jar命令打包，得到csd的jar文件，进入FLINK-1.6.0文件夹。

执行命令：

> jar -cvf FLINK-1.6.0 \*

将FLINK-1.6.0.jar复制到/opt/cloudera/csd/目录下。

### 制作yarn csd jar ###

csd文件的目录结构如下：

![在这里插入图片描述][20190116201543851.png]

descriptor 放服务的规则描述文件service.sdl。

images 放服务的图标文件，png格式。不放图标文件，则CDH页面不显示图标。

scripts  
放你的服务的启动脚本，你的服务如何启动在scripts目录下的control.sh中自行定义即可。

创建文件夹：

> mkdir -p FLINK\_ON\_YARN-1.6.0/descriptor

> mkdir -p FLINK\_ON\_YARN-1.6.0/images

> mkdir -p FLINK\_ON\_YARN-1.6.0/scripts

创建service.sdl文件：

> vi FLINK\_ON\_YARN-1.6.0/descriptor/service.sdl

FLINK\_ON\_YARN-1.6.0/descriptor/service.sdl内容：

> \{  
> “name”: “FLINK\_ON\_YARN”,  
> “label”: “Flink(yarn)”,  
> “description”: “Apache Flink is a framework and distributed processing  
> engine for stateful computations over unbounded and bounded data streams.”,  
> “version”: “1.6.0”,  
> “compatibility”: \{  
> “generation”: 1,  
> “cdhVersion”: \{  
> “min”: “5”,  
> “max”: “5”  
> \}  
> \},  
> “runAs”: \{  
> “user”: “flink”,  
> “group”: “flink”  
> \},  
> “icon”: “images/flink.png”,  
> “serviceDependencies”: \[\{  
> “name”: “ZOOKEEPER”,  
> “required”: “true”  
> \},  
> \{  
> “name”: “YARN”,  
> “required”: “true”  
> \}\],  
> “parameters”: \[\{  
> “name”: “high-availability.storageDir”,  
> “label”: “high-availability storageDir”,  
> “description”: “HDFS path (URI) where Flink persists metadata in  
> high-availability setups.”,  
> “type”: “string”,  
> “default”: “hdfs:///user/flink/ha”,  
> “configurableInWizard”: true  
> \},  
> \{  
> “name”: “high-availability.zookeeper.path.root”,  
> “label”: “high-availability zookeeper path root”,  
> “description”: “The root path under which Flink stores its entries in  
> ZooKeeper.”,  
> “type”: “string”,  
> “default”: “/flink”,  
> “configurableInWizard”: true  
> \},  
> \{  
> “name”: “high-availability.cluster-id”,  
> “label”: “high-availability cluster-id”,  
> “description”: “The ID of the Flink cluster, used to separate multiple Flink  
> clusters from each other.”,  
> “type”: “string”,  
> “default”: “cluster\_yarn”,  
> “configurableInWizard”: true  
> \},  
> \{  
> “name”: “state.checkpoints.dir”,  
> “label”: “state checkpoints dir”,  
> “description”: “HDFS path (URI) for checkpoints.”,  
> “type”: “string”,  
> “default”: “hdfs:///user/flink/cluster\_yarn/checkpoints”,  
> “configurableInWizard”: true  
> \},  
> \{  
> “name”: “state.savepoints.dir”,  
> “label”: “state savepoints dir”,  
> “description”: “HDFS path (URI) for savepoints.”,  
> “type”: “string”,  
> “default”: “hdfs:///user/flink/cluster\_yarn/savepoints”,  
> “configurableInWizard”: true  
> \},  
> \{  
> “name”: “jobmanager.heap.size”,  
> “label”: “jobmanager heap size”,  
> “description”: “The heap size for the JobManager JVM.”,  
> “type”: “string”,  
> “default”: “1024m”,  
> “configurableInWizard”: true  
> \},  
> \{  
> “name”: “taskmanager.heap.size”,  
> “label”: “taskmanager heap size”,  
> “description”: “The heap size for the TaskManager JVM.”,  
> “type”: “string”,  
> “default”: “1024m”,  
> “configurableInWizard”: true  
> \},  
> \{  
> “name”: “taskmanager.numberOfTaskSlots”,  
> “label”: “taskmanager numberOfTaskSlots”,  
> “description”: “The number of task slots that each TaskManager offers. Each slot runs one parallel pipeline.”,  
> “type”: “long”,  
> “default”: 1,  
> “configurableInWizard”: true  
> \},  
> \{  
> “name”: “yarn.application-attempts”,  
> “label”: “yarn.application-attempts”,  
> “description”: “Number of ApplicationMaster restarts.”,  
> “type”: “long”,  
> “default”: 1,  
> “configurableInWizard”: true  
> \},  
> \{  
> “name”: “yarn.taskmanagers”,  
> “label”: “yarn.taskmanagers”,  
> “description”: “Number of YARN container to allocate (=Number of Task  
> Managers).”,  
> “type”: “long”,  
> “default”: 1,  
> “configurableInWizard”: true  
> \},  
> \{  
> “name”: “streaming.mode”,  
> “label”: “streaming.mode”,  
> “description”: “Start Flink in streaming mode.”,  
> “type”: “boolean”,  
> “default”: true,  
> “configurableInWizard”: true  
> \},  
> \{  
> “name”: “rest.port”,  
> “label”: “rest port”,  
> “description”: “The port under which the web-based runtime monitor  
> listens.”,  
> “type”: “long”,  
> “default”: 8081,  
> “configurableInWizard”: true  
> \}\],  
> “hdfsDirs”: \[\{  
> “name”: “CreateFlinkUserDirCommand”,  
> “label”: “Create Flink User Dir”,  
> “description”: “Creates the Flink user directory in HDFS.”,  
> “directoryDescription”: “Flink HDFS user directory”,  
> “path”: “/user/$\{user\}”,  
> “permissions”: “0751”  
> \}\],  
> “serviceInit”: \{  
> “preStartSteps”: \[\{  
> “commandName”: “CreateFlinkUserDirCommand”  
> \}\]  
> \},  
> “roles”: \[\{  
> “name”: “FLINK\_YARN”,  
> “label”: “Flink Yarn”,  
> “pluralLabel”: “Flink Yarns”,  
> “startRunner”: \{  
> “program”: “scripts/control.sh”,  
> “args”: \[“start”\],  
> “environmentVariables”: \{  
> “FLINK\_TASK\_MANAGERS”: “$\{yarn.taskmanagers\}”,  
> “FLINK\_STREAMING\_MODE”: “$\{streaming.mode\}”,  
> “FLINK\_RUN\_AS\_USER”: “$\{user\}”  
> \}  
> \},  
> “stopRunner”: \{  
> “runner”: \{  
> “program”: “scripts/control.sh”,  
> “args”: \[“stop”\],  
> “environmentVariables”: \{  
> “FLINK\_RUN\_AS\_USER”: “$\{user\}”  
> \}  
> \}  
> \},  
> “topology”: \{  
> “minInstances”: 1  
> \},  
> “logging”: \{  
> “filename”: “flink-yarn.out”,  
> “isModifiable”: true,  
> “configName”: “env.log.dir”,  
> “loggingType”: “log4j”,  
> “dir”: “/var/log/flink”  
> \},  
> “configWriter”: \{  
> “generators”: \[\{  
> “filename”: “flink-conf.properties”,  
> “configFormat”: “properties”,  
> “includeParams”: \[  
> “high-availability.storageDir”,  
> “high-availability.zookeeper.path.root”,  
> “high-availability.cluster-id”,  
> “state.savepoints.dir”,  
> “state.checkpoints.dir”,  
> “yarn.application-attempts”,  
> “jobmanager.heap.size”,  
> “taskmanager.heap.size”,  
> “taskmanager.numberOfTaskSlots”,  
> “rest.port”  
> \]  
> \}\]  
> \}  
> \}\]  
> \}

Flink Yarn停止配置：

![在这里插入图片描述][watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3RvbnlfMzI4NDI3Njg1_size_16_color_FFFFFF_t_70 8]

其他配置说明同3.2.2制作standlaone csd jar

创建control.sh文件：

> vi FLINK\_ON\_YARN-1.6.0/scripts/control.sh

FLINK\_ON\_YARN-1.6.0/scripts/control.sh内容：

> \#!/bin/bash  
> \# For better debugging  
> USAGE=“Usage: [control.sh][] (start|stop)”  
> OPERATION=$1  
> case $OPERATION in  
> (start)  
> NODE\_HOST=\`hostname -f\`  
> \#Determine if the directory exists  
> TEMP\_PATH=$CMF\_VAR/…/cloudera/parcels  
> if \[ ! -d “$TEMP\_PATH” \];then  
> TEMP\_PATH=$CMF\_VAR/…/…/cloudera/parcels  
> fi  
> PARCELS\_DIR=\`cd $TEMP\_PATH; pwd\`  
> FLINK\_HOME=$PARCELS\_DIR/FLINK-1.6.0-hadoop\_2.6-scala\_2.11/lib/flink  
> \#Determine if the configuration file directory exists  
> FLINK\_CONF\_DIR=$CONF\_DIR/flink-conf  
> if \[ ! -d “$FLINK\_CONF\_DIR” \];then  
> mkdir $FLINK\_CONF\_DIR  
> else  
> rm -rf $FLINK\_CONF\_DIR/\*  
> fi  
> cp $FLINK\_HOME/conf/\* $FLINK\_CONF\_DIR/  
> sed -i ‘s\#=\#: \#g’ $CONF\_DIR/flink-conf.properties  
> HIGH\_MODE=\`cat $CONF\_DIR/flink-conf.properties | grep  
> “high-availability:”\`  
> \#Determine if the variable HIGH\_MODE is empty  
> if \[ “$HIGH\_MODE” = “” \]; then  
> echo “high-availability: zookeeper” >> $CONF\_DIR/flink-conf.properties  
> HIGH\_MODE=\`cat $CONF\_DIR/flink-conf.properties | grep  
> “high-availability:”\`  
> echo “HIGH\_MODE: $HIGH\_MODE”  
> fi  
> HIGH\_ZK\_QUORUM=\`cat $CONF\_DIR/flink-conf.properties | grep  
> “high-availability.zookeeper.quorum:”\`  
> \#Determine if the variable HIGH\_ZK\_QUORUM is empty  
> if \[ “$HIGH\_ZK\_QUORUM” = “” \]; then  
> echo "high-availability.zookeeper.quorum: "$ZK\_QUORUM >>  
> $CONF\_DIR/flink-conf.properties  
> HIGH\_ZK\_QUORUM=\`cat $CONF\_DIR/flink-conf.properties | grep  
> “high-availability.zookeeper.quorum:”\`  
> echo “HIGH\_ZK\_QUORUM: $HIGH\_ZK\_QUORUM”  
> fi  
> cp $CONF\_DIR/flink-conf.properties $FLINK\_CONF\_DIR/flink-conf.yaml  
> HADOOP\_CONF\_DIR=$CONF\_DIR/yarn-conf  
> export FLINK\_HOME FLINK\_CONF\_DIR HADOOP\_CONF\_DIR  
> echo “”  
> echo “Date: \`date\`”  
> echo “Host: $NODE\_HOST”  
> echo “NODE\_TYPE: $NODE\_TYPE”  
> echo “ZK\_QUORUM: $ZK\_QUORUM”  
> echo “FLINK\_HOME: $FLINK\_HOME”  
> echo “FLINK\_CONF\_DIR: $FLINK\_CONF\_DIR”  
> echo “”

> if \[ “$FLINK\_STREAMING\_MODE” = “true” \]; then  
> exec $FLINK\_HOME/bin/flink-yarn.sh --container $FLINK\_TASK\_MANAGERS  
> –streaming  
> else  
> exec $FLINK\_HOME/bin/flink-yarn.sh --container $FLINK\_TASK\_MANAGERS  
> fi  
> ;;  
> (stop)  
> YARN\_CONFIG\_FILE=/tmp/.yarn-properties-$FLINK\_RUN\_AS\_USER  
> if \[ -r “$YARN\_CONFIG\_FILE” \]; then  
> YARN\_APP\_ID=\`cat $YARN\_CONFIG\_FILE | grep applicationID | awk -F “=”  
> ‘\{print $2\}’\`  
> if \[ “$YARN\_APP\_ID” != “” \]; then  
> echo “kill flink yarn application $YARN\_APP\_ID .”  
> yarn application -kill $YARN\_APP\_ID  
> fi  
> fi  
> CLASS\_TO\_RUN=org.apache.flink.yarn.cli.FlinkYarnSessionCli  
> FLINK\_YARN\_PID=$(ps -ef | grep $CLASS\_TO\_RUN | grep -v grep | awk  
> ‘\{print $2\}’)  
> if \[ “$FLINK\_YARN\_PID” != “” \]; then  
> echo “kill flink yarn client $FLINK\_YARN\_PID .”  
> kill $FLINK\_YARN\_PID  
> fi  
> ;;  
> (\*)  
> echo “Unknown daemon ‘$\{OPERATION\}’. $USAGE.”  
> exit 1  
> ;;  
> esac

注意：control.sh脚本中的exec命令是必须的。

用jar命令打包，得到csd的jar文件，进入FLINK-1.6.0文件夹。

执行命令：

> jar -cvf FLINK\_ON\_YARN-1.6.0 \*

将FLINK\_ON\_YARN-1.6.0.jar复制到/opt/cloudera/csd/目录下。

## 制作activemq组件包 ##

### 下载activemq包 ###

> [http://archive.apache.org/dist/activemq/5.10.2/apache-activemq-5.10.2-bin.tar.gz][http_archive.apache.org_dist_activemq_5.10.2_apache-activemq-5.10.2-bin.tar.gz]

> [http://central.maven.org/maven2/io/hawt/hawtio-default-offline/1.4.68/hawtio-default-offline-1.4.68.war][http_central.maven.org_maven2_io_hawt_hawtio-default-offline_1.4.68_hawtio-default-offline-1.4.68.war]

### 制作parcel ###

parcel包的根目录结构如下：

![在这里插入图片描述][20190116202146592.png]

parcel包目录结构由你的服务目录(lib/activemq)和一个meta目录组成。

meta目录组成文件如下：

![在这里插入图片描述][20190116202202520.png]

activemq\_env.sh文件可以声明你的服务运行时的bash环境下的一些变量环境，根据你的服务需要可以自行添加设置。

创建activemq\_env.sh文件：

> \#!/bin/bash  
> ACTIVEMQ\_DIRNAME=$\{PARCEL\_DIRNAME:-“ACTIVEMQ-5.10.2-hawtio\_1.4.68”\}  
> export ACTIVEMQ\_HOME=$PARCELS\_ROOT/$ACTIVEMQ\_DIRNAME/lib/activemq

parcel.json文件需要填写好相关的parcel包名、兼容的CDH平台版本信息。

创建parcel.json文件：

> vi ACTIVEMQ-5.10.2-hawtio\_1.4.68/meta/parcel.json

ACTIVEMQ-5.10.2-hawtio\_1.4.68/meta/parcel.json内容：

> \{  
> “schema\_version”: 1,  
> “name”: “ACTIVEMQ”,  
> “version”: “5.10.2-hawtio\_1.4.68”,  
> “depends”: “CDH (>= 5.2), CDH (<< 6.0)”,  
> “setActiveSymlink”: true,  
> “replaces”: “ACTIVEMQ”,  
> “scripts”: \{  
> “defines”: “activemq\_env.sh”  
> \},  
> “packages”: \[\{  
> “name”: “activemq”,  
> “version”: “5.10.2+activemq5.10.2”  
> \}\],  
> “components”: \[\{  
> “name”: “activemq”,  
> “version”: “5.10.2-activemq5.10.2”,  
> “pkg\_version”: “5.10.2+activemq5.10.2”,  
> “pkg\_release”: “5.10.2-hawtio\_1.4.68”  
> \}\],  
> “provides”: \[“activemq”\],  
> “users”: \{  
> “activemq”: \{  
> “longname”: “Activemq”,  
> “home”: “/var/lib/activemq”,  
> “shell”: “/bin/bash”,  
> “extra\_groups”: \[\]  
> \}  
> \},  
> “groups”: \[“activemq”\]  
> \}

注意：务必注意文件内容的大小写，否则可能造成parcel包无法发布的情况。

进入ACTIVEMQ-5.10.2-hawtio\_1.4.68文件夹所在目录

删除ACTIVEMQ-5.10.2-hawtio\_1.4.68/lib/activemq/lib/pax-url-aether-1.5.2.jar

将下载的hawtio-default-offline-1.4.68.war重命名为hawtio.rar

然后解压到ACTIVEMQ-5.10.2-hawtio\_1.4.68/lib/activemq/webapps目录，如下图：

![在这里插入图片描述][20190116202311647.png]

修改log4j.properties文件：

> vi ACTIVEMQ-5.10.2-hawtio\_1.4.68/lib/activemq/conf/log4j.properties

ACTIVEMQ-5.10.2-hawtio\_1.4.68/lib/activemq/conf/log4j.properties内容：

> log4j.rootLogger=INFO, logfile  
> log4j.logger.org.apache.activemq.spring=WARN  
> log4j.logger.org.apache.activemq.web.handler=WARN  
> log4j.logger.org.springframework=WARN  
> log4j.logger.org.apache.xbean=WARN  
> log4j.logger.org.apache.camel=INFO  
> log4j.logger.org.eclipse.jetty=WARN  
> log4j.appender.logfile=org.apache.log4j.RollingFileAppender  
> log4j.appender.logfile.file=$\{activemq.logs\}/activemq-broker.log  
> log4j.appender.logfile.maxFileSize=10MB  
> log4j.appender.logfile.maxBackupIndex=5  
> log4j.appender.logfile.append=false  
> log4j.appender.logfile.layout=org.apache.log4j.PatternLayout  
> log4j.appender.logfile.layout.ConversionPattern=%d\{yyyy-MM-dd HH:mm:ss,SSS\}  
> %-5p %-60c %x - %m%n  
> log4j.throwableRenderer=org.apache.log4j.EnhancedThrowableRenderer

修改activemq脚本：

> vi ACTIVEMQ-5.10.2-hawtio\_1.4.68/lib/activemq/bin/activemq

修改内容1：

> COMMANDLINE\_ARGS="$@"

修改为：

> ACTIVEMQ\_CONF=$2  
> ACTIVEMQ\_DATA=$3  
> ACTIVEMQ\_LOGS=$4  
> ACTIVEMQ\_TEMP=$5  
> COMMANDLINE\_ARGS="$\{@:6\}"

修改内容2：

> if \[ -z “$ACTIVEMQ\_OPTS” \] ; then  
> ACTIVEMQ\_OPTS="$ACTIVEMQ\_OPTS\_MEMORY  
> \-Djava.util.logging.config.file=logging.properties  
> \-Djava.security.auth.login.config=$ACTIVEMQ\_CONF/login.config"  
> fi

修改为：

> if \[ -z “$ACTIVEMQ\_OPTS” \] ; then  
> ACTIVEMQ\_OPTS="$ACTIVEMQ\_OPTS\_MEMORY -Dhawtio.realm=activemq  
> \-Dhawtio.role=admins  
> \-Dhawtio.rolePrincipalClasses=org.apache.activemq.jaas.GroupPrincipal  
> \-Djava.util.logging.config.file=logging.properties  
> \-Djava.security.auth.login.config=$ACTIVEMQ\_CONF/login.config"  
> fi

修改内容3：

> if \[ -n “$PIDFILE” \] && \[ “$PIDFILE” != “stop” \];then  
> $EXEC\_OPTION $DOIT\_PREFIX “$JAVACMD $ACTIVEMQ\_OPTS $ACTIVEMQ\_DEBUG\_OPTS  
> \\  
> \-Dactivemq.classpath=\\”$\{ACTIVEMQ\_CLASSPATH\}\\" \\  
> \-Dactivemq.home=\\"$\{ACTIVEMQ\_HOME\}\\" \\  
> \-Dactivemq.base=\\"$\{ACTIVEMQ\_BASE\}\\" \\  
> \-Dactivemq.conf=\\"$\{ACTIVEMQ\_CONF\}\\" \\  
> \-Dactivemq.data=\\"$\{ACTIVEMQ\_DATA\}\\" \\  
> $ACTIVEMQ\_CYGWIN \\  
> \-jar \\"$\{ACTIVEMQ\_HOME\}/bin/activemq.jar\\" $COMMANDLINE\_ARGS  
> >/dev/null 2>&1 &  
> RET=\\"\\$?\\"; APID=\\"\\$!\\";  
> echo \\$APID > $PIDFILE;  
> echo \\“INFO: pidfile created : ‘$PIDFILE’ (pid ‘\\$APID’)\\”;exit  
> \\$RET" $DOIT\_POSTFIX  
> RET="$?"  
> elif \[ -n “$PIDFILE” \] && \[ “$PIDFILE” = “stop” \];then  
> PID=\`cat $ACTIVEMQ\_PIDFILE\`  
> $EXEC\_OPTION $DOIT\_PREFIX “$JAVACMD $ACTIVEMQ\_OPTS $ACTIVEMQ\_DEBUG\_OPTS  
> \\  
> \-Dactivemq.classpath=\\”$\{ACTIVEMQ\_CLASSPATH\}\\" \\  
> \-Dactivemq.home=\\"$\{ACTIVEMQ\_HOME\}\\" \\  
> \-Dactivemq.base=\\"$\{ACTIVEMQ\_BASE\}\\" \\  
> \-Dactivemq.conf=\\"$\{ACTIVEMQ\_CONF\}\\" \\  
> \-Dactivemq.data=\\"$\{ACTIVEMQ\_DATA\}\\" \\  
> $ACTIVEMQ\_CYGWIN \\  
> \-jar \\"$\{ACTIVEMQ\_HOME\}/bin/activemq.jar\\" $COMMANDLINE\_ARGS --pid  
> $PID &  
> RET=\\"\\$?\\"; APID=\\"\\$!\\";  
> echo \\$APID > $ACTIVEMQ\_DATA/stop.pid; exit \\$RET" $DOIT\_POSTFIX  
> RET="$?"  
> else  
> $EXEC\_OPTION $DOIT\_PREFIX “$JAVACMD $ACTIVEMQ\_OPTS $ACTIVEMQ\_DEBUG\_OPTS  
> \\  
> \-Dactivemq.classpath=\\”$\{ACTIVEMQ\_CLASSPATH\}\\" \\  
> \-Dactivemq.home=\\"$\{ACTIVEMQ\_HOME\}\\" \\  
> \-Dactivemq.base=\\"$\{ACTIVEMQ\_BASE\}\\" \\  
> \-Dactivemq.conf=\\"$\{ACTIVEMQ\_CONF\}\\" \\  
> \-Dactivemq.data=\\"$\{ACTIVEMQ\_DATA\}\\" \\  
> $ACTIVEMQ\_CYGWIN \\  
> \-jar \\"$\{ACTIVEMQ\_HOME\}/bin/activemq.jar\\" $COMMANDLINE\_ARGS"  
> $DOIT\_POSTFIX  
> RET="$?"  
> fi

修改为：

> if \[ -n “$PIDFILE” \] && \[ “$PIDFILE” != “stop” \];then  
> $EXEC\_OPTION $DOIT\_PREFIX “$JAVACMD $ACTIVEMQ\_OPTS $ACTIVEMQ\_DEBUG\_OPTS  
> \\  
> \-Dactivemq.classpath=\\”$\{ACTIVEMQ\_CLASSPATH\}\\" \\  
> \-Dactivemq.home=\\"$\{ACTIVEMQ\_HOME\}\\" \\  
> \-Dactivemq.base=\\"$\{ACTIVEMQ\_BASE\}\\" \\  
> \-Dactivemq.conf=\\"$\{ACTIVEMQ\_CONF\}\\" \\  
> \-Dactivemq.data=\\"$\{ACTIVEMQ\_DATA\}\\" \\  
> \-Dactivemq.logs=\\"$\{ACTIVEMQ\_LOGS\}\\" \\  
> $ACTIVEMQ\_CYGWIN \\  
> \-jar \\"$\{ACTIVEMQ\_HOME\}/bin/activemq.jar\\" $COMMANDLINE\_ARGS  
> >/dev/null 2>&1 &  
> RET=\\"\\$?\\"; APID=\\"\\$!\\";  
> echo \\$APID > $PIDFILE;  
> echo \\“INFO: pidfile created : ‘$PIDFILE’ (pid ‘\\$APID’)\\”;exit  
> \\$RET" $DOIT\_POSTFIX  
> RET="$?"  
> elif \[ -n “$PIDFILE” \] && \[ “$PIDFILE” = “stop” \];then  
> PID=\`cat $ACTIVEMQ\_PIDFILE\`  
> $EXEC\_OPTION $DOIT\_PREFIX “$JAVACMD $ACTIVEMQ\_OPTS $ACTIVEMQ\_DEBUG\_OPTS  
> \\  
> \-Dactivemq.classpath=\\”$\{ACTIVEMQ\_CLASSPATH\}\\" \\  
> \-Dactivemq.home=\\"$\{ACTIVEMQ\_HOME\}\\" \\  
> \-Dactivemq.base=\\"$\{ACTIVEMQ\_BASE\}\\" \\  
> \-Dactivemq.conf=\\"$\{ACTIVEMQ\_CONF\}\\" \\  
> \-Dactivemq.data=\\"$\{ACTIVEMQ\_DATA\}\\" \\  
> \-Dactivemq.logs=\\"$\{ACTIVEMQ\_LOGS\}\\" \\  
> $ACTIVEMQ\_CYGWIN \\  
> \-jar \\"$\{ACTIVEMQ\_HOME\}/bin/activemq.jar\\" $COMMANDLINE\_ARGS --pid  
> $PID &  
> RET=\\"\\$?\\"; APID=\\"\\$!\\";  
> echo \\$APID > $ACTIVEMQ\_DATA/stop.pid; exit \\$RET" $DOIT\_POSTFIX  
> RET="$?"  
> else  
> $EXEC\_OPTION $DOIT\_PREFIX “$JAVACMD $ACTIVEMQ\_OPTS $ACTIVEMQ\_DEBUG\_OPTS  
> \\  
> \-Dactivemq.classpath=\\”$\{ACTIVEMQ\_CLASSPATH\}\\" \\  
> \-Dactivemq.home=\\"$\{ACTIVEMQ\_HOME\}\\" \\  
> \-Dactivemq.base=\\"$\{ACTIVEMQ\_BASE\}\\" \\  
> \-Dactivemq.conf=\\"$\{ACTIVEMQ\_CONF\}\\" \\  
> \-Dactivemq.data=\\"$\{ACTIVEMQ\_DATA\}\\" \\  
> \-Dactivemq.logs=\\"$\{ACTIVEMQ\_LOGS\}\\" \\  
> $ACTIVEMQ\_CYGWIN \\  
> \-jar \\"$\{ACTIVEMQ\_HOME\}/bin/activemq.jar\\" $COMMANDLINE\_ARGS"  
> $DOIT\_POSTFIX  
> RET="$?"  
> fi

创建permissions.json文件：

> vi ACTIVEMQ-5.10.2-hawtio\_1.4.68/meta/permissions.json

ACTIVEMQ-5.10.2-hawtio\_1.4.68/meta/permissions.json内容：

> \{  
> “lib/activemq/bin/activemq-admin”: \{  
> “user”: “activemq”,  
> “group”: “activemq”,  
> “permissions”: “0755”  
> \},

> “lib/activemq/bin/activemq”: \{  
> “user”: “activemq”,  
> “group”: “activemq”,  
> “permissions”: “0755”  
> \},  
> “lib/activemq/bin/diag”: \{  
> “user”: “activemq”,  
> “group”: “activemq”,  
> “permissions”: “0755”  
> \}  
> \}

permissions.json文件用于授予文件或文件夹权限。

将目录ACTIVEMQ-5.10.2-hawtio\_1.4.68打包，打包成标准名称的parcel文件。

执行以下命令：

> tar -czvf parcel-el6/ACTIVEMQ-5.10.2-hawtio\_1.4.68-el6.parcel  
> ACTIVEMQ-5.10.2-hawtio\_1.4.68

打包完Parcel文件，需要生成ACTIVEMQ-5.10.2-hawtio\_1.4.68-el6.parcel.sha文件，作为ACTIVEMQ-5.10.2-hawtio\_1.4.68-el6.parcel文件的hash校验值。

执行以下命令：

> python cm\_ext-master/make\_manifest/make\_manifest.py parcel-el6

parcel-el6是ACTIVEMQ-5.10.2-hawtio\_1.4.68-el6.parcel的父级目录。

上面的命令会在parcel-el6文件夹下生成一个文件manifest.json。

parcel-el6/manifest.json内容：

> \{  
> “parcels”: \[\{  
> “hash”: “03ccbceb485a44f4340fba5a1389ad8ac444b1a7”,  
> “depends”: “CDH (>= 5.2), CDH (<< 6.0)”,  
> “replaces”: “ACTIVEMQ”,  
> “parcelName”: “ACTIVEMQ-5.10.2-hawtio\_1.4.68-el6.parcel”,  
> “components”: \[\{  
> “pkg\_version”: “5.10.2+activemq5.10.2”,  
> “version”: “5.10.2-activemq5.10.2”,  
> “name”: “activemq”,  
> “pkg\_release”: “5.10.2-hawtio\_1.4.68”  
> \}\]  
> \}\],  
> “lastUpdated”: 1539916493195  
> \}

创建ACTIVEMQ-5.10.2-hawtio\_1.4.68-el6.parcel.sha文件：

> echo $(cat parcel-el6/manifest.json | grep hash | awk -F"\\"" ‘\{print  
> $4\}’) > parcel-el6/ACTIVEMQ-5.10.2-hawtio\_1.4.68-el6.parcel.sha

parcel-el6/ACTIVEMQ-5.10.2-hawtio\_1.4.68-el6.parcel.sha内容：

> 03ccbceb485a44f4340fba5a1389ad8ac444b1a7

最终你会得到三个文件：

> ACTIVEMQ-5.10.2-hawtio\_1.4.68-el6.parcel

> ACTIVEMQ-5.10.2-hawtio\_1.4.68-el6.parcel.sha

> manifest.json

将这三个文件复制到/opt/cloudera/parcel-repo/目录下即可。

如果/opt/cloudera/parcel-repo/目录已存在manifest.json文件，需将以下内容：

> \{  
> “hash”: “03ccbceb485a44f4340fba5a1389ad8ac444b1a7”,  
> “depends”: “CDH (>= 5.2), CDH (<< 6.0)”,  
> “replaces”: “ACTIVEMQ”,  
> “parcelName”: “ACTIVEMQ-5.10.2-hawtio\_1.4.68-el6.parcel”,  
> “components”: \[\{  
> “pkg\_version”: “5.10.2+activemq5.10.2”,  
> “version”: “5.10.2-activemq5.10.2”,  
> “name”: “activemq”,  
> “pkg\_release”: “5.10.2-hawtio\_1.4.68”  
> \}\]  
> \}

> 添加到已有manifest.json文件中。

### 制作csd jar ###

csd文件的目录结构如下：

![在这里插入图片描述][2019011620272529.png]

descriptor 放服务的规则描述文件service.sdl。

images 放服务的图标文件，png格式。不放图标文件，则CDH页面不显示图标。

scripts  
放你的服务的启动脚本，你的服务如何启动在scripts目录下的control.sh中自行定义即可。

创建文件夹：

> mkdir -p ACTIVEMQ-5.10.2/descriptor  
> mkdir -p ACTIVEMQ-5.10.2/images  
> mkdir -p ACTIVEMQ-5.10.2/scripts

创建service.sdl文件：

> vi ACTIVEMQ-5.10.2/descriptor/service.sdl

ACTIVEMQ-5.10.2/descriptor/service.sdl内容：

> \{  
> “name”: “ACTIVEMQ”,  
> “label”: “ActiveMQ”,  
> “description”: “Apache ActiveMQ is the most popular and powerful open source  
> messaging and Integration Patterns server.”,  
> “version”: “5.10.2”,  
> “compatibility”: \{  
> “generation”: 1,  
> “cdhVersion”: \{  
> “min”: “5”,  
> “max”: “5”  
> \}  
> \},  
> “runAs”: \{  
> “user”: “activemq”,  
> “group”: “activemq”  
> \},  
> “icon”: “images/activemq.png”,  
> “serviceDependencies”: \[\{  
> “name”: “ZOOKEEPER”,  
> “required”: “true”  
> \}\],  
> “parameters”: \[\{  
> “name”: “activemq.leveldb.replicas”,  
> “label”: “activemq.leveldb.replicas”,  
> “description”: “Number of data stored in LealDB.”,  
> “type”: “long”,  
> “default”: 1,  
> “configurableInWizard”: true  
> \},  
> \{  
> “name”: “activemq.leveldb.path”,  
> “label”: “activemq.leveldb.path”,  
> “description”: “The Leveldb store data path.”,  
> “type”: “string”,  
> “default”: “/var/lib/activemq/leveldb-stores”,  
> “configurableInWizard”: true  
> \},  
> \{  
> “name”: “activemq.leveldb.zkPath”,  
> “label”: “activemq.leveldb.zkPath”,  
> “description”: “The zookeeper store data path.”,  
> “type”: “string”,  
> “default”: “/activemq/leveldb-stores”,  
> “configurableInWizard”: true  
> \}\],  
> “roles”: \[\{  
> “name”: “ACTIVEMQ\_BROKER\_A”,  
> “label”: “ActiveMQ Broker A”,  
> “uniqueIdParameters”: \[“activemq.brokerId”\],  
> “pluralLabel”: “ActiveMQ Brokers”,  
> “startRunner”: \{  
> “program”: “scripts/control.sh”,  
> “args”: \[“console”,  
> “$\{activemq.brokerId\}”,  
> “mq-broker-a”,  
> “$\{activemq.leveldb.port\}”,  
> “$\{activemq.leveldb.path\}”,  
> “$\{activemq.leveldb.replicas\}”,  
> “$\{activemq.leveldb.zkPath\}”,  
> “$\{activemq.openwire.port\}”,  
> “$\{activemq.mqtt.port\}”,  
> “$\{activemq.jetty.port\}”,  
> “/var/log/activemq/mq-broker-a”\],  
> “environmentVariables”: \{  
> “ACTIVEMQ\_RUN\_AS\_USER”: “$\{user\}”  
> \}  
> \},  
> “externalLink”: \{  
> “name”: “hawtio\_ui”,  
> “label”: “Hawtio UI”,  
> “url”: “[http://$][http]\{host\}?\{activemq.jetty.port\}/hawtio/”  
> \},  
> “parameters”: \[\{  
> “name”: “activemq.brokerId”,  
> “label”: “activemq.brokerId”,  
> “description”: "ID uniquely identifying each broker. ",  
> “type”: “string”,  
> “default”: “a1”,  
> “configurableInWizard”: true  
> \},  
> \{  
> “name”: “activemq.leveldb.port”,  
> “label”: “activemq.leveldb.port”,  
> “description”: “The Leveldb bind port.”,  
> “type”: “long”,  
> “default”: 61619,  
> “configurableInWizard”: true  
> \},  
> \{  
> “name”: “activemq.openwire.port”,  
> “label”: “activemq.openwire.port”,  
> “description”: “The transport openwire connector port.”,  
> “type”: “long”,  
> “default”: 61616,  
> “configurableInWizard”: true  
> \},  
> \{  
> “name”: “activemq.mqtt.port”,  
> “label”: “activemq.mqtt.port”,  
> “description”: “The transport mqtt connector port.”,  
> “type”: “long”,  
> “default”: 61613,  
> “configurableInWizard”: true  
> \},  
> \{  
> “name”: “activemq.jetty.port”,  
> “label”: “activemq.jetty.port”,  
> “description”: “The jetty web server port.”,  
> “type”: “long”,  
> “default”: 8161,  
> “configurableInWizard”: true  
> \}\],  
> “topology”: \{  
> “minInstances”: “1”  
> \},  
> “logging”: \{  
> “filename”: “activemq-broker.log”,  
> “isModifiable”: true,  
> “configName”: “activemq.logs”,  
> “loggingType”: “log4j”,  
> “dir”: “/var/log/activemq/mq-broker-a”  
> \},  
> “configWriter”: \{  
> “generators”: \[\{  
> “filename”: “activemq-conf.properties”,  
> “configFormat”: “properties”,  
> “includeParams”: \[“activemq.leveldb.replicas”,  
> “activemq.brokerId”,  
> “activemq.leveldb.path”,  
> “activemq.leveldb.zkPath”,  
> “activemq.leveldb.port”,  
> “activemq.openwire.port”,  
> “activemq.mqtt.port”,  
> “activemq.jetty.port”\]  
> \}\]  
> \}  
> \},  
> \{  
> “name”: “ACTIVEMQ\_BROKER\_B”,  
> “label”: “ActiveMQ Broker B”,  
> “uniqueIdParameters”: \[“activemq.brokerId”\],  
> “pluralLabel”: “ActiveMQ Brokers”,  
> “startRunner”: \{  
> “program”: “scripts/control.sh”,  
> “args”: \[“console”,  
> “$\{activemq.brokerId\}”,  
> “mq-broker-b”,  
> “$\{activemq.leveldb.port\}”,  
> “$\{activemq.leveldb.path\}”,  
> “$\{activemq.leveldb.replicas\}”,  
> “$\{activemq.leveldb.zkPath\}”,  
> “$\{activemq.openwire.port\}”,  
> “$\{activemq.mqtt.port\}”,  
> “$\{activemq.jetty.port\}”,  
> “/var/log/activemq/mq-broker-b”\],  
> “environmentVariables”: \{  
> “ACTIVEMQ\_RUN\_AS\_USER”: “$\{user\}”  
> \}  
> \},  
> “externalLink”: \{  
> “name”: “hawtio\_ui”,  
> “label”: “Hawtio UI”,  
> “url”: “[http://$][http]\{host\}?\{activemq.jetty.port\}/hawtio/”  
> \},  
> “parameters”: \[\{  
> “name”: “activemq.brokerId”,  
> “label”: “activemq.brokerId”,  
> “description”: “ID uniquely identifying each broker.”,  
> “type”: “string”,  
> “default”: “b1”,  
> “configurableInWizard”: true  
> \},  
> \{  
> “name”: “activemq.leveldb.port”,  
> “label”: “activemq.leveldb.port”,  
> “description”: “The Leveldb bind port.”,  
> “type”: “long”,  
> “default”: 61629,  
> “configurableInWizard”: true  
> \},  
> \{  
> “name”: “activemq.openwire.port”,  
> “label”: “activemq.openwire.port”,  
> “description”: “The transport openwire connector port.”,  
> “type”: “long”,  
> “default”: 61626,  
> “configurableInWizard”: true  
> \},  
> \{  
> “name”: “activemq.mqtt.port”,  
> “label”: “activemq.mqtt.port”,  
> “description”: “The transport mqtt connector port.”,  
> “type”: “long”,  
> “default”: 61623,  
> “configurableInWizard”: true  
> \},  
> \{  
> “name”: “activemq.jetty.port”,  
> “label”: “activemq.jetty.port”,  
> “description”: “The jetty web server port.”,  
> “type”: “long”,  
> “default”: 8171,  
> “configurableInWizard”: true  
> \}\],  
> “topology”: \{  
> “minInstances”: “0”  
> \},  
> “logging”: \{  
> “filename”: “activemq-broker.log”,  
> “isModifiable”: true,  
> “configName”: “activemq.logs”,  
> “loggingType”: “log4j”,  
> “dir”: “/var/log/activemq/mq-broker-b”  
> \},  
> “configWriter”: \{  
> “generators”: \[\{  
> “filename”: “activemq-conf.properties”,  
> “configFormat”: “properties”,  
> “includeParams”: \[“activemq.leveldb.replicas”,  
> “activemq.brokerId”,  
> “activemq.leveldb.path”,  
> “activemq.leveldb.zkPath”,  
> “activemq.leveldb.port”,  
> “activemq.openwire.port”,  
> “activemq.mqtt.port”,  
> “activemq.jetty.port”\]  
> \}\]  
> \}  
> \},  
> \{  
> “name”: “ACTIVEMQ\_BROKER\_C”,  
> “label”: “ActiveMQ Broker C”,  
> “uniqueIdParameters”: \[“activemq.brokerId”\],  
> “pluralLabel”: “ActiveMQ Brokers”,  
> “startRunner”: \{  
> “program”: “scripts/control.sh”,  
> “args”: \[“console”,  
> “$\{activemq.brokerId\}”,  
> “mq-broker-c”,  
> “$\{activemq.leveldb.port\}”,  
> “$\{activemq.leveldb.path\}”,  
> “$\{activemq.leveldb.replicas\}”,  
> “$\{activemq.leveldb.zkPath\}”,  
> “$\{activemq.openwire.port\}”,  
> “$\{activemq.mqtt.port\}”,  
> “$\{activemq.jetty.port\}”,  
> “/var/log/activemq/mq-broker-c”\],  
> “environmentVariables”: \{  
> “ACTIVEMQ\_RUN\_AS\_USER”: “$\{user\}”  
> \}  
> \},  
> “externalLink”: \{  
> “name”: “hawtio\_ui”,  
> “label”: “Hawtio UI”,  
> “url”: “[http://$][http]\{host\}?\{activemq.jetty.port\}/hawtio/”  
> \},  
> “parameters”: \[\{  
> “name”: “activemq.brokerId”,  
> “label”: “activemq.brokerId”,  
> “description”: "ID uniquely identifying each broker. ",  
> “type”: “string”,  
> “default”: “c1”,  
> “configurableInWizard”: true  
> \},  
> \{  
> “name”: “activemq.leveldb.port”,  
> “label”: “activemq.leveldb.port”,  
> “description”: “The Leveldb bind port.”,  
> “type”: “long”,  
> “default”: 61639,  
> “configurableInWizard”: true  
> \},  
> \{  
> “name”: “activemq.openwire.port”,  
> “label”: “activemq.openwire.port”,  
> “description”: “The transport openwire connector port.”,  
> “type”: “long”,  
> “default”: 61636,  
> “configurableInWizard”: true  
> \},  
> \{  
> “name”: “activemq.mqtt.port”,  
> “label”: “activemq.mqtt.port”,  
> “description”: “The transport mqtt connector port.”,  
> “type”: “long”,  
> “default”: 61633,  
> “configurableInWizard”: true  
> \},  
> \{  
> “name”: “activemq.jetty.port”,  
> “label”: “activemq.jetty.port”,  
> “description”: “The jetty web server port.”,  
> “type”: “long”,  
> “default”: 8181,  
> “configurableInWizard”: true  
> \}\],  
> “topology”: \{  
> “minInstances”: “0”  
> \},  
> “logging”: \{  
> “filename”: “activemq-broker.log”,  
> “isModifiable”: true,  
> “configName”: “activemq.logs”,  
> “loggingType”: “log4j”,  
> “dir”: “/var/log/activemq/mq-broker-c”  
> \},  
> “configWriter”: \{  
> “generators”: \[\{  
> “filename”: “activemq-conf.properties”,  
> “configFormat”: “properties”,  
> “includeParams”: \[“activemq.leveldb.replicas”,  
> “activemq.brokerId”,  
> “activemq.leveldb.path”,  
> “activemq.leveldb.zkPath”,  
> “activemq.leveldb.port”,  
> “activemq.openwire.port”,  
> “activemq.mqtt.port”,  
> “activemq.jetty.port”\]  
> \}\]  
> \}  
> \}\]  
> \}

配置说明同3.2.2制作standlaone csd jar

创建control.sh文件：

> vi ACTIVEMQ-5.10.2/scripts/control.sh

ACTIVEMQ-5.10.2/scripts/control.sh内容：

> \#!/bin/bash  
> \# For better debugging  
> USAGE=“Usage: [control.sh][] (start|stop)”  
> OPERTION=$1  
> ACTIVEMQ\_BROKER\_ID=$2  
> ACTIVEMQ\_BROKER\_NAME=$3  
> ACTIVEMQ\_LEVELDB\_PORT=$4  
> ACTIVEMQ\_LEVELDB\_PATH=$5  
> ACTIVEMQ\_LEVELDB\_REPLICAS=$6  
> ACTIVEMQ\_LEVELDB\_ZKPATH=$7  
> ACTIVEMQ\_OPENWIRE\_PORT=$8  
> ACTIVEMQ\_MQTT\_PORT=$9  
> ACTIVEMQ\_JETTY\_PORT=$\{10\}  
> ACTIVEMQ\_LOG\_DIR=$\{11\}  
> NODE\_HOST=\`hostname -f\`  
> \#Determine if the directory exists  
> TEMP\_PATH=$CMF\_VAR/…/cloudera/parcels  
> if \[ ! -d “$TEMP\_PATH” \];then  
> TEMP\_PATH=$CMF\_VAR/…/…/cloudera/parcels  
> fi  
> PARCELS\_DIR=\`cd $TEMP\_PATH; pwd\`  
> ACTIVEMQ\_HOME=$PARCELS\_DIR/ACTIVEMQ-5.10.2-hawtio\_1.4.68/lib/activemq  
> export ACTIVEMQ\_HOME  
> \#Determine if the configuration file directory exists  
> ACTIVEMQ\_CONF=$CONF\_DIR/activemq-conf  
> if \[ -d “$ACTIVEMQ\_CONF” \];then  
> rm -rf $ACTIVEMQ\_CONF/\*  
> else  
> mkdir -p $ACTIVEMQ\_CONF  
> fi  
> cp $ACTIVEMQ\_HOME/conf/\* $ACTIVEMQ\_CONF/  
> ACTIVEMQ\_DATA="/var/lib/activemq/data"  
> if \[ ! -d “$ACTIVEMQ\_DATA” \];then  
> mkdir -p $ACTIVEMQ\_DATA  
> fi  
> ACTIVEMQ\_TEMP="/var/lib/activemq/temp"  
> if \[ ! -d “$ACTIVEMQ\_TEMP” \];then  
> mkdir -p $ACTIVEMQ\_TEMP  
> fi  
> LEVELDB\_PATH="$ACTIVEMQ\_LEVELDB\_PATH/$ACTIVEMQ\_BROKER\_NAME"  
> if \[ ! -d “$LEVELDB\_PATH” \];then  
> mkdir -p $LEVELDB\_PATH  
> fi  
> chown -R $ACTIVEMQ\_RUN\_AS\_USER:$ACTIVEMQ\_RUN\_AS\_USER $LEVELDB\_PATH  
> BROKER\_ID="$ACTIVEMQ\_BROKER\_NAME-$ACTIVEMQ\_BROKER\_ID"  
> LEVELDB\_ZKPATH="$ACTIVEMQ\_LEVELDB\_ZKPATH/$ACTIVEMQ\_BROKER\_NAME"  
> echo “<?xml version=\\“1.0\\” encoding=\\“UTF-8\\”?>” >  
> $ACTIVEMQ\_CONF/activemq.xml  
> echo “<beans xmlns=\\“[http://www.springframework.org/schema/beans\\][http_www.springframework.org_schema_beans]”  
> xmlns:xsi=\\“[http://www.w3.org/2001/XMLSchema-instance\\][http_www.w3.org_2001_XMLSchema-instance]”  
> xsi:schemaLocation=\\“[http://www.springframework.org/schema/beans][http_www.springframework.org_schema_beans 1]  
> [http://www.springframework.org/schema/beans/spring-beans.xsd][http_www.springframework.org_schema_beans_spring-beans.xsd]  
> [http://activemq.apache.org/schema/core][http_activemq.apache.org_schema_core]  
> [http://activemq.apache.org/schema/core/activemq-core.xsd\\">"][http_activemq.apache.org_schema_core_activemq-core.xsd] >>  
> $ACTIVEMQ\_CONF/activemq.xml  
> echo “<bean  
> class=\\“org.springframework.beans.factory.config.PropertyPlaceholderConfigurer\\”>”  
> >> $ACTIVEMQ\_CONF/activemq.xml  
> echo “<property  
> name=\\“locations\\”><value>file:$\{ACTIVEMQ\_CONF\}/credentials.properties</value></property></bean>”  
> >> $ACTIVEMQ\_CONF/activemq.xml  
> echo “<broker xmlns=\\“[http://activemq.apache.org/schema/core\\][http_activemq.apache.org_schema_core 1]”  
> brokerName=\\”$ACTIVEMQ\_BROKER\_NAME\\” brokerId=\\”$BROKER\_ID\\"  
> dataDirectory=\\"$\{ACTIVEMQ\_DATA\}\\">" >> $ACTIVEMQ\_CONF/activemq.xml  
> echo “<destinationPolicy><policyMap><policyEntries><policyEntry  
> topic=\\”>\\"><pendingMessageLimitStrategy>" >>  
> $ACTIVEMQ\_CONF/activemq.xml  
> echo “<constantPendingMessageLimitStrategy  
> limit=\\“1000\\”/></pendingMessageLimitStrategy></policyEntry></policyEntries></policyMap>”  
> >> $ACTIVEMQ\_CONF/activemq.xml  
> echo “</destinationPolicy><managementContext><managementContext  
> createConnector=\\“false\\”/></managementContext><persistenceAdapter>”  
> >> $ACTIVEMQ\_CONF/activemq.xml  
> echo “<replicatedLevelDB directory=\\”$LEVELDB\_PATH\\"  
> replicas=\\"$ACTIVEMQ\_LEVELDB\_REPLICAS\\"  
> bind=\\“tcp://0.0.0.0:$ACTIVEMQ\_LEVELDB\_PORT\\” zkAddress=\\"$ZK\_QUORUM\\"  
> zkPath=\\"$LEVELDB\_ZKPATH\\" hostname=\\"$NODE\_HOST\\"/>" >>  
> $ACTIVEMQ\_CONF/activemq.xml  
> echo  
> “</persistenceAdapter><systemUsage><systemUsage><memoryUsage><memoryUsage  
> percentOfJvmHeap=\\“70\\”/></memoryUsage>” >>  
> $ACTIVEMQ\_CONF/activemq.xml  
> echo “<storeUsage><storeUsage limit=\\“100  
> gb\\”/></storeUsage><tempUsage><tempUsage limit=\\“50  
> gb\\”/></tempUsage></systemUsage></systemUsage>” >>  
> $ACTIVEMQ\_CONF/activemq.xml  
> echo “<transportConnectors><transportConnector name=\\“openwire\\”  
> uri=\\“tcp://0.0.0.0:$ACTIVEMQ\_OPENWIRE\_PORT?maximumConnections=1000&wireFormat.maxFrameSize=104857600\\”  
> discoveryUri=\\“multicast://default\\”/>” >> $ACTIVEMQ\_CONF/activemq.xml  
> echo “<transportConnector name=\\“mqtt\\”  
> uri=\\“mqtt://0.0.0.0:$ACTIVEMQ\_MQTT\_PORT?maximumConnections=1000&wireFormat.maxFrameSize=104857600\\”/></transportConnectors>”  
> >> $ACTIVEMQ\_CONF/activemq.xml  
> echo “<networkConnectors><networkConnector userName=\\“admin\\”  
> password=\\“admin\\” name=\\“default-nc\\”  
> uri=\\“multicast://default\\”/></networkConnectors><shutdownHooks>”  
> >> $ACTIVEMQ\_CONF/activemq.xml  
> echo “<bean xmlns=\\“[http://www.springframework.org/schema/beans\\][http_www.springframework.org_schema_beans]”  
> class=\\“org.apache.activemq.hooks.SpringContextHook\\”  
> /></shutdownHooks>” >> $ACTIVEMQ\_CONF/activemq.xml  
> echo “<plugins><simpleAuthenticationPlugin><users><authenticationUser  
> username=\\“admin\\” password=\\“admin\\” groups=\\“admins\\”/>” >>  
> $ACTIVEMQ\_CONF/activemq.xml  
> echo “<authenticationUser username=\\“user\\” password=\\“suning\\”  
> groups=\\“users\\”/></users></simpleAuthenticationPlugin></plugins></broker>”  
> >> $ACTIVEMQ\_CONF/activemq.xml  
> echo “<import resource=\\“jetty.xml\\”/></beans>” >>  
> $ACTIVEMQ\_CONF/activemq.xml  
> echo “<?xml version=\\“1.0\\” encoding=\\“UTF-8\\”?>” >  
> $ACTIVEMQ\_CONF/jetty.xml  
> echo “<beans xmlns=\\“[http://www.springframework.org/schema/beans\\][http_www.springframework.org_schema_beans]”  
> xmlns:xsi=\\“[http://www.w3.org/2001/XMLSchema-instance\\][http_www.w3.org_2001_XMLSchema-instance]”  
> xsi:schemaLocation=\\“[http://www.springframework.org/schema/beans][http_www.springframework.org_schema_beans 1]  
> [http://www.springframework.org/schema/beans/spring-beans.xsd\\">"][http_www.springframework.org_schema_beans_spring-beans.xsd 1] >>  
> $ACTIVEMQ\_CONF/jetty.xml  
> echo “<bean id=\\“securityLoginService\\”  
> class=\\“org.eclipse.jetty.security.HashLoginService\\”><property  
> name=\\“name\\” value=\\“ActiveMQRealm\\” />” >>  
> $ACTIVEMQ\_CONF/jetty.xml  
> echo “<property name=\\“config\\”  
> value=\\”$\{ACTIVEMQ\_CONF\}/jetty-realm.properties\\”/></bean><bean  
> id=\\“securityConstraint\\”  
> class=\\“org.eclipse.jetty.util.security.Constraint\\”>” >>  
> $ACTIVEMQ\_CONF/jetty.xml  
> echo “<property name=\\“name\\” value=\\“BASIC\\”/><property  
> name=\\“roles\\” value=\\“user,admin\\”/><property name=\\“authenticate\\”  
> value=\\“true\\”/></bean>” >> $ACTIVEMQ\_CONF/jetty.xml  
> echo “<bean id=\\“adminSecurityConstraint\\”  
> class=\\“org.eclipse.jetty.util.security.Constraint\\”>” >>  
> $ACTIVEMQ\_CONF/jetty.xml  
> echo “<property name=\\“name\\” value=\\“BASIC\\” /><property  
> name=\\“roles\\” value=\\“admin\\”/><property name=\\“authenticate\\”  
> value=\\“true\\”/></bean>” >> $ACTIVEMQ\_CONF/jetty.xml  
> echo “<bean id=\\“securityConstraintMapping\\”  
> class=\\“org.eclipse.jetty.security.ConstraintMapping\\”><property  
> name=\\“constraint\\” ref=\\“securityConstraint\\”/>” >>  
> $ACTIVEMQ\_CONF/jetty.xml  
> echo “<property name=\\“pathSpec\\”  
> value=\\”/api/\*,/admin/\*,\*.jsp\\"/></bean><bean  
> id=\\“adminSecurityConstraintMapping\\”  
> class=\\“org.eclipse.jetty.security.ConstraintMapping\\”>" >>  
> $ACTIVEMQ\_CONF/jetty.xml  
> echo “<property name=\\“constraint\\”  
> ref=\\“adminSecurityConstraint\\”/><property name=\\“pathSpec\\”  
> value=\\”\*.action\\"/></bean>" >> $ACTIVEMQ\_CONF/jetty.xml  
> echo “<bean id=\\“securityHandler\\”  
> class=\\“org.eclipse.jetty.security.ConstraintSecurityHandler\\”><property  
> name=\\“loginService\\” ref=\\“securityLoginService\\”/>” >>  
> $ACTIVEMQ\_CONF/jetty.xml  
> echo “<property name=\\“authenticator\\”><bean  
> class=\\“org.eclipse.jetty.security.authentication.BasicAuthenticator\\”/>”  
> >> $ACTIVEMQ\_CONF/jetty.xml  
> echo “</property><property name=\\“constraintMappings\\”><list><ref  
> bean=\\“adminSecurityConstraintMapping\\”/><ref  
> bean=\\“securityConstraintMapping\\”/>” >> $ACTIVEMQ\_CONF/jetty.xml  
> echo “</list></property><property name=\\“handler\\”><bean  
> id=\\“sec\\”  
> class=\\“org.eclipse.jetty.server.handler.HandlerCollection\\”>” >>  
> $ACTIVEMQ\_CONF/jetty.xml  
> echo “<property name=\\“handlers\\”><list><bean  
> class=\\“org.eclipse.jetty.webapp.WebAppContext\\”><property  
> name=\\“contextPath\\” value=\\”/admin\\"/>" >> $ACTIVEMQ\_CONF/jetty.xml  
> echo “<property name=\\“resourceBase\\”  
> value=\\”$\{ACTIVEMQ\_HOME\}/webapps/admin\\"/><property  
> name=\\“logUrlOnStart\\” value=\\“true\\”/></bean>" >>  
> $ACTIVEMQ\_CONF/jetty.xml  
> echo “<bean class=\\“org.eclipse.jetty.webapp.WebAppContext\\”><property  
> name=\\“contextPath\\” value=\\”/fileserver\\" />" >>  
> $ACTIVEMQ\_CONF/jetty.xml  
> echo “<property name=\\“resourceBase\\”  
> value=\\”$\{ACTIVEMQ\_HOME\}/webapps/fileserver\\"/><property  
> name=\\“logUrlOnStart\\” value=\\“true\\”/>" >> $ACTIVEMQ\_CONF/jetty.xml  
> echo “<property name=\\“parentLoaderPriority\\”  
> value=\\“true\\”/></bean><bean  
> class=\\“org.eclipse.jetty.webapp.WebAppContext\\”><property  
> name=\\“contextPath\\” value=\\”/api\\"/>" >> $ACTIVEMQ\_CONF/jetty.xml  
> echo “<property name=\\“resourceBase\\”  
> value=\\”$\{ACTIVEMQ\_HOME\}/webapps/api\\"/><property  
> name=\\“logUrlOnStart\\” value=\\“true\\”/></bean>" >>  
> $ACTIVEMQ\_CONF/jetty.xml  
> echo “<bean class=\\“org.eclipse.jetty.webapp.WebAppContext\\”><property  
> name=\\“contextPath\\” value=\\”/hawtio\\"/>" >>  
> $ACTIVEMQ\_CONF/jetty.xml  
> echo “<property name=\\“war\\”  
> value=\\”$\{ACTIVEMQ\_HOME\}/webapps/hawtio\\"/><property  
> name=\\“logUrlOnStart\\” value=\\“true\\”/></bean><bean  
> class=\\“org.eclipse.jetty.server.handler.ResourceHandler\\”>" >>  
> $ACTIVEMQ\_CONF/jetty.xml  
> echo “<property name=\\“directoriesListed\\” value=\\“false\\”/><property  
> name=\\“welcomeFiles\\”><list><value>index.html</value></list></property>”  
> >> $ACTIVEMQ\_CONF/jetty.xml  
> echo “<property name=\\“resourceBase\\”  
> value=\\”$\{ACTIVEMQ\_HOME\}/webapps/\\"/></bean><bean  
> id=\\“defaultHandler\\”  
> class=\\“org.eclipse.jetty.server.handler.DefaultHandler\\”>" >>  
> $ACTIVEMQ\_CONF/jetty.xml  
> echo “<property name=\\“serveIcon\\”  
> value=\\“false\\”/></bean></list></property></bean></property></bean><bean  
> id=\\“contexts\\”  
> class=\\“org.eclipse.jetty.server.handler.ContextHandlerCollection\\”>”  
> >> $ACTIVEMQ\_CONF/jetty.xml  
> echo “</bean><bean id=\\“jettyPort\\”  
> class=\\“org.apache.activemq.web.WebConsolePort\\”  
> init-method=\\“start\\”>” >> $ACTIVEMQ\_CONF/jetty.xml  
> echo “<property name=\\“port\\”  
> value=\\”$ACTIVEMQ\_JETTY\_PORT\\"/></bean><bean id=\\“Server\\”  
> depends-on=\\“jettyPort\\” class=\\“org.eclipse.jetty.server.Server\\”  
> init-method=\\“start\\” destroy-method=\\“stop\\”>" >>  
> $ACTIVEMQ\_CONF/jetty.xml  
> echo “<property name=\\“connectors\\”><list><bean id=\\“Connector\\”  
> class=\\“org.eclipse.jetty.server.nio.SelectChannelConnector\\”>” >>  
> $ACTIVEMQ\_CONF/jetty.xml  
> echo “<property name=\\“port\\”  
> value=\\”\#\{systemProperties\[‘jetty.port’\]\}\\"/></bean></list></property><property  
> name=\\“handler\\”>" >> $ACTIVEMQ\_CONF/jetty.xml  
> echo “<bean id=\\“handlers\\”  
> class=\\“org.eclipse.jetty.server.handler.HandlerCollection\\”><property  
> name=\\“handlers\\”><list><ref bean=\\“contexts\\”/>” >>  
> $ACTIVEMQ\_CONF/jetty.xml  
> echo “<ref  
> bean=\\“securityHandler\\”/></list></property></bean></property></bean></beans>”  
> >> $ACTIVEMQ\_CONF/jetty.xml  
> echo “”  
> echo “Date: \`date\`”  
> echo “Host: $NODE\_HOST”  
> echo “ZK\_QUORUM: $ZK\_QUORUM”  
> echo “ACTIVEMQ\_HOME: $ACTIVEMQ\_HOME”  
> echo “ACTIVEMQ\_CONF: $ACTIVEMQ\_CONF”  
> echo “ACTIVEMQ\_DATA: $ACTIVEMQ\_DATA”  
> echo “ACTIVEMQ\_BROKER\_ID: $ACTIVEMQ\_BROKER\_ID”  
> echo “ACTIVEMQ\_BROKER\_NAME: $ACTIVEMQ\_BROKER\_NAME”  
> echo “ACTIVEMQ\_LEVELDB\_PORT: $ACTIVEMQ\_LEVELDB\_PORT”  
> echo “ACTIVEMQ\_LEVELDB\_PATH: $LEVELDB\_PATH”  
> echo “ACTIVEMQ\_LEVELDB\_REPLICAS: $ACTIVEMQ\_LEVELDB\_REPLICAS”  
> echo “ACTIVEMQ\_LEVELDB\_ZKPATH: $ACTIVEMQ\_LEVELDB\_ZKPATH”  
> echo “ACTIVEMQ\_OPENWIRE\_PORT: $ACTIVEMQ\_OPENWIRE\_PORT”  
> echo “ACTIVEMQ\_MQTT\_PORT: $ACTIVEMQ\_MQTT\_PORT”  
> echo “ACTIVEMQ\_JETTY\_PORT: $ACTIVEMQ\_JETTY\_PORT”  
> echo “ACTIVEMQ\_LOG\_DIR: $ACTIVEMQ\_LOG\_DIR”  
> echo “”  
> exec $ACTIVEMQ\_HOME/bin/activemq $OPERTION “$ACTIVEMQ\_CONF”  
> “$ACTIVEMQ\_DATA” “$ACTIVEMQ\_LOG\_DIR” “$ACTIVEMQ\_TEMP”

注意：control.sh脚本中的exec命令是必须的。

用jar命令打包，得到csd的jar文件，进入ACTIVEMQ-5.10.2文件夹。

执行命令：

> jar -cvf ACTIVEMQ-5.10.2 \*

将ACTIVEMQ-5.10.2.jar复制到/opt/cloudera/csd/目录下。

# 发布到CDH上 #

## 激活parcel包 ##

![在这里插入图片描述][watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3RvbnlfMzI4NDI3Njg1_size_16_color_FFFFFF_t_70 9]

点击检查新Parcel后，就会显示你添加的parcel包，然后点击激活、启用。CDH会自动将你的parcel包分发到集群的各个节点上。也就是会解压在个节点的/opt/cloudera/parcels目录下。

这里的parcel包发布跟csd的jar文件无关。

## 添加服务 ##

![在这里插入图片描述][20190116203640789.jpg]

在CDH首页点击添加服务，会看到你发布的flink或activemq服务，按照提示一步一步选择即可。

最终服务添加成功后，会执行control.sh脚本，然后根据env.sh文件自动找到/opt/cloudera/parcels目录下的服务工程目录，并启动你的服务

服务启动后，运行状态受CDH监控，因为CDH是通过exec执行的control.sh脚本，会接管control.sh的bash环境，其实也就是fork出来的子进程。当进程挂了，CDH也就知道你的服务挂了

注：一定要注意上面的各个文件的服务名称大小写问题，出错了可能导致发布不成功的。

至此，整个第三方服务的添加就结束了。

[https://gitee.com/tony429001986/flink-cdh][https_gitee.com_tony429001986_flink-cdh]  
[https://gitee.com/tony429001986/activemq-cdh][https_gitee.com_tony429001986_activemq-cdh]

[https_github.com_cloudera_cm_csds]: https://github.com/cloudera/cm_csds
[https_github.com_cloudera_cm_ext]: https://github.com/cloudera/cm_ext
[https_archive.apache.org_dist_flink_flink-1.6.0_flink-1.6.0-bin-hadoop26-scala_2.11.tgz]: https://archive.apache.org/dist/flink/flink-1.6.0/flink-1.6.0-bin-hadoop26-scala_2.11.tgz
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3RvbnlfMzI4NDI3Njg1_size_16_color_FFFFFF_t_70]: /images/20220326/f56a940bca5c4fd094530da9d71aa44e.png
[20190116195624256.png]: /images/20220326/46b0b880584e40c18c8fc4c49dc46c88.png
[flink-master.sh]: http://flink-master.sh
[worker.sh]: http://worker.sh
[flink-worker.sh]: http://flink-worker.sh
[20190116200213904.png]: /images/20220326/90e7345a1bfd44a594516dcd5f3c5c3e.png
[2019011620034077.png]: /images/20220326/e067758f1905429abf3f6221626c52fb.png
[http]: http://$
[20190116201156801.png]: /images/20220326/02ed64f917334dd6b75e97efd9815023.png
[20190116201210280.png]: /images/20220326/e3727f29a9914dd89c6552c32640eb6d.png
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3RvbnlfMzI4NDI3Njg1_size_16_color_FFFFFF_t_70 1]: /images/20220326/fc2ba951b70647b7bb3c27a516ea3957.png
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3RvbnlfMzI4NDI3Njg1_size_16_color_FFFFFF_t_70 2]: /images/20220326/1ab3a8153d3c43b3abb34b3abadbb982.png
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3RvbnlfMzI4NDI3Njg1_size_16_color_FFFFFF_t_70 3]: /images/20220326/1bb74e0f1dc84138acec9fd1f363f19b.png
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3RvbnlfMzI4NDI3Njg1_size_16_color_FFFFFF_t_70 4]: /images/20220326/847a8d47d2b949568db88cf8445080f4.png
[20190116201317116.png]: /images/20220326/e7df190f56d04514bc253dfd80093d7f.png
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3RvbnlfMzI4NDI3Njg1_size_16_color_FFFFFF_t_70 5]: /images/20220326/cb7f86c9f86f4804af9ab59e86323a8d.png
[2019011620134271.png]: /images/20220326/4cddad72660f48bbbae066f8f4bbb732.png
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3RvbnlfMzI4NDI3Njg1_size_16_color_FFFFFF_t_70 6]: /images/20220326/4e543f1524b74bd5b12338aaa0b50a9c.png
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3RvbnlfMzI4NDI3Njg1_size_16_color_FFFFFF_t_70 7]: /images/20220326/c2be518cfebe463b9d6b67b698f97383.png
[control.sh]: http://control.sh
[20190116201543851.png]: /images/20220326/9ba7f4ad099e4e3fae0063a21e13df52.png
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3RvbnlfMzI4NDI3Njg1_size_16_color_FFFFFF_t_70 8]: /images/20220326/bfc9b685ecea40b9b2732dcd37d18e89.png
[http_archive.apache.org_dist_activemq_5.10.2_apache-activemq-5.10.2-bin.tar.gz]: http://archive.apache.org/dist/activemq/5.10.2/apache-activemq-5.10.2-bin.tar.gz
[http_central.maven.org_maven2_io_hawt_hawtio-default-offline_1.4.68_hawtio-default-offline-1.4.68.war]: http://central.maven.org/maven2/io/hawt/hawtio-default-offline/1.4.68/hawtio-default-offline-1.4.68.war
[20190116202146592.png]: /images/20220326/57727ba7468644048d2b054e644de932.png
[20190116202202520.png]: /images/20220326/84c0388a8d8f419da9188f2cc3986d31.png
[20190116202311647.png]: /images/20220326/87badd9abc7a42e2a0c6a660d416ea45.png
[2019011620272529.png]: /images/20220326/844c5b1f213140d8ae3fd534423eac48.png
[http_www.springframework.org_schema_beans]: http://www.springframework.org/schema/beans%5C
[http_www.w3.org_2001_XMLSchema-instance]: http://www.w3.org/2001/XMLSchema-instance%5C
[http_www.springframework.org_schema_beans 1]: http://www.springframework.org/schema/beans
[http_www.springframework.org_schema_beans_spring-beans.xsd]: http://www.springframework.org/schema/beans/spring-beans.xsd
[http_activemq.apache.org_schema_core]: http://activemq.apache.org/schema/core
[http_activemq.apache.org_schema_core_activemq-core.xsd]: http://activemq.apache.org/schema/core/activemq-core.xsd%5C%22%3E%22
[http_activemq.apache.org_schema_core 1]: http://activemq.apache.org/schema/core%5C
[http_www.springframework.org_schema_beans_spring-beans.xsd 1]: http://www.springframework.org/schema/beans/spring-beans.xsd%5C%22%3E%22
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3RvbnlfMzI4NDI3Njg1_size_16_color_FFFFFF_t_70 9]: /images/20220326/5c8bfc63f1604d8981cabc3070b1fb51.png
[20190116203640789.jpg]: /images/20220326/3d6905f74f474e8cb3ab7978e9540f41.png
[https_gitee.com_tony429001986_flink-cdh]: https://gitee.com/tony429001986/flink-cdh
[https_gitee.com_tony429001986_activemq-cdh]: https://gitee.com/tony429001986/activemq-cdh