Quick NSQ Cluster

喜欢ヅ旅行 2022-09-26 02:19 186阅读 0赞

’ve been meaning to look at Bitly’s realtime distributed messaging platform NSQ for a while now. It’s written in Go so it’s easy to deploy, and comes with a built-in HTTP interface for statistics, administration, and producers.  
  
I thought I’d quickly share this Bash script to start a little NSQ cluster with 2 nsqlookupd hosts, 5 nsqd nodes, and an instance of nsqadmin running on port 9000.  
  
\#!/usr/bin/env bash  
NSQ\_VERSION=0.3.5  
NSQ\_PACKAGE="nsq-$NSQ\_VERSION.linux-amd64.go1.4.2"  
NSQLOOKUPD\_LOG=/var/log/nsqlookupd.log  
NSQD\_LOG=/var/log/nsqd.log  
NSQADMIN\_LOG=/var/log/nsqadmin.log  
  
wget -nc -qP /usr/src "https://s3.amazonaws.com/bitly-downloads/nsq/$NSQ\_PACKAGE.tar.gz"  
  
if \[ ! -d "/opt/$NSQ\_PACKAGE" \]  
then  
    tar -xzvf "/usr/src/$NSQ\_PACKAGE.tar.gz" -C /opt/  
    for FILE in "/opt/$NSQ\_PACKAGE/bin/\*";  
    do  
        ln -s $FILE /usr/local/bin/  
    done  
fi  
  
for PROCESS in nsqlookupd nsqd nsqadmin;  
do  
    pkill "$PROCESS"  
done  
  
for NODE in \{1..2\};  
do  
    /usr/local/bin/nsqlookupd \\  
        -broadcast-address="nsqlookupd-0$NODE" \\  
        -tcp-address="127.0.0.1:900$NODE" \\  
        -http-address="127.0.0.1:901$NODE" >> "$NSQLOOKUPD\_LOG" 2>&1 &  
done  
  
for NODE in \{1..5\};  
do  
    /usr/local/bin/nsqd \\  
        -broadcast-address="nsqd-0$NODE" \\  
        -tcp-address="127.0.0.1:903$NODE" \\  
        -http-address="127.0.0.1:904$NODE" \\  
        -lookupd-tcp-address="127.0.0.1:9001" \\  
        -lookupd-tcp-address="127.0.0.1:9002" >> "$NSQD\_LOG" 2>&1 &  
done  
  
/usr/local/bin/nsqadmin \\  
    -http-address="0.0.0.0:9000" \\  
    -lookupd-http-address="127.0.0.1:9011" \\  
    -lookupd-http-address="127.0.0.1:9012" >> "$NSQADMIN\_LOG" 2>&1 &  
  
I’m really looking forward to learning more about NSQ, its features look impressive and it’s pretty simple to understand.