Barman 安装

淡淡的烟草味﹌ 2022-05-22 10:52 126阅读 0赞

yum -y install gcc

[https://sourceforge.net/projects/pgbarman/?source=typ\_redirect][https_sourceforge.net_projects_pgbarman_source_typ_redirect]

[https://sourceforge.net/projects/pgbarman/files/2.3/][https_sourceforge.net_projects_pgbarman_files_2.3]

[https://www.pgbarman.org/index.html][https_www.pgbarman.org_index.html]

wget  [https://jaist.dl.sourceforge.net/project/pgbarman/2.3/barman-2.3.tar.gz][https_jaist.dl.sourceforge.net_project_pgbarman_2.3_barman-2.3.tar.gz]

[https://pypi.org/project/barman/\#files][https_pypi.org_project_barman_files]

[http://docs.pgbarman.org/release/2.3/barman.5.html][http_docs.pgbarman.org_release_2.3_barman.5.html]

[https://docs.python.org/3/install/index.html\#alternate-installation-the-user-scheme][https_docs.python.org_3_install_index.html_alternate-installation-the-user-scheme]  python 环境

![70][]

Barman (备份和恢复管理器) 是 PostgreSQL 数据库服务器中非常方便的备份和恢复工具，允许远程备份多个服务器，允许从一个备份集中一个命令就恢复数据库。同时还可以对多个备份集进行方便的管理.

Centos7

需要的环境

![70 1][]

OS Centos7

python 2.7.5

172.31.107.1 pg-primary

172.31.107.2

172.31.107.3 pg-barman

分别创建以下账号

useradd barman

passwd barman  \#密码 barman

useradd postgres

passwd postgres  \#密码 postgres

\[root@vlnx107001 ~\]\#  \[root@vlnx107003 ~\]\# 分别

vim /etc/profile

PATH=$PATH:/usr/local/postgresql/bin

PGDATA=/opt/postgresql/data

PGUSER=postgres

PGPORT=5432

LD\_LIBRARY\_PATH=$LD\_LIBRARY\_PATH:/usr/local/postgresql/lib

export PATH

export PGDATA

export PGUSER

export PGPORT

export LD\_LIBRARY\_PATH

保存刷新使其生效

source /etc/profile

![70 2][]

一、

安装并配置参数

172.31.107.3

python 模块

[https://pypi.python.org/pypi/barman/][https_pypi.python.org_pypi_barman]

wget   [https://pypi.python.org/packages/c5/39/4da7c2dbc4f023fba5fb2325febcadf0d0ce0efdc8bd12083a0f65d20653/python-dateutil-2.7.2.tar.gz\#md5=03a08c8bcf0a2b29f1cd21b9de4d12fb][https_pypi.python.org_packages_c5_39_4da7c2dbc4f023fba5fb2325febcadf0d0ce0efdc8bd12083a0f65d20653_python-dateutil-2.7.2.tar.gz_md5_03a08c8bcf0a2b29f1cd21b9de4d12fb]

wget  [https://pypi.python.org/packages/e3/75/1183b5d1663a66aebb2c184e0398724b624cecd4f4b679cb6e25de97ed15/argh-0.26.2.tar.gz\#md5=edda25f3f0164a963dd89c0e3c619973][https_pypi.python.org_packages_e3_75_1183b5d1663a66aebb2c184e0398724b624cecd4f4b679cb6e25de97ed15_argh-0.26.2.tar.gz_md5_edda25f3f0164a963dd89c0e3c619973]

wget  [https://pypi.python.org/packages/3c/21/9741e5e5e63245a8cdafb32ffc738bff6e7ef6253b65953e77933e56ce88/argcomplete-1.9.4.tar.gz\#md5=9bb3b61a849f84723e63051240f74014][https_pypi.python.org_packages_3c_21_9741e5e5e63245a8cdafb32ffc738bff6e7ef6253b65953e77933e56ce88_argcomplete-1.9.4.tar.gz_md5_9bb3b61a849f84723e63051240f74014]

wget  [https://pypi.python.org/packages/74/83/51580322ed0e82cba7ad8e0af590b8fb2cf11bd5aaa1ed872661bd36f462/psycopg2-2.7.4.tar.gz\#md5=70fc57072e084565a42689d416cf2c5c][https_pypi.python.org_packages_74_83_51580322ed0e82cba7ad8e0af590b8fb2cf11bd5aaa1ed872661bd36f462_psycopg2-2.7.4.tar.gz_md5_70fc57072e084565a42689d416cf2c5c]

安装barman需要的附加的包:

sudo aptitude install python-argh

sudo aptitude install python-psycopg2

sudo aptitude install python-dateutil

sudo pip install argcomplete

检测argh的版本

\[zhaowzh@vlnx107003 postgresql\]$ python

>>>import argh

>>>argh.\_\_version\_\_

'0.26.2'

![70 3][]

安装barman

wget  [https://jaist.dl.sourceforge.net/project/pgbarman/2.3/barman-2.3.tar.gz][https_jaist.dl.sourceforge.net_project_pgbarman_2.3_barman-2.3.tar.gz]

tar -zxvf barman-2.3.tar.gz

cd /home/zhaowzh/barman-2.3

./setup.py build

./setup.py install

cp /home/zhaowzh/python-barman/barman-2.3/doc/barman.conf /etc/barman.conf

cp -r  /home/zhaowzh/python-barman/barman-2.3/doc/barman.d  /etc/barman.d

cp /etc/barman.d/ssh-server.conf-template   /etc/barman.d/ssh.conf

cp /etc/barman.d/streaming-server.conf-template   /etc/barman.d/streaming.conf

\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#

\# 以上安装为编译安装。RPM 安装为：

\#yum install gcc -y

\#rpm -ih   [https://download.postgresql.org/pub/repos/yum/10/redhat/rhel-7-x86\_64/pgdg-centos10-10-\#  2.noarch.rpm][https_download.postgresql.org_pub_repos_yum_10_redhat_rhel-7-x86_64_pgdg-centos10-10-_ 2.noarch.rpm]

\#yum install barman -y

\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#

chown barman:barman /opt/postgresql/backup -R

\[root@vlnx107003 ~\]\# vim /etc/cron.d/barman

\# m h  dom mon dow   user     command

\* \*    \*   \*   \*   barman   \[ -x /usr/bin/barman \] && /usr/bin/barman -q cron

![70 4][]

需要确保backup服务器能够以pg超级用户身份连接到PostgreSQL服务器。该操作是强制性的。

\#我们建议在PostgreSQL中创建一个名为的特定用户barman

\#createuser -s -P barman \#密码为 barman

配置

\[root@vlnx107003 ~\]\# vim /etc/barman.conf

barman\_user = barman

barman\_home = /opt/postgresql/backup

log\_file = /var/log/barman/barman.log

log\_level = INFO

minimum\_redundancy = 3

retention\_policy = REDUNDANCY 2

![70 5][]

\[root@vlnx107003 ~\]\# vim /etc/barman.d/ssh.conf

\[vlnx107001.firstshare.cn\]

description = "vlnx107001.firstshare.cn"

ssh\_command = ssh [postgres@vlnx107001.firstshare.cn][postgres_vlnx107001.firstshare.cn]

conninfo = host=vlnx107001.firstshare.cn user=barman dbname=postgres

backup\_method = rsync

archiver = on

![70 6][]

\[root@vlnx107003 ~\]\# vim /etvc/barman.d/streaming.conf

\[vlnx107001.firstshare.cn\]

description = "vlnx107001.firstshare.cn"

conninfo = host=vlnx107001.firstshare.cn user=barman dbname=postgres

backup\_method = postgres

streaming\_conninfo = host=vlnx107001.firstshare.cn user=streaming\_barman dbname=postgres

streaming\_archiver = on

path\_prefix = /usr/local/postgresql/bin

![70 7][]

注：如果要使用 复制插槽时，需要先 创建复制 插槽

\[barman@vlnx107003 ~\]\# barman receive-wal --create-slot vlnx107001.firstshare.cn

二、

打通PostgrSQL服务器和Barman备份机器间的通讯通道 (ssh连接配置）

SSH是一种协议和一组工具，它们允许您打开远程服务器的远程shell并在服务器和本地系统之间复制文件。

SSH密钥交换是一种非常普遍的做法，用于在不同计算机上的用户之间实现安全无密码连接，并且需要将其rsync用于WAL归档和备份。

分别在 172.31.107.1/3 (postgres / barman主目录） 上创建SSH密钥：

由于此密钥必须用于从主机进行连接而不提供密码，因此密钥对创建期间不应输入密码。

\[postgres@vlnx107001 ~\]$ ssh-keygen -t rsa

![70 8][]

从PostgreSQL到Barman

需要从PostgreSQL服务器到备份服务器的SSH连接才能使用该archive\_command设置正确存档WAL文件。

要成功从PostgreSQL服务器连接到备份服务器，必须将PostgreSQL公钥配置到barman用户备份服务器的授权密钥中。

要授权的公钥将存储在postgres用户主目录中的一个名为文件的文件中.ssh/id\_rsa.pub

将密钥传送到备机上并验证

\[postgres@vlnx107001 ~\]$ ssh-copy-id -i .ssh/id\_rsa.pub barman@172.31.107.3

\[postgres@vlnx107001 ~\]$ ssh barman@172.31.107.3 date

![70 9][]

![70 10][]

![70 11][]

同样在 备份机 172.31.107.3 上也创建 ssh密钥

\[barman@vlnx107003 ~\]$ ssh-keygen -t rsa

![70 12][]

![70 13][]

从Barman到PostgreSQL

备份服务器和PostgreSQL服务器之间的SSH连接用于通过rsync进行传统备份。就像从PostgreSQL服务器到备份服务器的连接一样，我们应该在PostgreSQL服务器中为postgres用户授权备份服务器的公钥。

将密钥传送到PostgreSQL主机上并验证

\[barman@vlnx107003 ~\]$ ssh-copy-id -i .ssh/id\_rsa.pub postgres@172.31.107.1

\[barman@vlnx107003 ~\]$ ssh postgres@172.31.107.1 date

![70 14][]  
![70 15][]

三

172.31.107.1

确保backup服务器能够以pg超级用户身份连接到PostgreSQL服务器。该操作是强制性的。

我们建议在PostgreSQL中创建一个名为的特定用户barman

createuser -s -P barman \#密码为 barman

![70 16][]

Barman需要这种连接来协调其与服务器的活动以及监控目的。

建议将密码添加到备份服务器~barman/.pgpass上的文件中。

![70 17][]

在备份服务器 172.31.107.3 上 验证

psql -c 'SELECT version()' -U barman -h 172.31.107.1 postgres

![70 18][]

PostgreSQL WAL arching and replication

需要正确配置PostgreSQL 主服务器（postgresql的服务器）以接受来自Barman服务器的流式复制连接。

PostgreSQL流式连接 配置

如果打算使用WAL流式传输或流式备份，则需要设置流式连接。我们建议在PostgreSQL中创建一个名为的特定用户streaming\_barman，如下所示：

createuser -P --replication streaming\_barman  \#设置密码为 barman

![70 19][]  
建议将密码添加到备份服务器~barman/.pgpass上的文件中。  
![70 20][]

在备份服务器  172.31.107.3 上 验证：

psql -U streaming\_barman -h 172.31.107.1 -c "IDENTIFY\_SYSTEM"  replication=1;

psql -U streaming\_barman -h vlnx107001.firstshare.cn \\

-c "IDENTIFY\_SYSTEM" \\

replication=1

![70 21][]

注：如果不通，检查pg\_hba.conf是否配置对应的IP+USER等信息

配置 postgresql.conf

\[postgres@vlnx107001 data\]$ vim postgresql.conf

wal\_level=replica

wal\_log\_hints = on

archive\_mode = on

archive\_command='rsync -a %p [barman@vlnx107003.firstshare.cn][barman_vlnx107003.firstshare.cn]:/opt/postgresql/backup/$HOSTNAME/incoming/%f'

wal\_keep\_segments = 1000

max\_wal\_senders=3   \#此选项表示允许服务器管理的最大并发流连接数。（如果使用了repmgr要增大该值）

\# 以下参数可选---------------------

max\_replication\_slots=3  \#它表示服务器将允许管理的复制插槽的最大数量。如果您打算使用流式连接通过流式连接接收WAL文件，则需要此参数

![70 22][]

验证wal归档配置

\[barman@vlnx107003~\]barman switch-xlog --force --archive vlnx107001.firstshare.cn

![70 23][]

也可以使用该barman check命令验证WAL归档是否已正确配置

\[barman@vlnx107003 ~\]$ barman check vlnx107001.firstshare.cn

![70 24][]

注：

rebuild-xlogdb

在任何时候，您都可以为特定服务器（或每个服务器，使用all快捷方式）重新生成WAL存档的内容。WAL档案包含在xlog.db文件中，Barman管理的每个服务器都有自己的副本。

该xlog.db文件可以使用该rebuild-xlogdb命令重建。这将扫描所有归档的WAL文件并重新生成归档的元数据。

例如：barman rebuild-xlogdb <server\_name>

vim pg\_hba\_conf

host   all             all             172.31.107.3/32         trust

host replication       streaming\_barman 172.31.107.3/32        trust

host all               barman          172.31.107.3/32         md5

![70 25][]

配置完毕后重启postgresql实例；

pg\_ctl -D /opt/postgresql/data -l /opt/postgresql/logs/logfile restart

172.31.107.3

/usr/bin/python /usr/bin/barman backup all

![70 26][]

base：基本备份文件的保存目录

incoming：在Postgresql将其完成的WAL文件存放到这个目录归档

wals： Barman复制的内容 incoming目录到wals目录

errors：Barman备份时遇到的error信息

streaming：

设置自动运行备份

\[barman@vlnx107003 ~\]$ crontab -e

\# 每天11:30 对数据库服务器进行完整备份

30 11 \* \* \* /usr/bin/barman backup all

\#每分钟运行一次，并对wal文件和基本备份文件执行维护操作；如果设置了 /etc/cron.d/barman  就不要设置这里的定时JOB。

\* \* \* \* \* /usr/bin/barman cron

![70 27][]

[https_sourceforge.net_projects_pgbarman_source_typ_redirect]: https://sourceforge.net/projects/pgbarman/?source=typ_redirect
[https_sourceforge.net_projects_pgbarman_files_2.3]: https://sourceforge.net/projects/pgbarman/files/2.3/
[https_www.pgbarman.org_index.html]: https://www.pgbarman.org/index.html
[https_jaist.dl.sourceforge.net_project_pgbarman_2.3_barman-2.3.tar.gz]: https://jaist.dl.sourceforge.net/project/pgbarman/2.3/barman-2.3.tar.gz
[https_pypi.org_project_barman_files]: https://pypi.org/project/barman/#files
[http_docs.pgbarman.org_release_2.3_barman.5.html]: http://docs.pgbarman.org/release/2.3/barman.5.html
[https_docs.python.org_3_install_index.html_alternate-installation-the-user-scheme]: https://docs.python.org/3/install/index.html#alternate-installation-the-user-scheme
[70]: /images/20220522/409a6dc63e29466387ca5006d75bf8c5.png
[70 1]: /images/20220522/55df0104a34d45ebb72460903195bf27.png
[70 2]: /images/20220522/5113c6b6b39744d6afc41a75c8fce0f2.png
[https_pypi.python.org_pypi_barman]: https://pypi.python.org/pypi/barman/
[https_pypi.python.org_packages_c5_39_4da7c2dbc4f023fba5fb2325febcadf0d0ce0efdc8bd12083a0f65d20653_python-dateutil-2.7.2.tar.gz_md5_03a08c8bcf0a2b29f1cd21b9de4d12fb]: https://pypi.python.org/packages/c5/39/4da7c2dbc4f023fba5fb2325febcadf0d0ce0efdc8bd12083a0f65d20653/python-dateutil-2.7.2.tar.gz#md5=03a08c8bcf0a2b29f1cd21b9de4d12fb
[https_pypi.python.org_packages_e3_75_1183b5d1663a66aebb2c184e0398724b624cecd4f4b679cb6e25de97ed15_argh-0.26.2.tar.gz_md5_edda25f3f0164a963dd89c0e3c619973]: https://pypi.python.org/packages/e3/75/1183b5d1663a66aebb2c184e0398724b624cecd4f4b679cb6e25de97ed15/argh-0.26.2.tar.gz#md5=edda25f3f0164a963dd89c0e3c619973
[https_pypi.python.org_packages_3c_21_9741e5e5e63245a8cdafb32ffc738bff6e7ef6253b65953e77933e56ce88_argcomplete-1.9.4.tar.gz_md5_9bb3b61a849f84723e63051240f74014]: https://pypi.python.org/packages/3c/21/9741e5e5e63245a8cdafb32ffc738bff6e7ef6253b65953e77933e56ce88/argcomplete-1.9.4.tar.gz#md5=9bb3b61a849f84723e63051240f74014
[https_pypi.python.org_packages_74_83_51580322ed0e82cba7ad8e0af590b8fb2cf11bd5aaa1ed872661bd36f462_psycopg2-2.7.4.tar.gz_md5_70fc57072e084565a42689d416cf2c5c]: https://pypi.python.org/packages/74/83/51580322ed0e82cba7ad8e0af590b8fb2cf11bd5aaa1ed872661bd36f462/psycopg2-2.7.4.tar.gz#md5=70fc57072e084565a42689d416cf2c5c
[70 3]: /images/20220522/627158094aec4995b3ba7cbac0f4a8d5.png
[https_download.postgresql.org_pub_repos_yum_10_redhat_rhel-7-x86_64_pgdg-centos10-10-_ 2.noarch.rpm]: https://download.postgresql.org/pub/repos/yum/10/redhat/rhel-7-x86_64/pgdg-centos10-10-2.noarch.rpm
[70 4]: /images/20220522/7e00da2516b84da4b198af10418ca0d2.png
[70 5]: /images/20220522/001ec9e3dd294ce9a88110e0b3939508.png
[postgres_vlnx107001.firstshare.cn]: mailto:postgres@vlnx107001.firstshare.cn
[70 6]: /images/20220522/5c68cb0feee544aebb42d5425221acfa.png
[70 7]: /images/20220522/350e1f0a175140c1ac72f625e91ba9de.png
[70 8]: /images/20220522/a6817c4e6c7a4890b943ee1d089e2f03.png
[70 9]: /images/20220522/be5c62e6e9f44f878adb62a31131b7b0.png
[70 10]: /images/20220522/7352c7f6f4b84b05abf769edd0b887b1.png
[70 11]: /images/20220522/b4e3329a9cbc410482a87636fa8988ed.png
[70 12]: /images/20220522/fd46b9ad919842d7a71eb6c616aeeceb.png
[70 13]: /images/20220522/6812a4ff5c2541bdb06c2b78850257b0.png
[70 14]: /images/20220522/ddca2c95c95445a798b1b0af066072fb.png
[70 15]: /images/20220522/291f5ee91ee04abcbd45369ccd2dc1f5.png
[70 16]: /images/20220522/e54e8da3c7a348deab271c2e529ce342.png
[70 17]: /images/20220522/98d6241ef1e84a7aad7e721c1257fb0d.png
[70 18]: /images/20220522/13768f557d3c4db3a7b7d677e2baedae.png
[70 19]: /images/20220522/8680581797c7470cb9e805ac268938b5.png
[70 20]: /images/20220522/21a160bb5aed4053baf5f5c9cc085b78.png
[70 21]: /images/20220522/b6559938fdcb474e842efeec59d08df0.png
[barman_vlnx107003.firstshare.cn]: mailto:barman@vlnx107003.firstshare.cn
[70 22]: /images/20220522/a99e0b8d2369484bac2230b2ffd9e7c6.png
[70 23]: /images/20220522/23242d1a98aa4f49ba11a583e7cc6113.png
[70 24]: /images/20220522/69538c8c7ff5426099136f5d95ffbd5c.png
[70 25]: /images/20220522/65d8c631fb7f4dfead3c4012fef22f36.png
[70 26]: /images/20220522/892ddf35288b4322855eff1d1687c41f.png
[70 27]: /images/20220522/64a4dc37631f4614a499da6a210cb011.png