gitlab数据迁移至其他gitlb服务器上

「爱情、让人受尽委屈。」 2022-10-03 00:39 256阅读 0赞

需求：

A : 待迁移服务器，上边存有数据

B：接收项目得服务器，本身存在数据

验证方案：

一，搭建gitlab8.15.2

OS:rhel7.4

yum install policycoreutils-python.x86\_64

wget https://mirrors.tuna.tsinghua.edu.cn/gitlab-ce/yum/el7/gitlab-ce-8.15.2-ce.0.el7.x86\_64.rpm

chmod 777 gitlab-ce-8.15.2-ce.0.el7.x86\_64.rpm

rpm -ivh gitlab-ce-8.15.2-ce.0.el7.x86\_64.rpm

\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#更新配置文件\#\#\#\#\#\#\#\#修改数据库为mysql\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#

1）安装MySQL

wget -i -c http://dev.mysql.com/get/mysql57-community-release-el7-10.noarch.rpm

yum -y install mysql57-community-release-el7-10.noarch.rpm

yum -y install mysql-community-server

yum install mysql-devel

2）修改mysql密码

systemctl start mysqld.service

grep "password" /var/log/mysqld.log ===》获得临时密码

mysql -uroot -p \# 回车后会提示输入密码

alter user 'root'@'localhost' identified by '123qweASD!'; ===》修改密码

set global validate\_password\_policy=0; ===》关闭MySQL密码验证

set global validate\_password\_length=1;

注：MySQL需要开启binlog

vim /etc/my.cnf

添加

log-bin=/var/lib/mysql/mysql-bin ====>路径注意权限，否则会启动报错

server-id=10

3）创建必要数据库

CREATE USER 'git'@'localhost' IDENTIFIED BY '123456';

SET GLOBAL innodb\_file\_per\_table=1, innodb\_file\_format=Barracuda, innodb\_large\_prefix=1;

CREATE DATABASE IF NOT EXISTS \`gitlabhq\_production\` DEFAULT CHARACTER SET \`utf8\` COLLATE \`utf8\_general\_ci\`;

GRANT SELECT, INSERT, UPDATE, DELETE, CREATE, CREATE TEMPORARY TABLES, DROP, INDEX, ALTER, LOCK TABLES, REFERENCES ON \`gitlabhq\_production\`.\* TO 'git'@'localhost';

flush privileges;

4）修改配置文件

vim /etc/gitlab/gitlab.rb

修改内容如下

external\_url 'http://10.2.177.31:8090' ===》AIP

gitlab\_rails\['db\_adapter'\] = "mysql2"  
gitlab\_rails\['db\_encoding'\] = "utf8"  
gitlab\_rails\['db\_database'\] = "gitlabhq\_production"  
gitlab\_rails\['db\_username'\] = "git"  
gitlab\_rails\['db\_password'\] = "123456"  
gitlab\_rails\['db\_host'\] = "127.0.0.1"  
gitlab\_rails\['db\_port'\] = 3306  
postgresql\['enable'\] = false

vim /opt/gitlab/embedded/service/gitlab-rails/.bundle/config

修改内容如下：

BUNDLE\_WITHOUT: "development:test:postgres" ===》MySQL改为postgres

5）重构

cd /opt/gitlab/embedded/bin/

./gem install mysql2 --version="0.3.20"

./gem install -i /opt/gitlab/embedded/service/gem/ruby/2.3.0/ mysql2 --version="0.3.20"

//gitlab-rake gitlab:setup

gitlab-ctl reconfigure

gitlab-ctl restart

6)检查

gitlab-rake gitlab:check

\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#同样搭建另一台\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#

保险起见，先备份gitlab

gitlab-rake gitlab:backup:create ====>备份目录/var/opt/gitlab/backups/

\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#

二，备份库以及其他文件

key目录：

/var/opt/gitlab/.ssh/authorized\_keys

====》cp authorized\_keys /opt

仓库目录：

/var/opt/gitlab/git-data/repositories

===》tar cvf repositories\_A.tar repositories ===》cp repositories\_A.tar /opt/

mysql库备份：

先创建一个备份数据库&复制到备份数据库gitlab

mysqldump gitlabhq\_production -uroot -p123qweASD! | mysql gitlab -uroot -p123qweASD!

导出备份数据库：

mysqldump --single-transaction -u root -p -B xx > A.sql ===》cp A.sql /opt

传送文件：将上述3个文件拷贝至接收服务器B：/opt目录下，其他目录也可以

解析binlog

cd mysql-binlog的目录

mysqlbinlog --base64-output=decode-rows -v -d gitlabhq\_production mysql-bin.000001 > t.binlog

三，迁移文件

gitlab命令参考：

https://wiki.archlinux.org/index.php/GitLab

1）合并MySQL数据库

查看t.binlog中的sql语句，按照顺序在mysql 上进行操作

涉及的表为users,namespaces,routes,audit\_events,members,notification\_settings,project\_features,projects,events,project\_authorizations,

protected\_branches,protected\_branch\_merge\_access\_levels,protected\_branch\_push\_access\_levels,events 共13个表

插入数据时注意各个表的id不要与已存数据冲突

2）合并repository数据库

cd /var/opt/gitlab/git-data/

tar xvf repositories\_B.tar ===>将B仓库合并至A中

之后执行gitlab-rake gitlab:import:repos

或者执行

\#chmod -R ug+rwX,o-rwx 仓库path  
\#chmod -R ug-s 仓库path  
\#find 仓库path -type d -print0 | xargs -0 chmod g+s  
\#chown -R git:git 仓库path

3）合并authorized\_keys ====>视情况====》我验证时不用

cat authorized\_keys\_B >> /var/opt/gitlab/.ssh/authorized\_keys

\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\# \#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#MySQL数据库表合并\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#

**1）创建组**涉及4个表

namespaces,routes,members,notification\_settings

验证：假设创建空组B，SQL执行顺序如下

1.1）namespaces 先为组B分配namespace\_id=11，path=B

1.2）routes为组B指定path, routes\_id=15, **routes.source\_id=namespaces\_id ,routes.path=namespaces.path**

**　**　1.3) members 为组B创建member\_id=10, **members.source\_id=namespaces.id**

1.4) notification\_settings为组B创建id=10, **notification\_settings.source\_id=namespace\_id**

测试，修改namespace\_id以及其他关联id,验证能否生成新的组

要点：routes.source\_id=namespaces.id=members.source\_id=notification\_settings.id

routes.path=namespaces.path

\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#测试实例\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#

INSERT INTO gitlabhq\_production.namespaces values(11,'B','B',NULL,'2018-11-24 04:09:59','2018-11-24 04:09:59','Group','',NULL,0,20,0,NULL,1,NULL,NULL);  
INSERT INTO gitlabhq\_production.routes values(15,11,'Namespace','B','2018-11-24 04:09:59','2018-11-24 04:09:59');  
INSERT INTO gitlabhq\_production.members values(10,50,11,'Namespace',1,3,'GroupMember','2018-11-24 04:09:59','2018-11-24 04:09:59',NULL,NULL,NULL,NULL,NULL,NULL);  
INSERT INTO gitlabhq\_production.notification\_settings values(10,1,11,'Namespace',3,'2018-11-24 04:09:59','2018-11-24 04:09:59','\{"new\_note":false,"new\_issue":false,"reopen\_issue":false,"close\_issue":false,"reassign\_issue":false,"new\_merge\_request":false,"reopen\_merge\_request":false,"close\_merge\_request":false,"reassign\_merge\_request":false,"merge\_merge\_request":false,"failed\_pipeline":false,"success\_pipeline":false\}');

\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#

结果：测试通过

**2)创建用户**涉及3个表

users,namespaces,routes

验证：假设创建用户UserA,密码123qweASD!，SQL执行顺序如下

1.1) users为用户创建user\_id, email，authentication\_token具有唯一性

1.2)namespaces创建namespace\_id , **namespaces.owner\_id=users.id ，namespaces.name=users.username namespace的name默认=path**

1.3)routes创建routes\_id, **routes.source\_id=namespaces.id,routes.path=namespaces.path**

1.4) users更新密码

密码会过期，要执行UPDATE gitlabhq\_production.users set password\_expires\_at=NULL where id= 'x'

测试：修改相关关联id，是否会生成新组

要点：users\_id=owner\_id routes.source\_id=namespaces.id

\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#测试实例\#\#\#\#

INSERT INTO gitlabhq\_production.users values(4,'zhangyu512@sohu.com','$2a$10$AibtkRnWuicxnioQ5enWReVnO8upwoVED94Mm3E/U6RQLstggLexm','c601f60659a30dcb49cfd978f5bd0f73b3591cdb562a100f6a0c4d92f65d0ccd','2018-11-24 05:35:52',NULL,0,NULL,NULL,NULL,NULL,'2018-11-24 05:35:52','2018-11-24 05:35:52','zhang',0,10,'','','','CCEPy4qr-kGUUNCzdzmi',2,NULL,0,NULL,'zhangyu',1,0,'active',1,NULL,1,NULL,NULL,NULL,'2018-11-24 05:35:52',NULL,NULL,0,'','zhangyu512@sohu.com',0,0,NULL,NULL,NULL,NULL,0,NULL,'',0,0,NULL,0,0,NULL,NULL,0,0,NULL,'c8ksp6mszdo9is7r9w4cq3t8f',NULL);  
INSERT INTO gitlabhq\_production.namespaces values(15,'zhangyu','zhangyu',4,'2018-11-24 05:35:52','2018-11-24 05:35:52',NULL,'',NULL,0,20,0,NULL,NULL,NULL,NULL);  
INSERT INTO gitlabhq\_production.routes values(19,15,'Namespace','zhangyu','2018-11-24 05:35:52','2018-11-24 05:35:52');  
UPDATE gitlabhq\_production.users set encrypted\_password='$2a$10$6iZkb/N/mJ4lmJIjUlOSvuRZeAH26yyIY.7OB7RfrsykJ3mpiFDRW',reset\_password\_token=NULL,reset\_password\_sent\_at=NULL,updated\_at='2018-11-24 05:36:06',password\_expires\_at='2018-11-24 05:36:06' where id= '4'

UPDATE gitlabhq\_production.users set encrypted\_password='$2a$10$UGo9UflSX9LC9rGGtJqD/Om5b0xBhwPmgBh2Lvapz5T2XE34RK6oO',updated\_at='2018-11-24 05:37:13' where id= '4'  
UPDATE gitlabhq\_production.users set password\_expires\_at=NULL where id= '4'

\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#

测试结果：通过

3）将用户添加至组

涉及2个表 members,notification\_settings

3.1)members表为用户和组建立关联 **members.source\_id=namespaces.id members.user\_id=users.id**

3.2)notification\_settings为用户和组建立关联 notificatiion\_settings.user\_id=users.id notification\_setting.source\_id=namespaces.id

\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#测试实例\#\#\#\#\#\#\#\#\#\#

INSERT INTO gitlabhq\_production.members values(13,10,12,'Namespace',2,3,'GroupMember','2018-11-24 05:59:22','2018-11-24 05:59:22',1,NULL,NULL,NULL,NULL,NULL);  
INSERT INTO gitlabhq\_production.notification\_settings values(13,2,12,'Namespace',3,'2018-11-24 05:59:22','2018-11-24 05:59:22','\{"new\_note":false,"new\_issue":false,"reopen\_issue":false,"close\_issue":false,"reassign\_issue":false,"new\_merge\_request":false,"reopen\_merge\_request":false,"close\_merge\_request":false,"reassign\_merge\_request":false,"merge\_merge\_request":false,"failed\_pipeline":false,"success\_pipeline":false\}');

\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#

测试结果：通过

4）创建project（创建是直接指认组）

涉及project\_features,project,routes,events,project\_authorizations,users

4.1)project\_features 创建2个id , 指定snippets\_access\_level=0

4.2)projects创建project\_id ,name,path

4.3)routes 创建 routes\_id,routes.source\_id=projects.id

4.4)project\_features 设置第二个的project\_features.project\_id=projects.id

4.5)project\_authorizations插入 user\_id=1,project\_id=projects.id

插入user\_id=组.用户的ID，project\_id=projects.id

4.6)users 设置对应用户authorized\_projects\_populated=1

4.7)projects设置has\_external\_issue\_tracker=0 has\_external\_wiki=0

\#\#\#\#\#\#\#\# 测试实例\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#

INSERT INTO gitlabhq\_production.project\_features values(9,NULL,20,20,20,20,20,'2018-11-24 06:21:40','2018-11-24 06:21:40',20);  
UPDATE gitlabhq\_production.project\_features set snippets\_access\_level=0 where id= '9'  
INSERT INTO gitlabhq\_production.project\_features values(10,NULL,20,20,20,20,20,'2018-11-24 06:22:44','2018-11-24 06:22:44',20);  
UPDATE gitlabhq\_production.project\_features set snippets\_access\_level=0 where id= '10'  
INSERT INTO gitlabhq\_production.projects values(1,'A','A','','2018-11-24 06:22:44','2018-11-24 06:22:44',1,11,NULL,NULL,20,0,NULL,'none',0 ,0,NULL,NULL,0,NULL,NULL,1,'BrGVBu9duy\_xm5tfpKc6',NULL,1,3600,0,1,NULL,NULL,1,0,NULL,'default',0,NULL,NULL,'',0);  
INSERT INTO gitlabhq\_production.routes values(21,1,'Project','B/A','2018-11-24 06:22:44','2018-11-24 06:22:44');  
UPDATE gitlabhq\_production.projects set last\_activity\_at='2018-11-24 06:22:44' where id= '1'  
UPDATE gitlabhq\_production.project\_features set project\_id=1 where id= '10'  
INSERT INTO gitlabhq\_production.events values(9,NULL,NULL,NULL,NULL,1,'2018-11-24 06:22:45','2018-11-24 06:22:45',1,1);  
INSERT INTO gitlabhq\_production.project\_authorizations values(2,1,1,50);  
INSERT INTO gitlabhq\_production.project\_authorizations values(1,5,1,10);  
UPDATE gitlabhq\_production.users set authorized\_projects\_populated=1 where id= '5'  
UPDATE gitlabhq\_production.projects set has\_external\_issue\_tracker=0 where id= '1'  
UPDATE gitlabhq\_production.projects set has\_external\_wiki=0 where id= '1'

\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#\#

测试结果：通过

转载于:https://www.cnblogs.com/zy1234567/p/9996567.html