通达信交易接口-GreenPlum分布式集群部署实战

????环境准备

✨1安装包下载

✨2IP及实例规划

192.168.6.12	mdw1	5432	Master host
192.168.6.13	mdw2	5432	Standby host
192.168.6.14	sdw1	主：6000-6001 镜像：7000-7001	segment host1，配置2个主实例+2个镜像实例
192.168.6.15	sdw2	主：6000-6001 镜像：7000-7001	segment host2，配置2个主实例+2个镜像实例

✨3操作系统

[root@jeames~]#cat/etc/centos-releaseCentOSLinuxrelease1810[root@jeames~]#free-mtotalusedfreesharedbuff/cacheavailableMem:37711593407112043365Swap:396703967

????安装前准备

✨1hostname设置

1个master+1个standbymaster，2个segment的集群示例，OS均为CentOS1810–设置host名，4个节点设置hostnamectlset-hostnamemdw1hostnamectlset-hostnamemdw2hostnamectlset-hostnamesdw1hostnamectlset-hostnamesdw2

在通达信交易接口,greenplum中，习惯将Master机器叫做mdw，将Segment机器叫做sdw，dw的含义为DataWarehouse。注意：4个节点设置一致cat>>/etc/hosts<<“EOF”191612mdw1191613mdw2191614sdw1191615sdw2EOF

✨3创建用户

groupadd-g1530gpadminuseradd-g1530-u1530-m-d/home/gpadmin-s/bin/bashgpadminchown-Rgpadmin:gpadmin/home/gpadminecho“gpadmin:jeames”|chpasswd

✨4host文件创建

为所有节点创建一个all_hosts文件，包含所有节点主机名su-gpadminmkdir-p/home/gpadmin/conf/cat>/home/gpadmin/conf/all_hosts<<“EOF”mdw1mdw2sdw1sdw2EOF为所有节点创建一个seg_hosts文件，包含所有的SegmentHost的主机名su-gpadmincat>/home/gpadmin/conf/seg_hosts<<“EOF”sdw1sdw2EOF

✨5配置互信

集群ssh免密,做互信的配置，只在master节点191612操作生成秘钥对ssh-keygen-trsa分发公钥su-gpadminssh-copy-idgpadmin@mdw1ssh-copy-idgpadmin@mdw2ssh-copy-idgpadmin@sdw1ssh-copy-idgpadmin@sdw2

✨6关闭防火墙

每个节点机器root用户操作systemctlstatusfirewalldsystemctlstopfirewalldsystemctldisablefirewalld

✨7禁用selinux

cat /etc/selinux/config

# This file controls the state of SELinux on the system.
# SELINUX= can take one of these three values:
#     enforcing - SELinux security policy is enforced.
#     permissive - SELinux prints warnings instead of enforcing.
#     disabled - No SELinux policy is loaded.
SELINUX=enforcing
# SELINUXTYPE= can take one of three values:
#     targeted - Targeted processes are protected,
#     minimum - Modification of targeted policy. Only selected processes are protected.
#     mls - Multi Level Security protection.
SELINUXTYPE=targeted

sed -i "s#^SELINUX=.*#SELINUX=disabled#g"  /etc/selinux/config
注意：修改后记得重启

????安装GP

✨1安装依赖

##安装依赖包
yum install net-tools -y
yum install libcgroup-tools -y

yum install -y apr apr-util bash bzip2 curl krb5 libcurl libevent libxml2 libyaml 
zlib openldap openssh openssl openssl-libs perl readline rsync R sed tar zip krb5-devel

✨2安装rpm包

## 在所有节点操作，root用户操作

1.默认安装到/usr/local下
rpm -ivh open-source-通达信交易接口,greenplum-db-6.24.3-rhel7-x86_64.rpm

2.赋权,修改该路径gpadmin操作权限
chown -R gpadmin:gpadmin /usr/local/greenplum*

✨4数据库初始化

????GP集群验证

若初始化成功，则GP自动启动，可以看到master节点上的5432已经在listen了，psql进入数据库，开始greenplum之旅。

[gpadmin@mdw1 ~]$ netstat -tulnp | grep 5432
(Not all processes could be identified, non-owned process info
 will not be shown, you would have to be root to see it all.)
tcp        0      0 0.0.0.0:5432            0.0.0.0:*               LISTEN      58954/postgres
tcp6       0      0 :::5432                 :::*                    LISTEN      58954/postgres


[gpadmin@mdw1 ~]$ psql postgres -c "SELECT * FROM pg_stat_replication;"
  pid  | usesysid | usename | application_name | client_addr  | client_hostname | client_port |         backend_start         | backend_xmin |   state
 | sent_location | write_location | flush_location | replay_location | sync_priority | sync_state
-------+----------+---------+------------------+--------------+-----------------+-------------+-------------------------------+--------------+----------
-+---------------+----------------+----------------+-----------------+---------------+------------
 60403 |       10 | gpadmin | gp_walreceiver   | 192.168.6.13 |                 |       33428 | 2023-06-11 15:37:38.811796+08 |              | streaming
 | 0/C000000     | 0/C000000      | 0/C000000      | 0/C000000       |             1 | sync
(1 row)


[gpadmin@mdw1 ~]$ psql -d rptgpdb
psql (9.4.26)
Type "help" for help.

rptgpdb=# l
                               List of databases
   Name    |  Owner  | Encoding |  Collate   |   Ctype    |  Access privileges
-----------+---------+----------+------------+------------+---------------------
 postgres  | gpadmin | UTF8     | en_US.utf8 | en_US.utf8 |
 rptgpdb   | gpadmin | UTF8     | en_US.utf8 | en_US.utf8 |
 template0 | gpadmin | UTF8     | en_US.utf8 | en_US.utf8 | =c/gpadmin         +
           |         |          |            |            | gpadmin=CTc/gpadmin
 template1 | gpadmin | UTF8     | en_US.utf8 | en_US.utf8 | =c/gpadmin         +
           |         |          |            |            | gpadmin=CTc/gpadmin

rptgpdb=# show port;
 port
------
 5432
(1 row)

rptgpdb=# show listen_addresses;
 listen_addresses
------------------
 *
(1 row)

rptgpdb=# select * from gp_segment_configuration order by 1;
 dbid | content | role | preferred_role | mode | status | port | hostname | address |            datadir
------+---------+------+----------------+------+--------+------+----------+---------+--------------------------------
    1 |      -1 | p    | p              | n    | u      | 5432 | mdw1     | mdw1    | /greenplum/data/master/gpseg-1
    2 |       0 | p    | p              | s    | u      | 6000 | sdw1     | sdw1    | /greenplum/data/primary/gpseg0
    3 |       1 | p    | p              | s    | u      | 6001 | sdw1     | sdw1    | /greenplum/data/primary/gpseg1
    4 |       2 | p    | p              | s    | u      | 6000 | sdw2     | sdw2    | /greenplum/data/primary/gpseg2
    5 |       3 | p    | p              | s    | u      | 6001 | sdw2     | sdw2    | /greenplum/data/primary/gpseg3
    6 |       0 | m    | m              | s    | u      | 7000 | sdw2     | sdw2    | /greenplum/data/mirror/gpseg0
    7 |       1 | m    | m              | s    | u      | 7001 | sdw2     | sdw2    | /greenplum/data/mirror/gpseg1
    8 |       2 | m    | m              | s    | u      | 7000 | sdw1     | sdw1    | /greenplum/data/mirror/gpseg2
    9 |       3 | m    | m              | s    | u      | 7001 | sdw1     | sdw1    | /greenplum/data/mirror/gpseg3
   10 |      -1 | m    | m              | s    | u      | 5432 | mdw2     | mdw2    | /greenplum/data/master/gpseg-1
(10 rows)

rptgpdb=# select * from gp_segment_configuration order by hostname,port;
 dbid | content | role | preferred_role | mode | status | port | hostname | address |            datadir
------+---------+------+----------------+------+--------+------+----------+---------+--------------------------------
    1 |      -1 | p    | p              | n    | u      | 5432 | mdw1     | mdw1    | /greenplum/data/master/gpseg-1
   10 |      -1 | m    | m              | s    | u      | 5432 | mdw2     | mdw2    | /greenplum/data/master/gpseg-1
    2 |       0 | p    | p              | s    | u      | 6000 | sdw1     | sdw1    | /greenplum/data/primary/gpseg0
    3 |       1 | p    | p              | s    | u      | 6001 | sdw1     | sdw1    | /greenplum/data/primary/gpseg1
    8 |       2 | m    | m              | s    | u      | 7000 | sdw1     | sdw1    | /greenplum/data/mirror/gpseg2
    9 |       3 | m    | m              | s    | u      | 7001 | sdw1     | sdw1    | /greenplum/data/mirror/gpseg3
    4 |       2 | p    | p              | s    | u      | 6000 | sdw2     | sdw2    | /greenplum/data/primary/gpseg2
    5 |       3 | p    | p              | s    | u      | 6001 | sdw2     | sdw2    | /greenplum/data/primary/gpseg3
    6 |       0 | m    | m              | s    | u      | 7000 | sdw2     | sdw2    | /greenplum/data/mirror/gpseg0
    7 |       1 | m    | m              | s    | u      | 7001 | sdw2     | sdw2    | /greenplum/data/mirror/gpseg1
(10 rows)

文章为作者独立观点，不代表股票配资公司观点

通达信交易接口-GreenPlum分布式集群部署实战

通达信交易接口-轻松掌握Seata源码分析之AT模式整体大纲流程跟踪

通达信交易接口-国产监控数据库产品lepus最新版学习和部署

通达信交易接口-Python中的Math模块

通达信交易接口-Power BI数据分析实战柏拉图的制作