1.环境：centos7.9
openfiler
oracle19c
rac11g搭建参考 http://blog.itpub.net/70004783/viewspace-2792218/
2.1 IP 规划
|
Hostname |
Host-alias |
type |
ip |
interface |
|
rac1 |
rac1 |
Public ip |
10.8.98.103 |
Eth0 |
|
rac1-vip |
rac1-vip |
Virtual ip |
10.8.98.105 |
Eth0:1 |
|
rac1-priv |
rac1-priv |
Private ip |
192.168.1.103 |
Eth1 |
|
rac2 |
rac2 |
Public ip |
10.8.98.104 |
Eth0 |
|
rac2-vip |
rac2-vip |
Virtual ip |
10.8.98.106 |
Eth0:1 |
|
rac2-priv |
rac2-priv |
Private ip |
192.168.1.104 |
Eth1 |
|
cluster-scan |
cluster-scan |
scan ip |
10.8.98.107 |
Eth0 |
|
openfiler |
openfiler |
10.8.98.100 |
Eth0 | |
|
10.8.98.101 |
Eth1 |
俩节点hosts文件修改
[root@rac1 ~]# cat /etc/hosts 127.0.0.1 localhost localhost.localdomain localhost4 localhost4.localdomain4 ::1 localhost localhost.localdomain localhost6 localhost6.localdomain6 #public ip eth0 10.8.98.103 rac1 10.8.98.104 rac2 #priv ip eth1 192.168.1.103 rac1-priv 192.168.1.104 rac2-priv #vip ip 10.8.98.105 rac1-vip 10.8.98.106 rac2-vip #scan ip 10.8.98.107 cluster-scan
2.2 目录规划
|
Grid infrastructure |
Oracle database |
|
HOME=/home/oracle |
HOME=/home/oracle |
|
ORACLE_BASE=/u01/app/grid |
ORACLE_BASE=/u01/app/oracle |
|
ORACLE_HOME=/u01/app/19c/grid |
ORACLE_HOME=/u01/app/oracle/product/19c/db_1 |
2.3 ORACLE SID
|
db_name |
prod |
|
Node 1 instance sid |
prod1 |
|
Node 2 instance sid |
prod2 |
2.4 存储规划
存储LUN （分区）规划原则（生产环境）
1. 数据文件和归档文件底层属于不同的raid 组，属于不通的DG( 磁盘组)
2. 在线日志文件同一组中不同成员分别存储在两个DG 中
3. 控制文件不同成员分别存储在两个DG 中
4. Ocr 和votedisk 存放在数据之外单独的ASM 磁盘组
ASM 磁盘划分
|
Rac 节点 |
Lun name |
Asm 磁盘名称 /alias |
Size |
ASM 磁盘组名称 |
冗余类型 |
|
Rac1 |
asmocrvote1 |
1G |
OCRDG |
High/normal | |
|
asmocrvote2 |
1G | ||||
|
asmocrvote3 |
1G | ||||
|
asmdata01 |
20G |
DATADG |
external | ||
|
asmdata02 |
20G | ||||
|
asmarch01 |
10G |
FRADG |
external | ||
|
asmmgmt01 |
30G |
MGMTDG |
external | ||
|
Rac2 |
asmocrvote1 |
1G |
SYSTEMDG |
High/normal | |
|
asmocrvote2 |
1G | ||||
|
asmocrvote3 |
1G | ||||
|
asmdata01 |
20G |
DATADG |
external | ||
|
asmdata02 |
20G | ||||
|
asmarch01 |
10G |
FRADG |
external | ||
|
asmmgmt01 |
30G |
MGMTDG |
external |
我这边时搭建的测试环境，生产环境可自己调整
openfile的搭建参考 http://blog.itpub.net/70004783/viewspace-2791487/
本地yum源的搭建参考 http://blog.itpub.net/70004783/viewspace-2789438/
安装需要的软件列表
yum install -y bc yum install -y compat-libcap1* yum install -y compat-libcap* yum install -y binutils yum install -y compat-libstdc++-33 yum install -y elfutils-libelf yum install -y elfutils-libelf-devel yum install -y gcc yum install -y gcc-c++ yum install -y glibc-2.5 yum install -y glibc-common yum install -y glibc-devel yum install -y glibc-headers yum install -y ksh libaio yum install -y libaio-devel yum install -y libgcc yum install -y libstdc++ yum install -y libstdc++-devel yum install -y make yum install -y sysstat yum install -y unixODBC yum install -y unixODBC-devel yum install -y binutils* yum install -y compat-libstdc* yum install -y elfutils-libelf* yum install -y gcc* yum install -y glibc* yum install -y ksh* yum install -y libaio* yum install -y libgcc* yum install -y libstdc* yum install -y make* yum install -y sysstat* yum install -y libXp* yum install -y glibc-kernheaders yum install -y net-tools-*
2.1 创建用户组，用户和目录
在两个节点增加用户与组：
/usr/sbin/groupadd -g 54321 oinstall /usr/sbin/groupadd -g 54322 dba /usr/sbin/groupadd -g 54323 oper /usr/sbin/groupadd -g 54324 backupdba /usr/sbin/groupadd -g 54325 dgdba /usr/sbin/groupadd -g 54326 kmdba /usr/sbin/groupadd -g 54327 asmdba /usr/sbin/groupadd -g 54328 asmoper /usr/sbin/groupadd -g 54329 asmadmin /usr/sbin/groupadd -g 54330 racdba /usr/sbin/useradd -u 54321 -g oinstall -G dba,asmdba,backupdba,dgdba,kmdba,racdba,oper oracle /usr/sbin/useradd -u 54331 -g oinstall -G dba,oper,backupdba,dgdba,kmdba,asmdba,asmoper,asmadmin,racdba grid
修改用户密码：
passwd grid
passwd oracle
登陆测试（必须做），分别用oracle,grid用户通过ssh登录，按提示修改密码
目录
mkdir -p /u01/app/19c/grid mkdir -p /u01/app/grid mkdir -p /u01/app/oraInventory chown -R grid:oinstall /u01 mkdir -p /u01/app/oracle mkdir -p /u01/app/oracle/product/19c/db_1 chown -R oracle:oinstall /u01/app/oracle chmod -R 775 /u01
2.修改操作系统参数2节点
修改/etc/security/limits.conf文件，增加内容如下：
vi /etc/security/limits.conf
#ORACLE SETTING grid soft nproc 2047 grid hard nproc 16384 grid soft nofile 1024 grid hard nofile 65536 grid soft stack 10240 grid hard stack 32768 oracle soft nproc 2047 oracle hard nproc 16384 oracle soft nofile 1024 oracle hard nofile 65536 oracle soft stack 10240 oracle hard stack 32768 oracle hard memlock unlimited oracle soft memlock unlimited
3.禁用SELINUX
vi /etc/selinux/config 修改下面
SELINUX=disabled
4.关闭防火墙
systemctl stop firewalld systemctl disable firewalld
配置NTP
systemctl start chronyd systemctl enable chronyd cat /etc/chrony.conf 配置自己内网的ntp服务器即可
禁用avahi
systemctl stop avahi-daemon.socket systemctl stop avahi-daemon.service systemctl disable avahi-daemon.socket systemctl disable avahi-daemon.service
5、内核参数设置
vi /etc/sysctl.conf 添加如下
添加以下 #ORACLE_SETTING fs.file-max = 6815744 kernel.sem = 250 32000 100 128 kernel.shmmni = 4096 kernel.panic_on_oops = 1 net.core.rmem_default = 262144 net.core.rmem_max = 4194304 net.core.wmem_default = 262144 net.core.wmem_max = 1048576 net.ipv4.conf.all.rp_filter = 2 net.ipv4.conf.default.rp_filter = 2 fs.aio-max-nr = 1048576 net.ipv4.ip_local_port_range = 9000 65500 net.ipv4.ipfrag_high_thresh = 16777216 net.ipv4.ipfrag_low_thresh = 15728640 vm.swappiness=5 #需要单独计算（见下面计算方法） kernel.shmall = 1887436 kernel.shmmax = 4294967296 vm.nr_hugepages = 2089 vm.min_free_kbytes=5079 #kernel.shmall计算方法 #setting for kernel.shmall 是全部允许使用的共享内存大小,这个可以设置为内存的 90%,单位是个数。 #例如 16G 内存，16*1024*1024*1024*90% = 15461882265， #shmall 的大小为 4096字节为pagesize大小 (getconf PAGESIZE可得到) #此系统为8G kernel.shmall=8*1024*1024*1024*90%/4096=1887436 #kernel.shmmax计算方法 #setting for kernel.shmmax oracle推荐物理内存一半大小 单位bytes SHMMAX参数：Linux进程可以分配的单独共享内存段的最大值。一般设置#为内存总大小的一半。 #这个值的设置应该大于SGA_MAX_TARGET或MEMORY_MAX_TARGET的值，因此对于安装Oracle数据库的系统，shmmax的值应该比内存的二分之一大一些。Share memory max #50%物理内存 8G*1024*1024*1024*0.5=4294967296 #vm.nr_hugepages计算方法 #setting up HugePage Memory (grep Huge /proc/meminfo查看,一般为2M) 对于只使用Oracle的服务器来说，把Hugepage设置成SGA(所有instance SGA之和)大小即可。 #如果增加HugePage或添加物理内存或者是当前服务器增加了新的instance以及SGA发生变化，应该重新设置所需的HugePage，设置过大，可能图形界面有问题。 #大小略大于 SGA=8G*51% vm.nr_hugepages=8G*51%/2M=8*1024M*51%/2M=2089 #vm.min_free_kbytes计算方法 #min physical memory 0.5%的物理内存 8*1024*1024*0.5%=5079
让配置生效：
sysctl -p
6、加载pam_limits.so模块
vi /etc/pam.d/login #ORACLE SETTING session required pam_limits.so
7、关闭zeroconf
vi /etc/sysconfig/network NOZEROCONF=yes
8.配置grid和oracle用户的环境变量
节点1 配置grid
[grid@rac1:/home/grid]$cat .bash_profile # .bash_profile # Get the aliases and functions if [ -f ~/.bashrc ]; then . ~/.bashrc fi # User specific environment and startup programs PATH=$PATH:$HOME/.local/bin:$HOME/bin export PATH PS1="[`whoami`@`hostname`:"'$PWD]$' export PS1 umask 022 alias sqlplus="rlwrap sqlplus" export TMP=/tmp export export TMPDIR=$TMP export ORACLE_HOSTNAME=rac1 ORACLE_SID=+ASM1; export ORACLE_SID ORACLE_TERM=xterm; export ORACLE_TERM ORACLE_BASE=/u01/app/grid; export ORACLE_BASE ORACLE_HOME=/u01/app/19c/grid; export ORACLE_HOME NLS_DATE_FORMAT="yyyy-mm-dd HH24:MI:SS"; export NLS_DATE_FORMAT PATH=.:$PATH:$HOME/bin:$ORACLE_HOME/bin; export PATH THREADS_FLAG=native; export THREADS_FLAG if [ $USER = "oracle" ] || [ $USER = "grid" ]; then if [ $SHELL = "/bin/ksh" ]; then ulimit -p 16384 ulimit -n 65536 else ulimit -u 16384 -n 65536 fi umask 022 fi [grid@rac1:/home/grid]$
节点2 一样，只需要更改以下2行
export ORACLE_HOSTNAME=rac2 ORACLE_SID=+ASM2; export ORACLE_SID
节点1配置oracle
[oracle@rac1:/home/oracle]$cat .bash_profile # .bash_profile # Get the aliases and functions if [ -f ~/.bashrc ]; then . ~/.bashrc fi # User specific environment and startup programs PATH=$PATH:$HOME/.local/bin:$HOME/bin export PATH PS1="[`whoami`@`hostname`:"'$PWD]$' alias sqlplus="rlwrap sqlplus" alias rman="rlwrap rman" export PS1 export TMP=/tmp export export TMPDIR=$TMP export ORACLE_HOSTNAME=rac1 export ORACLE_UNQNAME=prodpri ORACLE_BASE=/u01/app/oracle; export ORACLE_BASE ORACLE_HOME=$ORACLE_BASE/product/19c/db_1; export ORACLE_HOME ORACLE_SID=prod1; export ORACLE_SID ORACLE_TERM=xterm; export ORACLE_TERM NLS_DATE_FORMAT="yyyy-mm-dd HH24:MI:SS"; export NLS_DATE_FORMAT NLS_LANG=AMERICAN_AMERICA.ZHS16GBK;export NLS_LANG PATH=.:$PATH:$HOME/bin:$ORACLE_BASE/product/19c/db_1/bin:$ORACLE_HOME/bin; export PATH THREADS_FLAG=native; export THREADS_FLAG if [ $USER = "oracle" ] || [ $USER = "grid" ]; then if [ $SHELL = "/bin/ksh" ]; then ulimit -p 16384 ulimit -n 65536 else ulimit -u 16384 -n 65536 fi umask 022 fi
节点2一样，需要更改2行
export ORACLE_HOSTNAME=rac2 ORACLE_SID=prod2; export ORACLE_SID
9. 安装配置iscsi
yum install iscsi-initiator-utils* -y 检查是否开机启动 systemctl list-unit-files | grep iscsi 如果不是,则这样设置 systemctl enable iscsid.service systemctl enable iscsi.service
启动iscsi服务
systemctl restart iscsi systemctl restart iscsid 发现存储上的iscsi目标 iscsiadm -m discovery -t st -p 10.8.98.100:3260 登陆目标 iscsiadm -m node --loginall=all
察看iscsi信息，是不是2条链路
iscsiadm -m session
[root@rac1 ~]# iscsiadm -m session tcp: [1] 10.8.98.100:3260,1 iqn.2006-01.com.openfiler:tsn.c97222275d9c (non-flash) tcp: [2] 10.8.98.101:3260,1 iqn.2006-01.com.openfiler:tsn.c97222275d9c (non-flash) [root@rac1 ~]#
ls -l /dev/disk/by-path/
因为我们是手动发现的iscsi，所以如果重启则会消失，所以将iscsi目标写入iscsi配置文件中
vi /etc/iscsi/initiatorname.iscsi
InitiatorName=
iqn.2006-01.com.openfiler:tsn.c97222275d9c
重启iscsi服务
systemctl restart iscsi systemctl restart iscsid
刷新新增加iscsi 存储目标
iscsiadm -m session -R
察看iscsi通道
cat /proc/scsi/scsi
删除/注销target连接
iscsiadm -m node --logoutall=all
10.安装多路径
yum install device-mapper*
检查device-mapper有没有安装
rpm -qa | grep device-mapper
安装未安装的rpm包
设置maltipath开机启动
[root@rac1 ntp]# systemctl list-unit-files | grep multipath
multipathd.service enabled
把multipath模块加入内核
modprobe dm-multipath
modprobe dm-round-robin
/sbin/mpathconf -help
/sbin/mpathconf --enable
启动服务
systemctl restart multipathd
配置multipath -ll
[root@rac1 ~]# multipath -ll mpathe (14f504e46494c45526e494c786a632d69584c502d6e6c4e44) dm-6 OPNFILER,VIRTUAL-DISK size=20G features='0' hwhandler='0' wp=rw |-+- policy='service-time 0' prio=1 status=active | `- 3:0:0:4 sdk 8:160 active ready running `-+- policy='service-time 0' prio=1 status=enabled `- 4:0:0:4 sdj 8:144 active ready running mpathd (14f504e46494c45526c4c31396b682d344342732d7149316d) dm-5 OPNFILER,VIRTUAL-DISK size=20G features='0' hwhandler='0' wp=rw |-+- policy='service-time 0' prio=1 status=active | `- 3:0:0:3 sdi 8:128 active ready running `-+- policy='service-time 0' prio=1 status=enabled `- 4:0:0:3 sdh 8:112 active ready running mpathc (14f504e46494c45524562586d37472d656533512d4463437a) dm-4 OPNFILER,VIRTUAL-DISK size=1.0G features='0' hwhandler='0' wp=rw |-+- policy='service-time 0' prio=1 status=active | `- 3:0:0:2 sdg 8:96 active ready running `-+- policy='service-time 0' prio=1 status=enabled `- 4:0:0:2 sdf 8:80 active ready running mpathb (14f504e46494c45524e32653170322d6a7743732d566b394f) dm-3 OPNFILER,VIRTUAL-DISK size=1.0G features='0' hwhandler='0' wp=rw |-+- policy='service-time 0' prio=1 status=active | `- 3:0:0:1 sde 8:64 active ready running `-+- policy='service-time 0' prio=1 status=enabled `- 4:0:0:1 sdd 8:48 active ready running mpatha (14f504e46494c455278764265447a2d306571342d57524461) dm-2 OPNFILER,VIRTUAL-DISK size=1.0G features='0' hwhandler='0' wp=rw |-+- policy='service-time 0' prio=1 status=active | `- 3:0:0:0 sdc 8:32 active ready running `-+- policy='service-time 0' prio=1 status=enabled `- 4:0:0:0 sdb 8:16 active ready running mpathh (14f504e46494c45526d474e7946522d576f5a782d6d33756b) dm-9 OPNFILER,VIRTUAL-DISK size=10G features='0' hwhandler='0' wp=rw |-+- policy='service-time 0' prio=1 status=active | `- 3:0:0:7 sdp 8:240 active ready running `-+- policy='service-time 0' prio=1 status=enabled `- 4:0:0:7 sdq 65:0 active ready running mpathg (14f504e46494c455278336e304d762d36574b782d7a675463) dm-8 OPNFILER,VIRTUAL-DISK size=30G features='0' hwhandler='0' wp=rw |-+- policy='service-time 0' prio=1 status=active | `- 3:0:0:6 sdn 8:208 active ready running `-+- policy='service-time 0' prio=1 status=enabled `- 4:0:0:6 sdo 8:224 active ready running mpathf (14f504e46494c4552306e664a52432d4c3564582d75473136) dm-7 OPNFILER,VIRTUAL-DISK size=20G features='0' hwhandler='0' wp=rw |-+- policy='service-time 0' prio=1 status=active | `- 3:0:0:5 sdl 8:176 active ready running `-+- policy='service-time 0' prio=1 status=enabled `- 4:0:0:5 sdm 8:192 active ready running [root@rac1 ~]#
根据上面的磁盘大小以及wwid号
统计以及规划如下
14f504e46494c455278764265447a2d306571342d57524461 1g asmvote01 14f504e46494c45524e32653170322d6a7743732d566b394f 1g asmvote02 14f504e46494c45524562586d37472d656533512d4463437a 1g asmvote03 14f504e46494c45526c4c31396b682d344342732d7149316d 20g asmdata01 14f504e46494c45526e494c786a632d69584c502d6e6c4e44 20g asmdata02 14f504e46494c4552306e664a52432d4c3564582d75473136 20g asmdata03 14f504e46494c455278336e304d762d36574b782d7a675463 30g asmmgmt01 14f504e46494c45526d474e7946522d576f5a782d6d33756b 10g asmfra01
还有两个命令可以查找uuid
multipath -v3
more /etc/multipath/wwids
根据以上得到的资料修改多路径的配置文件
备份配置文件模板
[root@rac1 ~]# cp /etc/multipath.conf /etc/multipath.conf.bak2021
根据上面的规划，改后的配置文件如下
cat /etc/multipath.conf
defaults {
user_friendly_names yes
find_multipaths yes
}
blacklist {
devnode "^(ram|raw|loop|fd|md|dm-|sr|scd|st)[0-9]*"
devnode "^hd[a-z]"
#我这里sda是本地硬盘，所以加黑名单
devnode "^sda"
}
multipaths {
multipath {
wwid 14f504e46494c455278764265447a2d306571342d57524461
alias asmvote01
path_grouping_policy multibus
path_selector "round-robin 0"
failback immediate
}
multipath {
wwid 14f504e46494c45524e32653170322d6a7743732d566b394f
alias asmvote02
path_grouping_policy multibus
path_selector "round-robin 0"
failback immediate
}
multipath {
wwid 14f504e46494c45524562586d37472d656533512d4463437a
alias asmvote03
path_grouping_policy multibus
path_selector "round-robin 0"
failback immediate
}
multipath {
wwid 14f504e46494c45526c4c31396b682d344342732d7149316d
alias asmdata01
path_grouping_policy multibus
path_selector "round-robin 0"
failback immediate
}
multipath {
wwid 14f504e46494c45526e494c786a632d69584c502d6e6c4e44
alias asmdata02
path_grouping_policy multibus
path_selector "round-robin 0"
failback immediate
}
multipath {
wwid 14f504e46494c4552306e664a52432d4c3564582d75473136
alias asmdata03
path_grouping_policy multibus
path_selector "round-robin 0"
failback immediate
}
multipath {
wwid 14f504e46494c455278336e304d762d36574b782d7a675463
alias asmmgmt01
path_grouping_policy multibus
path_selector "round-robin 0"
failback immediate
}
multipath {
wwid 14f504e46494c45526d474e7946522d576f5a782d6d33756b
alias asmfra01
path_grouping_policy multibus
path_selector "round-robin 0"
failback immediate
}
}
devices {
device {
vendor "openfiler "
product "virtual disk"
path_grouping_policy multibus
path_checker readsector0
path_selector "round-robin 0"
hardware_handler "0"
}
}
节点2同理
删除现有多路径
multipath -F
格式化多路径
multipath -v2
启动服务
systemctl restart multipathd
俩节点
multipath -ll
[root@rac1 ~]# multipath -ll asmmgmt01 (14f504e46494c455278336e304d762d36574b782d7a675463) dm-8 OPNFILER,VIRTUAL-DISK size=30G features='0' hwhandler='0' wp=rw `-+- policy='round-robin 0' prio=1 status=active |- 3:0:0:6 sdn 8:208 active ready running `- 4:0:0:6 sdo 8:224 active ready running asmdata03 (14f504e46494c4552306e664a52432d4c3564582d75473136) dm-7 OPNFILER,VIRTUAL-DISK size=20G features='0' hwhandler='0' wp=rw `-+- policy='round-robin 0' prio=1 status=active |- 3:0:0:5 sdl 8:176 active ready running `- 4:0:0:5 sdm 8:192 active ready running asmdata02 (14f504e46494c45526e494c786a632d69584c502d6e6c4e44) dm-6 OPNFILER,VIRTUAL-DISK size=20G features='0' hwhandler='0' wp=rw `-+- policy='round-robin 0' prio=1 status=active |- 3:0:0:4 sdk 8:160 active ready running `- 4:0:0:4 sdj 8:144 active ready running asmvote03 (14f504e46494c45524562586d37472d656533512d4463437a) dm-4 OPNFILER,VIRTUAL-DISK size=1.0G features='0' hwhandler='0' wp=rw `-+- policy='round-robin 0' prio=1 status=active |- 3:0:0:2 sdg 8:96 active ready running `- 4:0:0:2 sdf 8:80 active ready running asmdata01 (14f504e46494c45526c4c31396b682d344342732d7149316d) dm-5 OPNFILER,VIRTUAL-DISK size=20G features='0' hwhandler='0' wp=rw `-+- policy='round-robin 0' prio=1 status=active |- 3:0:0:3 sdi 8:128 active ready running `- 4:0:0:3 sdh 8:112 active ready running asmvote02 (14f504e46494c45524e32653170322d6a7743732d566b394f) dm-3 OPNFILER,VIRTUAL-DISK size=1.0G features='0' hwhandler='0' wp=rw `-+- policy='round-robin 0' prio=1 status=active |- 3:0:0:1 sde 8:64 active ready running `- 4:0:0:1 sdd 8:48 active ready running asmvote01 (14f504e46494c455278764265447a2d306571342d57524461) dm-2 OPNFILER,VIRTUAL-DISK size=1.0G features='0' hwhandler='0' wp=rw `-+- policy='round-robin 0' prio=1 status=active |- 3:0:0:0 sdc 8:32 active ready running `- 4:0:0:0 sdb 8:16 active ready running asmfra01 (14f504e46494c45526d474e7946522d576f5a782d6d33756b) dm-9 OPNFILER,VIRTUAL-DISK size=10G features='0' hwhandler='0' wp=rw `-+- policy='round-robin 0' prio=1 status=active |- 3:0:0:7 sdp 8:240 active ready running `- 4:0:0:7 sdq 65:0 active ready running [root@rac1 ~]#
11.配置udev
cd /usr/share/doc/device-mapper-1.02.170/
cp 12-dm-permissions.rules /etc/udev/rules.d/
[root@rac1 ~]# vi /etc/udev/rules.d/12-dm-permissions.rules
在最后添加如下
# OWNER:="root", GROUP:="root", MODE:="660"
LABEL="dm_end"
ENV{DM_NAME}=="asmvote01", OWNER:="grid", GROUP:="asmadmin", MODE:="660"
ENV{DM_NAME}=="asmvote02", OWNER:="grid", GROUP:="asmadmin", MODE:="660"
ENV{DM_NAME}=="asmvote03", OWNER:="grid", GROUP:="asmadmin", MODE:="660"
ENV{DM_NAME}=="asmdata01", OWNER:="grid", GROUP:="asmadmin", MODE:="660"
ENV{DM_NAME}=="asmdata02", OWNER:="grid", GROUP:="asmadmin", MODE:="660"
ENV{DM_NAME}=="asmdata03", OWNER:="grid", GROUP:="asmadmin", MODE:="660"
ENV{DM_NAME}=="asmmgmt01", OWNER:="grid", GROUP:="asmadmin", MODE:="660"
ENV{DM_NAME}=="asmfra01", OWNER:="grid", GROUP:="asmadmin", MODE:="660"
启动udev
[root@rac1 rules.d]# /sbin/udevadm trigger --type=devices --action=change
检查是否正确
[root@rac1 device-mapper-1.02.170]# ll /dev/dm* brw-rw----. 1 root disk 253, 0 Sep 24 16:32 /dev/dm-0 brw-rw----. 1 root disk 253, 1 Sep 24 16:32 /dev/dm-1 brw-rw----. 1 grid asmadmin 253, 2 Sep 24 16:32 /dev/dm-2 brw-rw----. 1 grid asmadmin 253, 3 Sep 24 16:32 /dev/dm-3 brw-rw----. 1 grid asmadmin 253, 4 Sep 24 16:32 /dev/dm-4 brw-rw----. 1 grid asmadmin 253, 5 Sep 24 16:32 /dev/dm-5 brw-rw----. 1 grid asmadmin 253, 6 Sep 24 16:32 /dev/dm-6 brw-rw----. 1 grid asmadmin 253, 7 Sep 24 16:32 /dev/dm-7 brw-rw----. 1 grid asmadmin 253, 8 Sep 24 16:32 /dev/dm-8 brw-rw----. 1 grid asmadmin 253, 9 Sep 24 16:32 /dev/dm-9
不重启，重新应用udev规则
/sbin/udevadm control --reload-rules && udevadm trigger
2节点重启系统，检查如上则可以了
12.安装集群软件，创建asm磁盘组，安装oracle软件，dbca建库（只截取重要步骤）
[root@rac1 ~]
# yum install tigervnc*[grid@rac1:
/home/grid
]$vncserver
LINUX.X64_193000_grid_home.zip 文件放到grid的ORACLE_HOME 目录（注意是grid用户的），并解压
[grid@rac1 grid]$ pwd /u01/app/19c/grid [grid@rac1 grid]$ ./gridSetup.sh
找到cvuqdisk包在rac俩节点安装。
dns解析的问题，可以忽略
注意：脚本执行顺序，rac1执行第一个脚本，rac2执行第一个脚本，然后rac1执行第二个，rac2执行第二个
asmca图形化界面创建asm磁盘组
将oracle安装包放到oracle用户的$ORACLE_HOME目录下解压，并图形安装（仅安装软件）
oracle用户dbca图形化建库
13、确认rac安装ok
root用户环境变量添加grid的home目录/u01/app/19c/grid/bin
[root@rac1 ~]# cat .bash_profile # .bash_profile # Get the aliases and functions if [ -f ~/.bashrc ]; then . ~/.bashrc fi # User specific environment and startup programs PATH=$PATH:$HOME/bin:/u01/app/19c/grid/bin export PATH [root@rac1 ~]#
[root@rac1 ~]# crsctl status resource -t -------------------------------------------------------------------------------- Name Target State Server State details -------------------------------------------------------------------------------- Local Resources -------------------------------------------------------------------------------- ora.LISTENER.lsnr ONLINE ONLINE rac1 STABLE ONLINE ONLINE rac2 STABLE ora.chad ONLINE ONLINE rac1 STABLE ONLINE ONLINE rac2 STABLE ora.net1.network ONLINE ONLINE rac1 STABLE ONLINE ONLINE rac2 STABLE ora.ons ONLINE ONLINE rac1 STABLE ONLINE ONLINE rac2 STABLE -------------------------------------------------------------------------------- Cluster Resources -------------------------------------------------------------------------------- ora.ASMNET1LSNR_ASM.lsnr(ora.asmgroup) 1 ONLINE ONLINE rac1 STABLE 2 ONLINE ONLINE rac2 STABLE 3 OFFLINE OFFLINE STABLE ora.DATADG.dg(ora.asmgroup) 1 ONLINE ONLINE rac1 STABLE 2 ONLINE ONLINE rac2 STABLE 3 ONLINE OFFLINE STABLE ora.FRADG.dg(ora.asmgroup) 1 ONLINE ONLINE rac1 STABLE 2 ONLINE ONLINE rac2 STABLE 3 ONLINE OFFLINE STABLE ora.LISTENER_SCAN1.lsnr 1 ONLINE ONLINE rac1 STABLE ora.MGMTDG.dg(ora.asmgroup) 1 ONLINE ONLINE rac1 STABLE 2 ONLINE ONLINE rac2 STABLE 3 OFFLINE OFFLINE STABLE ora.MGMTLSNR 1 ONLINE ONLINE rac1 169.254.25.123 192.1 68.1.103,STABLE ora.OCRDG.dg(ora.asmgroup) 1 ONLINE ONLINE rac1 STABLE 2 ONLINE ONLINE rac2 STABLE 3 OFFLINE OFFLINE STABLE ora.asm(ora.asmgroup) 1 ONLINE ONLINE rac1 Started,STABLE 2 ONLINE ONLINE rac2 Started,STABLE 3 OFFLINE OFFLINE STABLE ora.asmnet1.asmnetwork(ora.asmgroup) 1 ONLINE ONLINE rac1 STABLE 2 ONLINE ONLINE rac2 STABLE 3 OFFLINE OFFLINE STABLE ora.cvu 1 ONLINE ONLINE rac1 STABLE ora.mgmtdb 1 ONLINE ONLINE rac1 Open,STABLE ora.prod.db 1 ONLINE ONLINE rac1 Open,HOME=/u01/app/o racle/product/19c/db _1,STABLE 2 ONLINE ONLINE rac2 Open,HOME=/u01/app/o racle/product/19c/db _1,STABLE ora.qosmserver 1 ONLINE ONLINE rac1 STABLE ora.rac1.vip 1 ONLINE ONLINE rac1 STABLE ora.rac2.vip 1 ONLINE ONLINE rac2 STABLE ora.scan1.vip 1 ONLINE ONLINE rac1 STABLE -------------------------------------------------------------------------------- [root@rac1 ~]#
觉得对你有帮助给点个赞吧，欢迎装载。