一次GI补丁安装不完整导致的RAC心跳流量异常

一、系统环境

服务器:IBM3850 X86两节点RAC

操作系统:redhat6.8

数据库版本:11.2.0.4


二、故障介绍

巡检中发现数据库未安装任何补丁,停机安装DB PSU后,出现 gc cr block lost/gc current block lost 等待事件,原本私网网卡的大帧配置失效。


三、原因分析

检查数据库的私网信息

SQL> select * from x$ksxpia;

ADDR INDX INST_ID PUB_KSXPIA PICKED_KSXPIA NAME_KSXPIA IP_KSXPIA

---------------- ---------- ---------- ---------- ----------------------------------- --------------- ----------------

00007F528A46E768 0 1 N OSD bond0 10.16.9.1


SQL> select * from v$configured_interconnects;

NAME IP_ADDRESS IS_ SOURCE

--------------- ---------------- --- -------------------------------

bond0 10.16.9.1 NO OS dependent software


[grid@dbsvr1 ~]$ oifcfg getif

bond0 10.16.9.0 global public

bond1 192.168.10.0 global cluster_interconnect


CRS-2302:Cannot get GPnP profile. Error CLSGPNP_NO_DAEMON (GPNPD daemon is not running).


[USER(18925)]CRS-2316:Fatal error: cannot initialize GPnP, CLSGPNP_ERR (Generic GPnP error).

kggpnpInit: failed to init gpnp

WARNING: No cluster interconnect has been specified. Depending on the communication driver configured Oracle cluster traffic may be directed to the public interface of this machine.

Oracle recommends that RAC clustered databases be configured with a private interconnect for enhanced security and performance.


检查集群profile.xml文件

[grid@dbsvr1 peer]$ cat profile.xml

4m05s4qWGOKpVEymNmB7qPuqhFU=iI0hALvlRvjLY2F7mAxocv3XVXGxX7q0mPcwxaNBVRjgjfwsiv0yfQNiLnlpQQbMCxQ6hOdh4h06JBjbsH0Z3DysNC5UzE+5KWE3vp+HvMUWVpdAvYDKttq2Hla99x1XCeBx55SX753PDoeSQmoCE+pNKGMGF/2+BZbPjqoMif0=


检查发现群集的public网段为10.16.9.0,private网段为192.168.10.0

但实际数据库中却使用10.16.9.0作为private网络使用,造成原本私网网卡的大帧配置失效。


四、解决方案

方案一:

登录实例并修改 cluster_interconnects 参数后重启所有实例

alter system set cluster_interconnects='169.254.232.49' scope=spfile sid='orcl1';

alter system set cluster_interconnects='169.254.144.102' scope=spfile sid='orcl2';

方案二:

同时应用GI PSU避免此问题


















请使用浏览器的分享功能分享到微信等