根据Oracle官方白皮书《Oracle Clusterware 11g Release 2 (11.2) –Using standard
NFS to support a third voting file for extended cluster
configurations》中的方式,配置好NFS服务器,把文件系统挂载到各个RAC节点之后。使用如下方式dd创建一个文件当做第三地表决盘,注意,这里dd出来的文件,会被ASM当做一个member磁盘来使用。区分这里的voting
disk 和voting file的区别。
[grid@extended01 ~]$ ocrcheck Status of Oracle Cluster Registry is as follows : Version : 4 Total space (kbytes) : 491684 Used space (kbytes) : 84756 Available space (kbytes) : 406928 ID : 1234425375 Device/File Name : +OCRC1 Device/File integrity check succeeded
Device/Filenot configured
Device/Filenot configured
Device/Filenot configured
Device/Filenot configured
Cluster registry integrity check succeeded
Logicalcorruptioncheck bypassed due to non-privileged user
[grid@extended01 ~]$ [grid@extended01 vote3nd]$ crsctl query css votedisk ## STATE File Universal Id FileName Disk group -- ----- ----------------- --------- --------- 1. ONLINE 0f6da8ca07774f84bf4f3b118a754d52 (/dev/mapper/s1ocr01) [OCRC1] 2. ONLINE 3af408a91eb74fcbbf83a4a38b77d064 (/dev/mapper/s2ocr07) [OCRC1] 3. ONLINE 3921fae437694f05bf27f01e5adbce99 (/dev/mapper/s1ocr04) [OCRC1]
SQL> alter diskgroup OCRC1 add quorum failgroup FGQ DISK '/vote3nd/vote_nfs_3'; alter diskgroup OCRC1 add quorum failgroup FGQ DISK '/vote3nd/vote_nfs_3' * ERROR at line 1: ORA-15032: not all alterations performed ORA-15031: disk specification '/vote3nd/vote_nfs_3' matches no disks ORA-15014: path '/vote3nd/vote_nfs_3'isnotin the discovery set
在完成这个盘的添加操作和简单梳理之后,新的voting disk构成如下:
[grid@extended01 ~]$ crsctl query css votedisk ## STATE File Universal Id FileName Disk group -- ----- ----------------- --------- --------- 1. ONLINE 0f6da8ca07774f84bf4f3b118a754d52 (/dev/mapper/s1ocr01) [OCRC1] 2. ONLINE ded2df4f62df4f91bf9a5028ecaa4c5b (/vote3nd/vote_nfs_3) [OCRC1] 3. ONLINE 8917739853ce4fa3bf30d120235d0131 (/dev/mapper/s2ocr05) [OCRC1] Located 3 voting disk(s).
[grid@extended01 ~]$ crsctl query css votedisk ## STATE File Universal Id FileName Disk group -- ----- ----------------- --------- --------- 1. ONLINE 0f6da8ca07774f84bf4f3b118a754d52 (/dev/mapper/s1ocr01) [OCRC1] 2. OFFLINE ded2df4f62df4f91bf9a5028ecaa4c5b (/vote3nd/vote_nfs_3) [OCRC1] 3. ONLINE 8917739853ce4fa3bf30d120235d0131 (/dev/mapper/s2ocr05) [OCRC1] Located 3 voting disk(s).
在集群的日志中,有如下信息:
2019-03-1812:02:37.032 [OCSSD(6654)]CRS-1615: No I/O has completed after 50% of the maximum interval. If this persists, voting file /vote3nd/vote_nfs_3 will be considered not functional in99940 milliseconds.
2019-03-1812:03:27.038 [OCSSD(6654)]CRS-1614: No I/O has completed after 75% of the maximum interval. If this persists, voting file /vote3nd/vote_nfs_3 will be considered not functional in49930 milliseconds.
2019-03-1812:03:57.051 [OCSSD(6654)]CRS-1613: No I/O has completed after 90% of the maximum interval. If this persists, voting file /vote3nd/vote_nfs_3 will be considered not functional in19920 milliseconds.
2019-03-1812:04:17.079 [OCSSD(6654)]CRS-1604: CSSD voting fileis offline: /vote3nd/vote_nfs_3; details at (:CSSNM00058:) in /u01/app/grid/diag/crs/extended01/crs/trace/ocssd.trc. 2019-03-1812:04:17.080 [OCSSD(6654)]CRS-1672: The number of voting files currently available 2 has fallen to the minimum number of voting files required 2. Further reduction in voting files will result in eviction and loss of functionality