Oracle 12cR1 RAC Installation Part III - Grid Installation
Material Target and Description
Oracle Real Application Clusters (RAC) is a high-availability solution that allows multiple instances of Oracle Database to run on different servers, accessing a single database. This setup ensures that if one server fails, the database remains accessible through other servers, thus providing both high availability and scalability. Oracle RAC provides a robust solution for enterprises needing high availability and scalability. Proper setup and configuration are crucial for maximizing the benefits of a RAC environment.
Copy Grid software on rac1 and unzip it.
[grid@rac1 ~]$ ls -lrth total 2.3G drwxr-xr-x 7 grid oinstall 137 Jul 7 2014 grid drwxr-xr-x 2 grid oinstall 6 Aug 1 15:20 Videos drwxr-xr-x 2 grid oinstall 6 Aug 1 15:20 Templates drwxr-xr-x 2 grid oinstall 6 Aug 1 15:20 Public drwxr-xr-x 2 grid oinstall 6 Aug 1 15:20 Pictures drwxr-xr-x 2 grid oinstall 6 Aug 1 15:20 Music drwxr-xr-x 2 grid oinstall 6 Aug 1 15:20 Downloads drwxr-xr-x 2 grid oinstall 6 Aug 1 15:20 Documents drwxr-xr-x 2 grid oinstall 6 Aug 1 15:20 Desktop -rw-r--r-- 1 grid oinstall 1.7G Aug 1 16:52 12c-grid-r1-12.1.0.2.0-linux-x86-64-1of2.zip -rw-r--r-- 1 grid oinstall 618M Aug 1 16:52 12c-grid-r1-12.1.0.2.0-linux-x86-64-2of2.zip [grid@rac1 ~]$ unzip 12c-grid-r1-12.1.0.2.0-linux-x86-64-1of2.zip [grid@rac1 ~]$ unzip 12c-grid-r1-12.1.0.2.0-linux-x86-64-2of2.zip
Crosscheck prerequest Cluster Ready Services on both nodes rac1 and rac2
go inside grid and run below command.
[grid@rac1 grid]$ ./runcluvfy.sh stage -pre crsinst -n rac1,rac2 -fixup -verbose
Performing pre-checks for cluster services setup
Checking node reachability...
Check: Node reachability from node "rac1"
Destination Node Reachable?
------------------------------------ ------------------------
rac1 yes
rac2 yes
Result: Node reachability check passed from node "rac1"
Checking user equivalence...
Check: User equivalence for user "grid"
Node Name Status
------------------------------------ ------------------------
rac2 passed
rac1 passed
Result: User equivalence check passed for user "grid"
Checking node connectivity...
Checking hosts config file...
Node Name Status
------------------------------------ ------------------------
rac1 passed
rac2 passed
Verification of the hosts config file successful
Interface information for node "rac1"
Name IP Address Subnet Gateway Def. Gateway HW Address MTU
------ --------------- --------------- --------------- --------------- ----------------- ------
enp0s3 192.168.29.175 192.168.29.0 0.0.0.0 192.168.29.1 08:00:27:87:4D:A3 1500
enp0s8 192.168.29.71 192.168.29.0 0.0.0.0 192.168.29.1 08:00:27:5F:B8:06 1500
enp0s9 192.168.10.1 192.168.10.0 0.0.0.0 192.168.29.1 08:00:27:5F:C5:3A 1500
virbr0 192.168.122.1 192.168.122.0 0.0.0.0 192.168.29.1 52:54:00:A4:99:A4 1500
enp0s3 2405:201:e005:2105:a643:f37d:e07a:b2e2 2405:201:e005:2105:: UNKNOWN fe80::7297:41ff:fef1:15f6 08:00:27:87:4D:A3 1500
Interface information for node "rac2"
Name IP Address Subnet Gateway Def. Gateway HW Address MTU
------ --------------- --------------- --------------- --------------- ----------------- ------
enp0s3 192.168.29.180 192.168.29.0 0.0.0.0 192.168.29.1 08:00:27:69:68:45 1500
enp0s8 192.168.29.72 192.168.29.0 0.0.0.0 192.168.29.1 08:00:27:06:9D:28 1500
enp0s9 192.168.10.2 192.168.10.0 0.0.0.0 192.168.29.1 08:00:27:4C:66:92 1500
virbr0 192.168.122.1 192.168.122.0 0.0.0.0 192.168.29.1 52:54:00:A4:99:A4 1500
enp0s3 2405:201:e005:2105:ca0e:a126:cf8d:434b 2405:201:e005:2105:: UNKNOWN fe80::7297:41ff:fef1:15f6 08:00:27:69:68:45 1500
Check: Node connectivity of subnet "192.168.29.0"
Source Destination Connected?
------------------------------ ------------------------------ ----------------
rac1[192.168.29.175] rac1[192.168.29.71] yes
rac1[192.168.29.175] rac2[192.168.29.180] yes
rac1[192.168.29.175] rac2[192.168.29.72] yes
rac1[192.168.29.71] rac2[192.168.29.180] yes
rac1[192.168.29.71] rac2[192.168.29.72] yes
rac2[192.168.29.180] rac2[192.168.29.72] yes
Result: Node connectivity passed for subnet "192.168.29.0" with node(s) rac1,rac2
Check: TCP connectivity of subnet "192.168.29.0"
Source Destination Connected?
------------------------------ ------------------------------ ----------------
rac1 : 192.168.29.175 rac1 : 192.168.29.175 passed
rac1 : 192.168.29.71 rac1 : 192.168.29.175 passed
rac2 : 192.168.29.180 rac1 : 192.168.29.175 passed
rac2 : 192.168.29.72 rac1 : 192.168.29.175 passed
rac1 : 192.168.29.175 rac1 : 192.168.29.71 passed
rac1 : 192.168.29.71 rac1 : 192.168.29.71 passed
rac2 : 192.168.29.180 rac1 : 192.168.29.71 passed
rac2 : 192.168.29.72 rac1 : 192.168.29.71 passed
rac1 : 192.168.29.175 rac2 : 192.168.29.180 passed
rac1 : 192.168.29.71 rac2 : 192.168.29.180 passed
rac2 : 192.168.29.180 rac2 : 192.168.29.180 passed
rac2 : 192.168.29.72 rac2 : 192.168.29.180 passed
rac1 : 192.168.29.175 rac2 : 192.168.29.72 passed
rac1 : 192.168.29.71 rac2 : 192.168.29.72 passed
rac2 : 192.168.29.180 rac2 : 192.168.29.72 passed
rac2 : 192.168.29.72 rac2 : 192.168.29.72 passed
Result: TCP connectivity check passed for subnet "192.168.29.0"
Check: Node connectivity of subnet "192.168.10.0"
Source Destination Connected?
------------------------------ ------------------------------ ----------------
rac1[192.168.10.1] rac2[192.168.10.2] yes
Result: Node connectivity passed for subnet "192.168.10.0" with node(s) rac1,rac2
Check: TCP connectivity of subnet "192.168.10.0"
Source Destination Connected?
------------------------------ ------------------------------ ----------------
rac1 : 192.168.10.1 rac1 : 192.168.10.1 passed
rac2 : 192.168.10.2 rac1 : 192.168.10.1 passed
rac1 : 192.168.10.1 rac2 : 192.168.10.2 passed
rac2 : 192.168.10.2 rac2 : 192.168.10.2 passed
Result: TCP connectivity check passed for subnet "192.168.10.0"
Check: Node connectivity of subnet "192.168.122.0"
Source Destination Connected?
------------------------------ ------------------------------ ----------------
rac1[192.168.122.1] rac2[192.168.122.1] yes
Result: Node connectivity passed for subnet "192.168.122.0" with node(s) rac1,rac2
Check: TCP connectivity of subnet "192.168.122.0"
Source Destination Connected?
------------------------------ ------------------------------ ----------------
rac1 : 192.168.122.1 rac1 : 192.168.122.1 failed
ERROR:
PRVG-11850 : The system call "connect" failed with error "111" while executing exectask on node "rac1"
Connection refused
rac2 : 192.168.122.1 rac1 : 192.168.122.1 passed
rac1 : 192.168.122.1 rac2 : 192.168.122.1 failed
ERROR:
PRVG-11850 : The system call "connect" failed with error "111" while executing exectask on node "rac1"
Connection refused
rac2 : 192.168.122.1 rac2 : 192.168.122.1 passed
Result: TCP connectivity check failed for subnet "192.168.122.0"
Check: Node connectivity of subnet "2405:201:e005:2105::"
Source Destination Connected?
------------------------------ ------------------------------ ----------------
rac1[2405:201:e005:2105:a643:f37d:e07a:b2e2] rac2[2405:201:e005:2105:ca0e:a126:cf8d:434b] yes
Result: Node connectivity passed for subnet "2405:201:e005:2105::" with node(s) rac1,rac2
Check: TCP connectivity of subnet "2405:201:e005:2105::"
Source Destination Connected?
------------------------------ ------------------------------ ----------------
rac1 : 2405:201:e005:2105:a643:f37d:e07a:b2e2 rac1 : 2405:201:e005:2105:a643:f37d:e07a:b2e2 passed
rac2 : 2405:201:e005:2105:ca0e:a126:cf8d:434b rac1 : 2405:201:e005:2105:a643:f37d:e07a:b2e2 passed
rac1 : 2405:201:e005:2105:a643:f37d:e07a:b2e2 rac2 : 2405:201:e005:2105:ca0e:a126:cf8d:434b passed
rac2 : 2405:201:e005:2105:ca0e:a126:cf8d:434b rac2 : 2405:201:e005:2105:ca0e:a126:cf8d:434b passed
Result: TCP connectivity check passed for subnet "2405:201:e005:2105::"
Interfaces found on subnet "192.168.29.0" that are likely candidates for VIP are:
rac1 enp0s3:192.168.29.175
rac2 enp0s3:192.168.29.180
Interfaces found on subnet "192.168.29.0" that are likely candidates for VIP are:
rac1 enp0s8:192.168.29.71
rac2 enp0s8:192.168.29.72
Interfaces found on subnet "2405:201:e005:2105::" that are likely candidates for VIP are:
rac1 enp0s3:2405:201:e005:2105:a643:f37d:e07a:b2e2
rac2 enp0s3:2405:201:e005:2105:ca0e:a126:cf8d:434b
Interfaces found on subnet "192.168.10.0" that are likely candidates for a private interconnect are:
rac1 enp0s9:192.168.10.1
rac2 enp0s9:192.168.10.2
Checking subnet mask consistency...
Subnet mask consistency check passed for subnet "192.168.29.0".
Subnet mask consistency check passed for subnet "192.168.10.0".
Subnet mask consistency check passed for subnet "192.168.122.0".
Subnet mask consistency check passed for subnet "2405:201:e005:2105::".
Subnet mask consistency check passed.
ERROR:
PRVG-1172 : The IP address "192.168.122.1" is on multiple interfaces "virbr0" on nodes "rac1,rac2"
Result: Node connectivity check failed
Checking multicast communication...
Checking subnet "192.168.29.0" for multicast communication with multicast group "224.0.0.251"...
Check of subnet "192.168.29.0" for multicast communication with multicast group "224.0.0.251" passed.
Check of multicast communication passed.
Checking ASMLib configuration.
Node Name Status
------------------------------------ ------------------------
rac1 passed
rac2 passed
Result: Check for ASMLib configuration passed.
Check: Total memory
Node Name Available Required Status
------------ ------------------------ ------------------------ ----------
rac2 3.5616GB (3734624.0KB) 4GB (4194304.0KB) failed
rac1 3.5616GB (3734624.0KB) 4GB (4194304.0KB) failed
Result: Total memory check failed
Check: Available memory
Node Name Available Required Status
------------ ------------------------ ------------------------ ----------
rac2 2.8803GB (3020236.0KB) 50MB (51200.0KB) passed
rac1 2.8271GB (2964408.0KB) 50MB (51200.0KB) passed
Result: Available memory check passed
Check: Swap space
Node Name Available Required Status
------------ ------------------------ ------------------------ ----------
rac2 3.875GB (4063228.0KB) 3.5616GB (3734624.0KB) passed
rac1 3.875GB (4063228.0KB) 3.5616GB (3734624.0KB) passed
Result: Swap space check passed
Check: Free disk space for "rac2:/usr,rac2:/var,rac2:/etc,rac2:/sbin,rac2:/tmp"
Path Node Name Mount point Available Required Status
---------------- ------------ ------------ ------------ ------------ ------------
/usr rac2 / 44.4404GB 1.0635GB passed
/var rac2 / 44.4404GB 1.0635GB passed
/etc rac2 / 44.4404GB 1.0635GB passed
/sbin rac2 / 44.4404GB 1.0635GB passed
/tmp rac2 / 44.4404GB 1.0635GB passed
Result: Free disk space check passed for "rac2:/usr,rac2:/var,rac2:/etc,rac2:/sbin,rac2:/tmp"
Check: Free disk space for "rac1:/usr,rac1:/var,rac1:/etc,rac1:/sbin,rac1:/tmp"
Path Node Name Mount point Available Required Status
---------------- ------------ ------------ ------------ ------------ ------------
/usr rac1 / 44.4753GB 1.0635GB passed
/var rac1 / 44.4753GB 1.0635GB passed
/etc rac1 / 44.4753GB 1.0635GB passed
/sbin rac1 / 44.4753GB 1.0635GB passed
/tmp rac1 / 44.4753GB 1.0635GB passed
Result: Free disk space check passed for "rac1:/usr,rac1:/var,rac1:/etc,rac1:/sbin,rac1:/tmp"
Check: User existence for "grid"
Node Name Status Comment
------------ ------------------------ ------------------------
rac2 passed exists(54323)
rac1 passed exists(54323)
Checking for multiple users with UID value 54323
Result: Check for multiple users with UID value 54323 passed
Result: User existence check passed for "grid"
Check: Group existence for "oinstall"
Node Name Status Comment
------------ ------------------------ ------------------------
rac2 passed exists
rac1 passed exists
Result: Group existence check passed for "oinstall"
Check: Group existence for "dba"
Node Name Status Comment
------------ ------------------------ ------------------------
rac2 passed exists
rac1 passed exists
Result: Group existence check passed for "dba"
Check: Membership of user "grid" in group "oinstall" [as Primary]
Node Name User Exists Group Exists User in Group Primary Status
---------------- ------------ ------------ ------------ ------------ ------------
rac2 yes yes yes yes passed
rac1 yes yes yes yes passed
Result: Membership check for user "grid" in group "oinstall" [as Primary] passed
Check: Membership of user "grid" in group "dba"
Node Name User Exists Group Exists User in Group Status
---------------- ------------ ------------ ------------ ----------------
rac2 yes yes yes passed
rac1 yes yes yes passed
Result: Membership check for user "grid" in group "dba" passed
Check: Run level
Node Name run level Required Status
------------ ------------------------ ------------------------ ----------
rac2 5 3,5 passed
rac1 5 3,5 passed
Result: Run level check passed
Check: Hard limits for "maximum open file descriptors"
Node Name Type Available Required Status
---------------- ------------ ------------ ------------ ----------------
rac2 hard 65536 65536 passed
rac1 hard 65536 65536 passed
Result: Hard limits check passed for "maximum open file descriptors"
Check: Soft limits for "maximum open file descriptors"
Node Name Type Available Required Status
---------------- ------------ ------------ ------------ ----------------
rac2 soft 1024 1024 passed
rac1 soft 65536 1024 passed
Result: Soft limits check passed for "maximum open file descriptors"
Check: Hard limits for "maximum user processes"
Node Name Type Available Required Status
---------------- ------------ ------------ ------------ ----------------
rac2 hard 16384 16384 passed
rac1 hard 16384 16384 passed
Result: Hard limits check passed for "maximum user processes"
Check: Soft limits for "maximum user processes"
Node Name Type Available Required Status
---------------- ------------ ------------ ------------ ----------------
rac2 soft 16384 2047 passed
rac1 soft 16384 2047 passed
Result: Soft limits check passed for "maximum user processes"
Check: System architecture
Node Name Available Required Status
------------ ------------------------ ------------------------ ----------
rac2 x86_64 x86_64 passed
rac1 x86_64 x86_64 passed
Result: System architecture check passed
Check: Kernel version
Node Name Available Required Status
------------ ------------------------ ------------------------ ----------
rac2 5.4.17-2102.201.3.el7uek.x86_64 3.8.0 passed
rac1 5.4.17-2102.201.3.el7uek.x86_64 3.8.0 passed
Result: Kernel version check passed
Check: Kernel parameter for "semmsl"
Node Name Current Configured Required Status Comment
---------------- ------------ ------------ ------------ ------------ ------------
rac1 250 250 250 passed
rac2 250 250 250 passed
Result: Kernel parameter check passed for "semmsl"
Check: Kernel parameter for "semmns"
Node Name Current Configured Required Status Comment
---------------- ------------ ------------ ------------ ------------ ------------
rac1 32000 32000 32000 passed
rac2 32000 32000 32000 passed
Result: Kernel parameter check passed for "semmns"
Check: Kernel parameter for "semopm"
Node Name Current Configured Required Status Comment
---------------- ------------ ------------ ------------ ------------ ------------
rac1 100 100 100 passed
rac2 100 100 100 passed
Result: Kernel parameter check passed for "semopm"
Check: Kernel parameter for "semmni"
Node Name Current Configured Required Status Comment
---------------- ------------ ------------ ------------ ------------ ------------
rac1 128 128 128 passed
rac2 128 128 128 passed
Result: Kernel parameter check passed for "semmni"
Check: Kernel parameter for "shmmax"
Node Name Current Configured Required Status Comment
---------------- ------------ ------------ ------------ ------------ ------------
rac1 4398046511104 4398046511104 1912127488 passed
rac2 4398046511104 4398046511104 1912127488 passed
Result: Kernel parameter check passed for "shmmax"
Check: Kernel parameter for "shmmni"
Node Name Current Configured Required Status Comment
---------------- ------------ ------------ ------------ ------------ ------------
rac1 4096 4096 4096 passed
rac2 4096 4096 4096 passed
Result: Kernel parameter check passed for "shmmni"
Check: Kernel parameter for "shmall"
Node Name Current Configured Required Status Comment
---------------- ------------ ------------ ------------ ------------ ------------
rac1 1073741824 1073741824 373462 passed
rac2 1073741824 1073741824 373462 passed
Result: Kernel parameter check passed for "shmall"
Check: Kernel parameter for "file-max"
Node Name Current Configured Required Status Comment
---------------- ------------ ------------ ------------ ------------ ------------
rac1 6815744 6815744 6815744 passed
rac2 6815744 6815744 6815744 passed
Result: Kernel parameter check passed for "file-max"
Check: Kernel parameter for "ip_local_port_range"
Node Name Current Configured Required Status Comment
---------------- ------------ ------------ ------------ ------------ ------------
rac1 between 9000 & 65500 between 9000 & 65500 between 9000 & 65535 passed
rac2 between 9000 & 65500 between 9000 & 65500 between 9000 & 65535 passed
Result: Kernel parameter check passed for "ip_local_port_range"
Check: Kernel parameter for "rmem_default"
Node Name Current Configured Required Status Comment
---------------- ------------ ------------ ------------ ------------ ------------
rac1 262144 262144 262144 passed
rac2 262144 262144 262144 passed
Result: Kernel parameter check passed for "rmem_default"
Check: Kernel parameter for "rmem_max"
Node Name Current Configured Required Status Comment
---------------- ------------ ------------ ------------ ------------ ------------
rac1 4194304 4194304 4194304 passed
rac2 4194304 4194304 4194304 passed
Result: Kernel parameter check passed for "rmem_max"
Check: Kernel parameter for "wmem_default"
Node Name Current Configured Required Status Comment
---------------- ------------ ------------ ------------ ------------ ------------
rac1 262144 262144 262144 passed
rac2 262144 262144 262144 passed
Result: Kernel parameter check passed for "wmem_default"
Check: Kernel parameter for "wmem_max"
Node Name Current Configured Required Status Comment
---------------- ------------ ------------ ------------ ------------ ------------
rac1 1048576 1048576 1048576 passed
rac2 1048576 1048576 1048576 passed
Result: Kernel parameter check passed for "wmem_max"
Check: Kernel parameter for "aio-max-nr"
Node Name Current Configured Required Status Comment
---------------- ------------ ------------ ------------ ------------ ------------
rac1 1048576 1048576 1048576 passed
rac2 1048576 1048576 1048576 passed
Result: Kernel parameter check passed for "aio-max-nr"
Check: Kernel parameter for "panic_on_oops"
Node Name Current Configured Required Status Comment
---------------- ------------ ------------ ------------ ------------ ------------
rac1 1 1 1 passed
rac2 1 1 1 passed
Result: Kernel parameter check passed for "panic_on_oops"
Check: Package existence for "binutils"
Node Name Available Required Status
------------ ------------------------ ------------------------ ----------
rac2 binutils-2.27-44.base.0.3.el7_9.1 binutils-2.23.52.0.1 passed
rac1 binutils-2.27-44.base.0.3.el7_9.1 binutils-2.23.52.0.1 passed
Result: Package existence check passed for "binutils"
Check: Package existence for "compat-libcap1"
Node Name Available Required Status
------------ ------------------------ ------------------------ ----------
rac2 compat-libcap1-1.10-7.el7 compat-libcap1-1.10 passed
rac1 compat-libcap1-1.10-7.el7 compat-libcap1-1.10 passed
Result: Package existence check passed for "compat-libcap1"
Check: Package existence for "compat-libstdc++-33(x86_64)"
Node Name Available Required Status
------------ ------------------------ ------------------------ ----------
rac2 compat-libstdc++-33(x86_64)-3.2.3-72.el7 compat-libstdc++-33(x86_64)-3.2.3 passed
rac1 compat-libstdc++-33(x86_64)-3.2.3-72.el7 compat-libstdc++-33(x86_64)-3.2.3 passed
Result: Package existence check passed for "compat-libstdc++-33(x86_64)"
Check: Package existence for "libgcc(x86_64)"
Node Name Available Required Status
------------ ------------------------ ------------------------ ----------
rac2 libgcc(x86_64)-4.8.5-44.0.3.el7 libgcc(x86_64)-4.8.2 passed
rac1 libgcc(x86_64)-4.8.5-44.0.3.el7 libgcc(x86_64)-4.8.2 passed
Result: Package existence check passed for "libgcc(x86_64)"
Check: Package existence for "libstdc++(x86_64)"
Node Name Available Required Status
------------ ------------------------ ------------------------ ----------
rac2 libstdc++(x86_64)-4.8.5-44.0.3.el7 libstdc++(x86_64)-4.8.2 passed
rac1 libstdc++(x86_64)-4.8.5-44.0.3.el7 libstdc++(x86_64)-4.8.2 passed
Result: Package existence check passed for "libstdc++(x86_64)"
Check: Package existence for "libstdc++-devel(x86_64)"
Node Name Available Required Status
------------ ------------------------ ------------------------ ----------
rac2 libstdc++-devel(x86_64)-4.8.5-44.0.3.el7 libstdc++-devel(x86_64)-4.8.2 passed
rac1 libstdc++-devel(x86_64)-4.8.5-44.0.3.el7 libstdc++-devel(x86_64)-4.8.2 passed
Result: Package existence check passed for "libstdc++-devel(x86_64)"
Check: Package existence for "sysstat"
Node Name Available Required Status
------------ ------------------------ ------------------------ ----------
rac2 sysstat-10.1.5-19.el7 sysstat-10.1.5 passed
rac1 sysstat-10.1.5-19.el7 sysstat-10.1.5 passed
Result: Package existence check passed for "sysstat"
Check: Package existence for "gcc"
Node Name Available Required Status
------------ ------------------------ ------------------------ ----------
rac2 gcc-4.8.5-44.0.3.el7 gcc-4.8.2 passed
rac1 gcc-4.8.5-44.0.3.el7 gcc-4.8.2 passed
Result: Package existence check passed for "gcc"
Check: Package existence for "gcc-c++"
Node Name Available Required Status
------------ ------------------------ ------------------------ ----------
rac2 gcc-c++-4.8.5-44.0.3.el7 gcc-c++-4.8.2 passed
rac1 gcc-c++-4.8.5-44.0.3.el7 gcc-c++-4.8.2 passed
Result: Package existence check passed for "gcc-c++"
Check: Package existence for "ksh"
Node Name Available Required Status
------------ ------------------------ ------------------------ ----------
rac2 ksh ksh passed
rac1 ksh ksh passed
Result: Package existence check passed for "ksh"
Check: Package existence for "make"
Node Name Available Required Status
------------ ------------------------ ------------------------ ----------
rac2 make-3.82-24.el7 make-3.82 passed
rac1 make-3.82-24.el7 make-3.82 passed
Result: Package existence check passed for "make"
Check: Package existence for "glibc(x86_64)"
Node Name Available Required Status
------------ ------------------------ ------------------------ ----------
rac2 glibc(x86_64)-2.17-326.0.9.el7_9.3 glibc(x86_64)-2.17 passed
rac1 glibc(x86_64)-2.17-326.0.9.el7_9.3 glibc(x86_64)-2.17 passed
Result: Package existence check passed for "glibc(x86_64)"
Check: Package existence for "glibc-devel(x86_64)"
Node Name Available Required Status
------------ ------------------------ ------------------------ ----------
rac2 glibc-devel(x86_64)-2.17-326.0.9.el7_9.3 glibc-devel(x86_64)-2.17 passed
rac1 glibc-devel(x86_64)-2.17-326.0.9.el7_9.3 glibc-devel(x86_64)-2.17 passed
Result: Package existence check passed for "glibc-devel(x86_64)"
Check: Package existence for "libaio(x86_64)"
Node Name Available Required Status
------------ ------------------------ ------------------------ ----------
rac2 libaio(x86_64)-0.3.109-13.el7 libaio(x86_64)-0.3.109 passed
rac1 libaio(x86_64)-0.3.109-13.el7 libaio(x86_64)-0.3.109 passed
Result: Package existence check passed for "libaio(x86_64)"
Check: Package existence for "libaio-devel(x86_64)"
Node Name Available Required Status
------------ ------------------------ ------------------------ ----------
rac2 libaio-devel(x86_64)-0.3.109-13.el7 libaio-devel(x86_64)-0.3.109 passed
rac1 libaio-devel(x86_64)-0.3.109-13.el7 libaio-devel(x86_64)-0.3.109 passed
Result: Package existence check passed for "libaio-devel(x86_64)"
Check: Package existence for "nfs-utils"
Node Name Available Required Status
------------ ------------------------ ------------------------ ----------
rac2 nfs-utils-1.3.0-0.68.0.1.el7 nfs-utils-1.2.3-15 passed
rac1 nfs-utils-1.3.0-0.68.0.1.el7 nfs-utils-1.2.3-15 passed
Result: Package existence check passed for "nfs-utils"
Checking availability of ports "6200,6100" required for component "Oracle Notification Service (ONS)"
Node Name Port Number Protocol Available Status
---------------- ------------ ------------ ------------ ----------------
rac2 6200 TCP yes successful
rac1 6200 TCP yes successful
rac2 6100 TCP yes successful
rac1 6100 TCP yes successful
Result: Port availability check passed for ports "6200,6100"
Checking availability of ports "42424" required for component "Oracle Cluster Synchronization Services (CSSD)"
Node Name Port Number Protocol Available Status
---------------- ------------ ------------ ------------ ----------------
rac2 42424 TCP yes successful
rac1 42424 TCP yes successful
Result: Port availability check passed for ports "42424"
Checking for multiple users with UID value 0
Result: Check for multiple users with UID value 0 passed
Check: Current group ID
Result: Current group ID check passed
Starting check for consistency of primary group of root user
Node Name Status
------------------------------------ ------------------------
rac2 passed
rac1 passed
Check for consistency of root user's primary group passed
Starting Clock synchronization checks using Network Time Protocol(NTP)...
Checking existence of NTP configuration file "/etc/ntp.conf" across nodes
Node Name File exists?
------------------------------------ ------------------------
rac2 no
rac1 no
Network Time Protocol(NTP) configuration file not found on any of the nodes. Oracle Cluster Time Synchronization Service(CTSS) can be used instead of NTP for time synchronization on the cluster nodes
No NTP Daemons or Services were found to be running
Result: Clock synchronization check using Network Time Protocol(NTP) passed
Checking Core file name pattern consistency...
Core file name pattern consistency check passed.
Checking to make sure user "grid" is not in "root" group
Node Name Status Comment
------------ ------------------------ ------------------------
rac2 passed does not exist
rac1 passed does not exist
Result: User "grid" is not part of "root" group. Check passed
Check default user file creation mask
Node Name Available Required Comment
------------ ------------------------ ------------------------ ----------
rac2 0022 0022 passed
rac1 0022 0022 passed
Result: Default user file creation mask check passed
Checking integrity of file "/etc/resolv.conf" across nodes
Checking the file "/etc/resolv.conf" to make sure only one of 'domain' and 'search' entries is defined
WARNING:
PRVF-5640 : Both 'search' and 'domain' entries are present in file "/etc/resolv.conf" on the following nodes: rac1,rac2
Check for integrity of file "/etc/resolv.conf" passed
Check: Time zone consistency
Result: Time zone consistency check passed
Checking integrity of name service switch configuration file "/etc/nsswitch.conf" ...
Checking if "hosts" entry in file "/etc/nsswitch.conf" is consistent across nodes...
Checking file "/etc/nsswitch.conf" to make sure that only one "hosts" entry is defined
More than one "hosts" entry does not exist in any "/etc/nsswitch.conf" file
All nodes have same "hosts" entry defined in file "/etc/nsswitch.conf"
Check for integrity of name service switch configuration file "/etc/nsswitch.conf" passed
Checking daemon "avahi-daemon" is not configured and running
Check: Daemon "avahi-daemon" not configured
Node Name Configured Status
------------ ------------------------ ------------------------
rac2 no passed
rac1 no passed
Daemon not configured check passed for process "avahi-daemon"
Check: Daemon "avahi-daemon" not running
Node Name Running? Status
------------ ------------------------ ------------------------
rac2 no passed
rac1 no passed
Daemon not running check passed for process "avahi-daemon"
Starting check for /dev/shm mounted as temporary file system ...
ERROR:
PRVE-0421 : No entry exists in /etc/fstab for mounting /dev/shm
PRVE-0421 : No entry exists in /etc/fstab for mounting /dev/shm
Check for /dev/shm mounted as temporary file system failed
Starting check for /boot mount ...
Check for /boot mount passed
Starting check for zeroconf check ...
Check for zeroconf check passed
Pre-check for cluster services setup was unsuccessful on all the nodes.
NOTE:
No fixable verification failures to fix
[grid@rac1 grid]$
start runInstaller and follow steps as shown screenshot.
Enter root password
[grid@rac1 grid]$ ps -ef|grep pmon
grid 6858 1 0 17:18 ? 00:00:00 asm_pmon_+ASM1
grid 20746 1 0 17:42 ? 00:00:00 mdb_pmon_-MGMTDB
grid 32373 5907 0 17:57 pts/1 00:00:00 grep --color=auto pmon
[grid@rac1 grid]$ ps -ef|grep tns
root 16 2 0 15:15 ? 00:00:00 [netns]
grid 8080 1 0 17:20 ? 00:00:00 /u01/app/12.1.0/grid/bin/tnslsnr LISTENER_SCAN2 -no_crs_notify -inherit
grid 8111 1 0 17:20 ? 00:00:00 /u01/app/12.1.0/grid/bin/tnslsnr LISTENER_SCAN3 -no_crs_notify -inherit
grid 9065 1 0 17:21 ? 00:00:00 /u01/app/12.1.0/grid/bin/tnslsnr LISTENER -no_crs_notify -inherit
grid 20676 1 0 17:41 ? 00:00:00 /u01/app/12.1.0/grid/bin/tnslsnr MGMTLSNR -no_crs_notify -inherit
grid 32392 5907 0 17:57 pts/1 00:00:00 grep --color=auto tns
[grid@rac1 grid]$
[grid@rac2 grid]$ ps -ef|grep pmon
grid 7886 1 0 17:27 ? 00:00:00 asm_pmon_+ASM2
grid 24848 5894 0 17:57 pts/1 00:00:00 grep --color=auto pmon
[grid@rac2 grid]$ ps -ef|grep tns
root 16 2 0 15:15 ? 00:00:00 [netns]
grid 8557 1 0 17:27 ? 00:00:00 /u01/app/12.1.0/grid/bin/tnslsnr LISTENER_SCAN1 -no_crs_notify -inherit
grid 9053 1 0 17:28 ? 00:00:00 /u01/app/12.1.0/grid/bin/tnslsnr LISTENER -no_crs_notify -inherit
grid 24899 5894 0 17:57 pts/1 00:00:00 grep --color=auto tns
[grid@rac2 grid]$
[grid@rac1 grid]$ cat /etc/oratab
#Backup file is /u01/app/12.1.0/grid/srvm/admin/oratab.bak.rac1 line added by Agent
#
# This file is used by ORACLE utilities. It is created by root.sh
# and updated by either Database Configuration Assistant while creating
# a database or ASM Configuration Assistant while creating ASM instance.
# A colon, ':', is used as the field terminator. A new line terminates
# the entry. Lines beginning with a pound sign, '#', are comments.
#
# Entries are of the form:
# $ORACLE_SID:$ORACLE_HOME:<N|Y>:
#
# The first and second fields are the system identifier and home
# directory of the database respectively. The third field indicates
# to the dbstart utility that the database should , "Y", or should not,
# "N", be brought up at system boot time.
#
# Multiple entries with the same $ORACLE_SID are not allowed.
#
#
+ASM1:/u01/app/12.1.0/grid:N # line added by Agent
-MGMTDB:/u01/app/12.1.0/grid:N # line added by Agent
[grid@rac1 grid]$
[grid@rac2 grid]$ cat /etc/oratab
#Backup file is /u01/app/12.1.0/grid/srvm/admin/oratab.bak.rac2 line added by Agent
#
# This file is used by ORACLE utilities. It is created by root.sh
# and updated by either Database Configuration Assistant while creating
# a database or ASM Configuration Assistant while creating ASM instance.
# A colon, ':', is used as the field terminator. A new line terminates
# the entry. Lines beginning with a pound sign, '#', are comments.
#
# Entries are of the form:
# $ORACLE_SID:$ORACLE_HOME:<N|Y>:
#
# The first and second fields are the system identifier and home
# directory of the database respectively. The third field indicates
# to the dbstart utility that the database should , "Y", or should not,
# "N", be brought up at system boot time.
#
# Multiple entries with the same $ORACLE_SID are not allowed.
#
#
+ASM2:/u01/app/12.1.0/grid:N # line added by Agent
[grid@rac2 grid]$
[root@rac1 ~]# /u01/app/12.1.0/grid/bin/crsctl stop has
CRS-2791: Starting shutdown of Oracle High Availability Services-managed resources on 'rac1'
CRS-2673: Attempting to stop 'ora.crsd' on 'rac1'
CRS-2790: Starting shutdown of Cluster Ready Services-managed resources on 'rac1'
CRS-2673: Attempting to stop 'ora.oc4j' on 'rac1'
CRS-2673: Attempting to stop 'ora.LISTENER.lsnr' on 'rac1'
CRS-2673: Attempting to stop 'ora.cvu' on 'rac1'
CRS-2673: Attempting to stop 'ora.mgmtdb' on 'rac1'
CRS-2673: Attempting to stop 'ora.LISTENER_SCAN2.lsnr' on 'rac1'
CRS-2673: Attempting to stop 'ora.LISTENER_SCAN3.lsnr' on 'rac1'
CRS-2677: Stop of 'ora.cvu' on 'rac1' succeeded
CRS-2672: Attempting to start 'ora.cvu' on 'rac2'
CRS-2676: Start of 'ora.cvu' on 'rac2' succeeded
CRS-2677: Stop of 'ora.LISTENER.lsnr' on 'rac1' succeeded
CRS-2673: Attempting to stop 'ora.rac1.vip' on 'rac1'
CRS-2677: Stop of 'ora.LISTENER_SCAN2.lsnr' on 'rac1' succeeded
CRS-2673: Attempting to stop 'ora.scan2.vip' on 'rac1'
CRS-2677: Stop of 'ora.LISTENER_SCAN3.lsnr' on 'rac1' succeeded
CRS-2673: Attempting to stop 'ora.scan3.vip' on 'rac1'
CRS-2677: Stop of 'ora.rac1.vip' on 'rac1' succeeded
CRS-2672: Attempting to start 'ora.rac1.vip' on 'rac2'
CRS-2677: Stop of 'ora.scan2.vip' on 'rac1' succeeded
CRS-2672: Attempting to start 'ora.scan2.vip' on 'rac2'
CRS-2677: Stop of 'ora.scan3.vip' on 'rac1' succeeded
CRS-2672: Attempting to start 'ora.scan3.vip' on 'rac2'
CRS-2677: Stop of 'ora.mgmtdb' on 'rac1' succeeded
CRS-2673: Attempting to stop 'ora.OCR.dg' on 'rac1'
CRS-2673: Attempting to stop 'ora.MGMTLSNR' on 'rac1'
CRS-2677: Stop of 'ora.MGMTLSNR' on 'rac1' succeeded
CRS-2672: Attempting to start 'ora.MGMTLSNR' on 'rac2'
CRS-2677: Stop of 'ora.OCR.dg' on 'rac1' succeeded
CRS-2676: Start of 'ora.rac1.vip' on 'rac2' succeeded
CRS-2676: Start of 'ora.scan2.vip' on 'rac2' succeeded
CRS-2672: Attempting to start 'ora.LISTENER_SCAN2.lsnr' on 'rac2'
CRS-2676: Start of 'ora.scan3.vip' on 'rac2' succeeded
CRS-2672: Attempting to start 'ora.LISTENER_SCAN3.lsnr' on 'rac2'
CRS-2676: Start of 'ora.MGMTLSNR' on 'rac2' succeeded
CRS-2672: Attempting to start 'ora.mgmtdb' on 'rac2'
CRS-2676: Start of 'ora.LISTENER_SCAN2.lsnr' on 'rac2' succeeded
CRS-2676: Start of 'ora.LISTENER_SCAN3.lsnr' on 'rac2' succeeded
CRS-2677: Stop of 'ora.oc4j' on 'rac1' succeeded
CRS-2672: Attempting to start 'ora.oc4j' on 'rac2'
CRS-2676: Start of 'ora.mgmtdb' on 'rac2' succeeded
CRS-2673: Attempting to stop 'ora.asm' on 'rac1'
CRS-2677: Stop of 'ora.asm' on 'rac1' succeeded
CRS-2676: Start of 'ora.oc4j' on 'rac2' succeeded
CRS-2673: Attempting to stop 'ora.ons' on 'rac1'
CRS-2677: Stop of 'ora.ons' on 'rac1' succeeded
CRS-2673: Attempting to stop 'ora.net1.network' on 'rac1'
CRS-2677: Stop of 'ora.net1.network' on 'rac1' succeeded
CRS-2792: Shutdown of Cluster Ready Services-managed resources on 'rac1' has completed
CRS-2677: Stop of 'ora.crsd' on 'rac1' succeeded
CRS-2673: Attempting to stop 'ora.crf' on 'rac1'
CRS-2673: Attempting to stop 'ora.ctssd' on 'rac1'
CRS-2673: Attempting to stop 'ora.evmd' on 'rac1'
CRS-2673: Attempting to stop 'ora.storage' on 'rac1'
CRS-2673: Attempting to stop 'ora.mdnsd' on 'rac1'
CRS-2673: Attempting to stop 'ora.gpnpd' on 'rac1'
CRS-2677: Stop of 'ora.storage' on 'rac1' succeeded
CRS-2673: Attempting to stop 'ora.asm' on 'rac1'
CRS-2677: Stop of 'ora.crf' on 'rac1' succeeded
CRS-2677: Stop of 'ora.ctssd' on 'rac1' succeeded
CRS-2677: Stop of 'ora.evmd' on 'rac1' succeeded
CRS-2677: Stop of 'ora.mdnsd' on 'rac1' succeeded
CRS-2677: Stop of 'ora.gpnpd' on 'rac1' succeeded
CRS-2677: Stop of 'ora.asm' on 'rac1' succeeded
CRS-2673: Attempting to stop 'ora.cluster_interconnect.haip' on 'rac1'
CRS-2677: Stop of 'ora.cluster_interconnect.haip' on 'rac1' succeeded
CRS-2673: Attempting to stop 'ora.cssd' on 'rac1'
CRS-2677: Stop of 'ora.cssd' on 'rac1' succeeded
CRS-2673: Attempting to stop 'ora.gipcd' on 'rac1'
CRS-2677: Stop of 'ora.gipcd' on 'rac1' succeeded
CRS-2793: Shutdown of Oracle High Availability Services-managed resources on 'rac1' has completed
CRS-4133: Oracle High Availability Services has been stopped.
[root@rac1 ~]#
[grid@rac2 grid]$ ps -ef|grep pmon
grid 7886 1 0 17:27 ? 00:00:00 asm_pmon_+ASM2
grid 25880 1 0 17:59 ? 00:00:00 mdb_pmon_-MGMTDB
grid 27724 5894 0 18:02 pts/1 00:00:00 grep --color=auto pmon
[grid@rac2 grid]$ ps -ef|grep tns
root 16 2 0 15:15 ? 00:00:00 [netns]
grid 8557 1 0 17:27 ? 00:00:00 /u01/app/12.1.0/grid/bin/tnslsnr LISTENER_SCAN1 -no_crs_notify -inherit
grid 9053 1 0 17:28 ? 00:00:00 /u01/app/12.1.0/grid/bin/tnslsnr LISTENER -no_crs_notify -inherit
grid 25612 1 0 17:59 ? 00:00:00 /u01/app/12.1.0/grid/bin/tnslsnr MGMTLSNR -no_crs_notify -inherit
grid 25618 1 0 17:59 ? 00:00:00 /u01/app/12.1.0/grid/bin/tnslsnr LISTENER_SCAN2 -no_crs_notify -inherit
grid 25625 1 0 17:59 ? 00:00:00 /u01/app/12.1.0/grid/bin/tnslsnr LISTENER_SCAN3 -no_crs_notify -inherit
grid 27768 5894 0 18:02 pts/1 00:00:00 grep --color=auto tns
[grid@rac2 grid]$
rac2:
[root@rac2 ~]# /u01/app/12.1.0/grid/bin/crsctl stop has
CRS-2791: Starting shutdown of Oracle High Availability Services-managed resources on 'rac2'
CRS-2673: Attempting to stop 'ora.crsd' on 'rac2'
CRS-2790: Starting shutdown of Cluster Ready Services-managed resources on 'rac2'
CRS-2673: Attempting to stop 'ora.LISTENER_SCAN1.lsnr' on 'rac2'
CRS-2673: Attempting to stop 'ora.rac2.vip' on 'rac2'
CRS-2673: Attempting to stop 'ora.oc4j' on 'rac2'
CRS-2673: Attempting to stop 'ora.mgmtdb' on 'rac2'
CRS-2673: Attempting to stop 'ora.cvu' on 'rac2'
CRS-2673: Attempting to stop 'ora.LISTENER.lsnr' on 'rac2'
CRS-2673: Attempting to stop 'ora.LISTENER_SCAN3.lsnr' on 'rac2'
CRS-2673: Attempting to stop 'ora.LISTENER_SCAN2.lsnr' on 'rac2'
CRS-2677: Stop of 'ora.cvu' on 'rac2' succeeded
CRS-2677: Stop of 'ora.LISTENER_SCAN1.lsnr' on 'rac2' succeeded
CRS-2673: Attempting to stop 'ora.scan1.vip' on 'rac2'
CRS-2677: Stop of 'ora.rac2.vip' on 'rac2' succeeded
CRS-2677: Stop of 'ora.LISTENER.lsnr' on 'rac2' succeeded
CRS-2677: Stop of 'ora.LISTENER_SCAN3.lsnr' on 'rac2' succeeded
CRS-2673: Attempting to stop 'ora.scan3.vip' on 'rac2'
CRS-2677: Stop of 'ora.LISTENER_SCAN2.lsnr' on 'rac2' succeeded
CRS-2673: Attempting to stop 'ora.scan2.vip' on 'rac2'
CRS-2673: Attempting to stop 'ora.rac1.vip' on 'rac2'
CRS-2677: Stop of 'ora.scan1.vip' on 'rac2' succeeded
CRS-2677: Stop of 'ora.rac1.vip' on 'rac2' succeeded
CRS-2677: Stop of 'ora.scan3.vip' on 'rac2' succeeded
CRS-2677: Stop of 'ora.scan2.vip' on 'rac2' succeeded
CRS-2677: Stop of 'ora.mgmtdb' on 'rac2' succeeded
CRS-2673: Attempting to stop 'ora.OCR.dg' on 'rac2'
CRS-2673: Attempting to stop 'ora.MGMTLSNR' on 'rac2'
CRS-2677: Stop of 'ora.OCR.dg' on 'rac2' succeeded
CRS-2673: Attempting to stop 'ora.asm' on 'rac2'
CRS-2677: Stop of 'ora.asm' on 'rac2' succeeded
CRS-2677: Stop of 'ora.MGMTLSNR' on 'rac2' succeeded
CRS-2677: Stop of 'ora.oc4j' on 'rac2' succeeded
CRS-2673: Attempting to stop 'ora.ons' on 'rac2'
CRS-2677: Stop of 'ora.ons' on 'rac2' succeeded
CRS-2673: Attempting to stop 'ora.net1.network' on 'rac2'
CRS-2677: Stop of 'ora.net1.network' on 'rac2' succeeded
CRS-2792: Shutdown of Cluster Ready Services-managed resources on 'rac2' has completed
CRS-2677: Stop of 'ora.crsd' on 'rac2' succeeded
CRS-2673: Attempting to stop 'ora.storage' on 'rac2'
CRS-2673: Attempting to stop 'ora.evmd' on 'rac2'
CRS-2673: Attempting to stop 'ora.gpnpd' on 'rac2'
CRS-2673: Attempting to stop 'ora.mdnsd' on 'rac2'
CRS-2677: Stop of 'ora.storage' on 'rac2' succeeded
CRS-2673: Attempting to stop 'ora.asm' on 'rac2'
CRS-2677: Stop of 'ora.gpnpd' on 'rac2' succeeded
CRS-2677: Stop of 'ora.evmd' on 'rac2' succeeded
CRS-2677: Stop of 'ora.mdnsd' on 'rac2' succeeded
CRS-2677: Stop of 'ora.asm' on 'rac2' succeeded
CRS-2673: Attempting to stop 'ora.cluster_interconnect.haip' on 'rac2'
CRS-2677: Stop of 'ora.cluster_interconnect.haip' on 'rac2' succeeded
CRS-2673: Attempting to stop 'ora.crf' on 'rac2'
CRS-2673: Attempting to stop 'ora.ctssd' on 'rac2'
CRS-2677: Stop of 'ora.crf' on 'rac2' succeeded
CRS-2677: Stop of 'ora.ctssd' on 'rac2' succeeded
CRS-2673: Attempting to stop 'ora.cssd' on 'rac2'
CRS-2677: Stop of 'ora.cssd' on 'rac2' succeeded
CRS-2673: Attempting to stop 'ora.gipcd' on 'rac2'
CRS-2677: Stop of 'ora.gipcd' on 'rac2' succeeded
CRS-2793: Shutdown of Oracle High Availability Services-managed resources on 'rac2' has completed
CRS-4133: Oracle High Availability Services has been stopped.
[root@rac2 ~]#
That’s it.
If you would have any questions or concerns, please leave your comments. I would be glad to explain in more details. Thank you so much for all your feedback and support!