 |
 |
*******************************************************************
* Description: Oracle RAC 12.2.0.1 installation with response file
* Date: 01:10 PM EST, 12/01/2019
*******************************************************************
<1> Pre-work on network level setting:
|
|__ o. Following IP address are needed by setting eth0 network card:
[*** RAC-DB01 ***]
Public IP: 192.168.21.10
Private IP: 192.168.21.10
Virtual IP: 192.168.21.11
[*** RAC-DB02 ***]
Public IP: 192.168.21.12
Private IP: 192.168.21.12
Virtual IP: 192.168.21.13
<2> Verify scanner listener hostname can be resolved on an splite individual server on both nodes:
|
|__ $ nslookup RAC-DB01
|
|__ $ nslookup RAC-DB02
Server: 192.168.21.20
Address: 192.168.21.20#53
Name: rac_scan_listener.emeralit.local
Address: 192.168.21.19
Name: rac_scan_listener.emeralit.local
Address: 192.168.21.18
Name: rac_scan_listener.emeralit.local
Address: 192.168.21.17
<3> Setup user "Oracle" SSH equivalance between 2 nodes with key pair:
|
|__ $ ssh-keygen -t rsa
|
| Generating public/private rsa key pair.
| Enter file in which to save the key (/home/oracle/.ssh/id_rsa):
| Enter passphrase (empty for no passphrase):
| Enter same passphrase again:
| Your identification has been saved in /home/oracle/.ssh/id_rsa.
| Your public key has been saved in /home/oracle/.ssh/id_rsa.pub.
| The key fingerprint is:
| SHA256:J6AhnKlf82udygjUnL7sO5MACBj4v8Vn5XmejFAi3is oracle@RAC-DB01
| The key's randomart image is:
| +---[RSA 2048]----+
| | |
| | . o . . |
| | =.. = |
| | ....= . |
| |. .++o S o o |
| | . oo..O.= = . |
| | . Oo..Oo= o . |
| | o .o+Eo.o = . |
| | . ++ .. . + |
| +----[SHA256]-----+
|
|
|__ $ mkdir /home/oracle/.ssh
|
|
|__ $ cat .ssh/id_rsa.pub
| |
| |__ o. Copy and Paste the ouptut to the file on target server: /home/oracle/.ssh/authorized_keys
| |
| |__ o. If content exist, please append the new key in new line, and can be splite by blank line: /home/oracle/.ssh/authorized_keys
|
|
|__ $ chmod 700 .ssh
|
|__ $ chmod 640 .ssh/authorized_keys
<4> Create directory for GRID_HOME, amd unzip the Grid Infrastructure Clusterware Software installation package:
|
|__ $ mkdir -p /u01/app/12.2.0.1/grid
|
|__ $ unzip /u01/app/12.2.0.1/grid/linuxx64_12201_grid_home.zip
<5> Verify /etc/hosts contains all IP on both nodes:
127.0.0.1 localhost.localdomain localhost smtp.eoriginal.net emeralit.net
192.168.12.10 rac-db01.emeralit.local rac-db01
192.168.12.11 rac-db01-vip
192.168.19.10 rac-db01-priv
192.168.12.12 rac-db01.emeralit.local rac-db01
192.168.12.13 rac-db01-vip
192.168.19.12 rac-db01-priv
127.0.0.1 localhost.localdomain localhost smtp.emeralit.net emeralit.net
192.168.12.10 rac-db01.emeralit.local rac-db01
192.168.12.11 rac-db01-vip
192.168.19.10 rac-db01-priv
192.168.12.12 rac-db01.emeralit.local rac-db01
192.168.12.13 rac-db01-vip
192.168.19.12 rac-db01-priv
<6> Install cvuqdisk RPM package:
|
|__ o. If you do not use an Oracle Preinstallation RPM, and you want to use the Cluster Verification Utility, then you must install the cvuqdisk RPM.
| Without cvuqdisk, Cluster Verification Utility cannot discover shared disks, and you receive the error message "Package cvuqdisk not installed",
| when you run Cluster Verification Utility.
|
|__ $ sudo su -
|
|__ $ [root@rac_db01]# cd /u01/app/12.2.0.1/grid/cv/rpm
|
|__ $ [root@rac-db01]# ls -ltr
|
| -rw-r--r--. 1 oracle oinstall 8860 Jan 5 2017 cvuqdisk-1.0.10-1.rpm
|
|__ $ [root@rac-db01]# export CVUQDISK_GRP=oinstall
|
|__ $ [root@rac-db01]# rpm -iv cvuqdisk-1.0.10-1.
Preparing packages...
cvuqdisk-1.0.10-1.x86_64
<7> Execute the script RUNCLUVFY.sh to verify installation prerequisite on one node ONLY:
|
|__ $ nohup /u01/app/12.2.0.1/grid/runcluvfy.sh stage -pre crsinst -n rac-db01,rac-db02 -r 12.2 -verbose > /u01/runcluvfy_1835_05152019.log &
|
|__ $ cat /u02/software/runcluvfy_1835_05152019.log
ERROR:
PRVG-10467 : The default Oracle Inventory group could not be determined.
Verifying Physical Memory ...
Node Name Available Required Status
------------ ------------------------ ------------------------ ----------
rac-db02 31.2616GB (3.278016E7KB) 8GB (8388608.0KB) passed
rac-db01 31.2616GB (3.2780152E7KB) 8GB (8388608.0KB) passed
Verifying Physical Memory ...PASSED
Verifying Available Physical Memory ...
Node Name Available Required Status
------------ ------------------------ ------------------------ ----------
rac-db02 30.6607GB (3.2150076E7KB) 50MB (51200.0KB) passed
rac-db01 29.7583GB (3.1203816E7KB) 50MB (51200.0KB) passed
Verifying Available Physical Memory ...PASSED
Verifying Swap Size ...
Node Name Available Required Status
------------ ------------------------ ------------------------ ----------
rac-db02 16GB (1.6777212E7KB) 16GB (1.6777216E7KB) passed
rac-db01 16GB (1.6777212E7KB) 16GB (1.6777216E7KB) passed
Verifying Swap Size ...PASSED
Verifying Free Space: rac-db02 :/usr,rac-db02 :/etc,rac-db02 :/sbin ...
Path Node Name Mount point Available Required Status
---------------- ------------ ------------ ------------ ------------ ------------
/usr rac-db02 / 18.4727GB 25MB passed
/etc rac-db02 / 18.4727GB 25MB passed
/sbin rac-db02 / 18.4727GB 10MB passed
Verifying Free Space: rac-db02 :/usr,rac-db02 :/etc,rac-db02 :/sbin ...PASSED
Verifying Free Space: rac-db02 :/var ...
Path Node Name Mount point Available Required Status
---------------- ------------ ------------ ------------ ------------ ------------
/var rac-db02 /var 9.4385GB 5MB passed
Verifying Free Space: rac-db02 :/var ...PASSED
Verifying Free Space: rac-db02 :/tmp ...
Path Node Name Mount point Available Required Status
---------------- ------------ ------------ ------------ ------------ ------------
/tmp rac-db02 /tmp 16.3809GB 1GB passed
Verifying Free Space: rac-db02 :/tmp ...PASSED
Verifying Free Space: rac-db01 :/usr,rac-db01 :/etc,rac-db01 :/sbin ...
Path Node Name Mount point Available Required Status
---------------- ------------ ------------ ------------ ------------ ------------
/usr rac-db01 / 18.4727GB 25MB passed
/etc rac-db01 / 18.4727GB 25MB passed
/sbin rac-db01 / 18.4727GB 10MB passed
Verifying Free Space: rac-db01 :/usr,rac-db01 :/etc,rac-db01 :/sbin ...PASSED
Verifying Free Space: rac-db01 :/var ...
Path Node Name Mount point Available Required Status
---------------- ------------ ------------ ------------ ------------ ------------
/var rac-db01 /var 9.4395GB 5MB passed
Verifying Free Space: rac-db01 :/var ...PASSED
Verifying Free Space: rac-db01 :/tmp ...
Path Node Name Mount point Available Required Status
---------------- ------------ ------------ ------------ ------------ ------------
/tmp rac-db01 /tmp 16.3809GB 1GB passed
Verifying Free Space: rac-db01 :/tmp ...PASSED
Verifying User Existence: oracle ...
Node Name Status Comment
------------ ------------------------ ------------------------
rac-db02 passed exists(20000)
rac-db01 passed exists(20000)
Verifying Users With Same UID: 20000 ...PASSED
Verifying User Existence: oracle ...PASSED
Verifying Group Existence: asmadmin ...
Node Name Status Comment
------------ ------------------------ ------------------------
rac-db02 passed exists
rac-db01 passed exists
Verifying Group Existence: asmadmin ...PASSED
Verifying Group Existence: asmdba ...
Node Name Status Comment
------------ ------------------------ ------------------------
rac-db02 passed exists
rac-db01 passed exists
Verifying Group Existence: asmdba ...PASSED
Verifying Group Membership: asmadmin ...
Node Name User Exists Group Exists User in Group Status
---------------- ------------ ------------ ------------ ----------------
rac-db02 yes yes yes passed
rac-db01 yes yes yes passed
Verifying Group Membership: asmadmin ...PASSED
Verifying Group Membership: asmdba ...
Node Name User Exists Group Exists User in Group Status
---------------- ------------ ------------ ------------ ----------------
rac-db02 yes yes yes passed
rac-db01 yes yes yes passed
Verifying Group Membership: asmdba ...PASSED
Verifying Run Level ...
Node Name run level Required Status
------------ ------------------------ ------------------------ ----------
rac-db02 3 3,5 passed
rac-db01 3 3,5 passed
Verifying Run Level ...PASSED
Verifying Hard Limit: maximum open file descriptors ...
Node Name Type Available Required Status
---------------- ------------ ------------ ------------ ----------------
rac-db02 hard 65536 65536 passed
rac-db01 hard 65536 65536 passed
Verifying Hard Limit: maximum open file descriptors ...PASSED
Verifying Soft Limit: maximum open file descriptors ...
Node Name Type Available Required Status
---------------- ------------ ------------ ------------ ----------------
rac-db02 soft 1024 1024 passed
rac-db01 soft 1024 1024 passed
Verifying Soft Limit: maximum open file descriptors ...PASSED
Verifying Hard Limit: maximum user processes ...
Node Name Type Available Required Status
---------------- ------------ ------------ ------------ ----------------
rac-db02 hard 16384 16384 passed
rac-db01 hard 16384 16384 passed
Verifying Hard Limit: maximum user processes ...PASSED
Verifying Soft Limit: maximum user processes ...
Node Name Type Available Required Status
---------------- ------------ ------------ ------------ ----------------
rac-db02 soft 16384 2047 passed
rac-db01 soft 16384 2047 passed
Verifying Soft Limit: maximum user processes ...PASSED
Verifying Soft Limit: maximum stack size ...
Node Name Type Available Required Status
---------------- ------------ ------------ ------------ ----------------
rac-db02 soft 10240 10240 passed
rac-db01 soft 10240 10240 passed
Verifying Soft Limit: maximum stack size ...PASSED
Verifying Architecture ...
Node Name Available Required Status
------------ ------------------------ ------------------------ ----------
rac-db02 x86_64 x86_64 passed
rac-db01 x86_64 x86_64 passed
Verifying Architecture ...PASSED
Verifying OS Kernel Version ...
Node Name Available Required Status
------------ ------------------------ ------------------------ ----------
rac-db02 3.10.0-957.12.1.el7.x86_64 3.10.0 passed
rac-db01 3.10.0-957.12.1.el7.x86_64 3.10.0 passed
Verifying OS Kernel Version ...PASSED
Verifying OS Kernel Parameter: semmsl ...
Node Name Current Configured Required Status Comment
---------------- ------------ ------------ ------------ ------------ ------------
rac-db01 250 undefined 250 passed
rac-db02 250 undefined 250 passed
Verifying OS Kernel Parameter: semmsl ...PASSED
Verifying OS Kernel Parameter: semmns ...
Node Name Current Configured Required Status Comment
---------------- ------------ ------------ ------------ ------------ ------------
rac-db01 32000 undefined 32000 passed
rac-db02 32000 undefined 32000 passed
Verifying OS Kernel Parameter: semmns ...PASSED
Verifying OS Kernel Parameter: semopm ...
Node Name Current Configured Required Status Comment
---------------- ------------ ------------ ------------ ------------ ------------
rac-db01 100 undefined 100 passed
rac-db02 100 undefined 100 passed
Verifying OS Kernel Parameter: semopm ...PASSED
Verifying OS Kernel Parameter: semmni ...
Node Name Current Configured Required Status Comment
---------------- ------------ ------------ ------------ ------------ ------------
rac-db01 128 undefined 128 passed
rac-db02 128 undefined 128 passed
Verifying OS Kernel Parameter: semmni ...PASSED
Verifying OS Kernel Parameter: shmmax ...
Node Name Current Configured Required Status Comment
---------------- ------------ ------------ ------------ ------------ ------------
rac-db01 4398046511104 undefined 16783437824 passed
rac-db02 4398046511104 undefined 16783441920 passed
Verifying OS Kernel Parameter: shmmax ...PASSED
Verifying OS Kernel Parameter: shmmni ...
Node Name Current Configured Required Status Comment
---------------- ------------ ------------ ------------ ------------ ------------
rac-db01 4096 undefined 4096 passed
rac-db02 4096 undefined 4096 passed
Verifying OS Kernel Parameter: shmmni ...PASSED
Verifying OS Kernel Parameter: shmall ...
Node Name Current Configured Required Status Comment
---------------- ------------ ------------ ------------ ------------ ------------
rac-db01 1073741824 undefined 3278015 passed
rac-db02 1073741824 undefined 3278016 passed
Verifying OS Kernel Parameter: shmall ...PASSED
Verifying OS Kernel Parameter: file-max ...
Node Name Current Configured Required Status Comment
---------------- ------------ ------------ ------------ ------------ ------------
rac-db01 6815744 undefined 6815744 passed
rac-db02 6815744 undefined 6815744 passed
Verifying OS Kernel Parameter: file-max ...PASSED
Verifying OS Kernel Parameter: ip_local_port_range ...
Node Name Current Configured Required Status Comment
---------------- ------------ ------------ ------------ ------------ ------------
rac-db01 between 9000 & 65500 undefined between 9000 & 65535 passed
rac-db02 between 9000 & 65500 undefined between 9000 & 65535 passed
Verifying OS Kernel Parameter: ip_local_port_range ...PASSED
Verifying OS Kernel Parameter: rmem_default ...
Node Name Current Configured Required Status Comment
---------------- ------------ ------------ ------------ ------------ ------------
rac-db01 262144 undefined 262144 passed
rac-db02 262144 undefined 262144 passed
Verifying OS Kernel Parameter: rmem_default ...PASSED
Verifying OS Kernel Parameter: rmem_max ...
Node Name Current Configured Required Status Comment
---------------- ------------ ------------ ------------ ------------ ------------
rac-db01 4194304 undefined 4194304 passed
rac-db02 4194304 undefined 4194304 passed
Verifying OS Kernel Parameter: rmem_max ...PASSED
Verifying OS Kernel Parameter: wmem_default ...
Node Name Current Configured Required Status Comment
---------------- ------------ ------------ ------------ ------------ ------------
rac-db01 262144 undefined 262144 passed
rac-db02 262144 undefined 262144 passed
Verifying OS Kernel Parameter: wmem_default ...PASSED
Verifying OS Kernel Parameter: wmem_max ...
Node Name Current Configured Required Status Comment
---------------- ------------ ------------ ------------ ------------ ------------
rac-db01 1048576 undefined 1048576 passed
rac-db02 1048576 undefined 1048576 passed
Verifying OS Kernel Parameter: wmem_max ...PASSED
Verifying OS Kernel Parameter: aio-max-nr ...
Node Name Current Configured Required Status Comment
---------------- ------------ ------------ ------------ ------------ ------------
rac-db01 1048576 undefined 1048576 passed
rac-db02 1048576 undefined 1048576 passed
Verifying OS Kernel Parameter: aio-max-nr ...PASSED
Verifying Package: binutils-2.23.52.0.1 ...
Node Name Available Required Status
------------ ------------------------ ------------------------ ----------
rac-db02 binutils-2.27-34.base.el7 binutils-2.23.52.0.1 passed
rac-db01 binutils-2.27-34.base.el7 binutils-2.23.52.0.1 passed
Verifying Package: binutils-2.23.52.0.1 ...PASSED
Verifying Package: compat-libcap1-1.10 ...
Node Name Available Required Status
------------ ------------------------ ------------------------ ----------
rac-db02 compat-libcap1-1.10-7.el7 compat-libcap1-1.10 passed
rac-db01 compat-libcap1-1.10-7.el7 compat-libcap1-1.10 passed
Verifying Package: compat-libcap1-1.10 ...PASSED
Verifying Package: libgcc-4.8.2 (x86_64) ...
Node Name Available Required Status
------------ ------------------------ ------------------------ ----------
rac-db02 libgcc(x86_64)-4.8.5-36.el7_6.2 libgcc(x86_64)-4.8.2 passed
rac-db01 libgcc(x86_64)-4.8.5-36.el7_6.2 libgcc(x86_64)-4.8.2 passed
Verifying Package: libgcc-4.8.2 (x86_64) ...PASSED
Verifying Package: libstdc++-4.8.2 (x86_64) ...
Node Name Available Required Status
------------ ------------------------ ------------------------ ----------
rac-db02 libstdc++(x86_64)-4.8.5-36.el7_6.2 libstdc++(x86_64)-4.8.2 passed
rac-db01 libstdc++(x86_64)-4.8.5-36.el7_6.2 libstdc++(x86_64)-4.8.2 passed
Verifying Package: libstdc++-4.8.2 (x86_64) ...PASSED
Verifying Package: libstdc++-devel-4.8.2 (x86_64) ...
Node Name Available Required Status
------------ ------------------------ ------------------------ ----------
rac-db02 libstdc++-devel(x86_64)-4.8.5-36.el7_6.2 libstdc++-devel(x86_64)-4.8.2 passed
rac-db01 libstdc++-devel(x86_64)-4.8.5-36.el7_6.2 libstdc++-devel(x86_64)-4.8.2 passed
Verifying Package: libstdc++-devel-4.8.2 (x86_64) ...PASSED
Verifying Package: sysstat-10.1.5 ...
Node Name Available Required Status
------------ ------------------------ ------------------------ ----------
rac-db02 sysstat-10.1.5-17.el7 sysstat-10.1.5 passed
rac-db01 sysstat-10.1.5-17.el7 sysstat-10.1.5 passed
Verifying Package: sysstat-10.1.5 ...PASSED
Verifying Package: gcc-c++-4.8.2 ...
Node Name Available Required Status
------------ ------------------------ ------------------------ ----------
rac-db02 gcc-c++-4.8.5-36.el7_6.2 gcc-c++-4.8.2 passed
rac-db01 gcc-c++-4.8.5-36.el7_6.2 gcc-c++-4.8.2 passed
Verifying Package: gcc-c++-4.8.2 ...PASSED
Verifying Package: ksh ...
Node Name Available Required Status
------------ ------------------------ ------------------------ ----------
rac-db02 ksh ksh passed
rac-db01 ksh ksh passed
Verifying Package: ksh ...PASSED
Verifying Package: make-3.82 ...
Node Name Available Required Status
------------ ------------------------ ------------------------ ----------
rac-db02 make-3.82-23.el7 make-3.82 passed
rac-db01 make-3.82-23.el7 make-3.82 passed
Verifying Package: make-3.82 ...PASSED
Verifying Package: glibc-2.17 (x86_64) ...
Node Name Available Required Status
------------ ------------------------ ------------------------ ----------
rac-db02 glibc(x86_64)-2.17-260.el7_6.4 glibc(x86_64)-2.17 passed
rac-db01 glibc(x86_64)-2.17-260.el7_6.4 glibc(x86_64)-2.17 passed
Verifying Package: glibc-2.17 (x86_64) ...PASSED
Verifying Package: glibc-devel-2.17 (x86_64) ...
Node Name Available Required Status
------------ ------------------------ ------------------------ ----------
rac-db02 glibc-devel(x86_64)-2.17-260.el7_6.4 glibc-devel(x86_64)-2.17 passed
rac-db01 glibc-devel(x86_64)-2.17-260.el7_6.4 glibc-devel(x86_64)-2.17 passed
Verifying Package: glibc-devel-2.17 (x86_64) ...PASSED
Verifying Package: libaio-0.3.109 (x86_64) ...
Node Name Available Required Status
------------ ------------------------ ------------------------ ----------
rac-db02 libaio(x86_64)-0.3.109-13.el7 libaio(x86_64)-0.3.109 passed
rac-db01 libaio(x86_64)-0.3.109-13.el7 libaio(x86_64)-0.3.109 passed
Verifying Package: libaio-0.3.109 (x86_64) ...PASSED
Verifying Package: libaio-devel-0.3.109 (x86_64) ...
Node Name Available Required Status
------------ ------------------------ ------------------------ ----------
rac-db02 libaio-devel(x86_64)-0.3.109-13.el7 libaio-devel(x86_64)-0.3.109 passed
rac-db01 libaio-devel(x86_64)-0.3.109-13.el7 libaio-devel(x86_64)-0.3.109 passed
Verifying Package: libaio-devel-0.3.109 (x86_64) ...PASSED
Verifying Package: nfs-utils-1.2.3-15 ...
Node Name Available Required Status
------------ ------------------------ ------------------------ ----------
rac-db02 nfs-utils-1.3.0-0.61.el7 nfs-utils-1.2.3-15 passed
rac-db01 nfs-utils-1.3.0-0.61.el7 nfs-utils-1.2.3-15 passed
Verifying Package: nfs-utils-1.2.3-15 ...PASSED
Verifying Package: smartmontools-6.2-4 ...
Node Name Available Required Status
------------ ------------------------ ------------------------ ----------
rac-db02 smartmontools-6.5-1.el7 smartmontools-6.2-4 passed
rac-db01 smartmontools-6.5-1.el7 smartmontools-6.2-4 passed
Verifying Package: smartmontools-6.2-4 ...PASSED
Verifying Package: net-tools-2.0-0.17 ...
Node Name Available Required Status
------------ ------------------------ ------------------------ ----------
rac-db02 net-tools-2.0-0.24.20131004git.el7 net-tools-2.0-0.17 passed
rac-db01 net-tools-2.0-0.24.20131004git.el7 net-tools-2.0-0.17 passed
Verifying Package: net-tools-2.0-0.17 ...PASSED
Verifying Port Availability for component "Oracle Notification Service (ONS)" ...
Node Name Port Number Protocol Available Status
---------------- ------------ ------------ ------------ ----------------
rac-db02 6200 TCP yes successful
rac-db01 6200 TCP yes successful
rac-db02 6100 TCP yes successful
rac-db01 6100 TCP yes successful
Verifying Port Availability for component "Oracle Notification Service (ONS)" ...PASSED
Verifying Port Availability for component "Oracle Cluster Synchronization Services (CSSD)" ...
Node Name Port Number Protocol Available Status
---------------- ------------ ------------ ------------ ----------------
rac-db02 42424 TCP yes successful
rac-db01 42424 TCP yes successful
Verifying Port Availability for component "Oracle Cluster Synchronization Services (CSSD)" ...PASSED
Verifying Users With Same UID: 0 ...PASSED
Verifying Current Group ID ...PASSED
Verifying Root user consistency ...
Node Name Status
------------------------------------ ------------------------
rac-db02 passed
rac-db01 passed
Verifying Root user consistency ...PASSED
Verifying Package: cvuqdisk-1.0.10-1 ...
Node Name Available Required Status
------------ ------------------------ ------------------------ ----------
rac-db02 cvuqdisk-1.0.10-1 cvuqdisk-1.0.10-1 passed
rac-db01 cvuqdisk-1.0.10-1 cvuqdisk-1.0.10-1 passed
Verifying Package: cvuqdisk-1.0.10-1 ...PASSED
Verifying Node Connectivity ...
Verifying Hosts File ...
Node Name Status
------------------------------------ ------------------------
rac-db01 passed
rac-db02 passed
Verifying Hosts File ...PASSED
Interface information for node "rac-db01"
Name IP Address Subnet Gateway Def. Gateway HW Address MTU
------ --------------- --------------- --------------- --------------- ----------------- ------
ens192 192.168.12.10 192.168.212.0 0.0.0.0 192.168.219.1 00:50:56:8B:4A:00 1500
ens224 192.168.19.10 192.168.219.0 0.0.0.0 192.168.219.1 00:50:56:8B:14:9D 9000
Interface information for node "rac-db02"
Name IP Address Subnet Gateway Def. Gateway HW Address MTU
------ --------------- --------------- --------------- --------------- ----------------- ------
ens192 192.168.212.162 192.168.212.0 0.0.0.0 192.168.219.1 00:50:56:8B:45:37 1500
ens224 192.168.219.162 192.168.219.0 0.0.0.0 192.168.219.1 00:50:56:8B:35:0A 9000
Check: MTU consistency of the subnet "192.168.219.0".
Node Name IP Address Subnet MTU
---------------- ------------ ------------ ------------ ----------------
rac-db01 ens224 192.168.19.10 192.168.219.0 9000
rac-db02 ens224 192.168.219.162 192.168.219.0 9000
Check: MTU consistency of the subnet "192.168.212.0".
Node Name IP Address Subnet MTU
---------------- ------------ ------------ ------------ ----------------
rac-db01 ens192 192.168.12.10 192.168.212.0 1500
rac-db02 ens192 192.168.212.162 192.168.212.0 1500
Verifying Check that maximum (MTU) size packet goes through subnet ...PASSED
Source Destination Connected?
------------------------------ ------------------------------ ----------------
rac-db01 [ens224:192.168.19.10] rac-db02 [ens224:192.168.219.162] yes
Source Destination Connected?
------------------------------ ------------------------------ ----------------
rac-db01 [ens192:192.168.12.10] rac-db02 [ens192:192.168.212.162] yes
Verifying subnet mask consistency for subnet "192.168.219.0" ...PASSED
Verifying subnet mask consistency for subnet "192.168.212.0" ...PASSED
Verifying Node Connectivity ...PASSED
Verifying Multicast check ...
Checking subnet "192.168.219.0" for multicast communication with multicast group "224.0.0.251"
Verifying Multicast check ...PASSED
Verifying Network Time Protocol (NTP) ...
Verifying '/etc/chrony.conf' ...
Node Name File exists?
------------------------------------ ------------------------
rac-db02 yes
rac-db01 yes
Verifying '/etc/chrony.conf' ...PASSED
Verifying '/var/run/chronyd.pid' ...
Node Name File exists?
------------------------------------ ------------------------
rac-db02 yes
rac-db01 yes
Verifying '/var/run/chronyd.pid' ...PASSED
Verifying Daemon 'chronyd' ...
Node Name Running?
------------------------------------ ------------------------
rac-db02 yes
rac-db01 yes
Verifying Daemon 'chronyd' ...PASSED
Verifying NTP daemon or service using UDP port 123 ...
Node Name Port Open?
------------------------------------ ------------------------
rac-db02 yes
rac-db01 yes
Verifying NTP daemon or service using UDP port 123 ...PASSED
Verifying chrony daemon is synchronized with at least one external time source ...PASSED
Verifying Network Time Protocol (NTP) ...PASSED
Verifying Same core file name pattern ...PASSED
Verifying User Mask ...
Node Name Available Required Comment
------------ ------------------------ ------------------------ ----------
rac-db02 0022 0022 passed
rac-db01 0022 0022 passed
Verifying User Mask ...PASSED
Verifying User Not In Group "root": oracle ...
Node Name Status Comment
------------ ------------------------ ------------------------
rac-db02 passed does not exist
rac-db01 passed does not exist
Verifying User Not In Group "root": oracle ...PASSED
Verifying Time zone consistency ...PASSED
Verifying resolv.conf Integrity ...
Verifying (Linux) resolv.conf Integrity ...
Node Name Status
------------------------------------ ------------------------
rac-db01 passed
rac-db02 passed
checking response for name "rac-db02 " from each of the name servers
specified in "/etc/resolv.conf"
Node Name Source Comment Status
------------ ------------------------ ------------------------ ----------
rac-db02 192.168.208.200 IPv4 passed
rac-db02 192.168.208.201 IPv4 passed
rac-db02 192.168.208.202 IPv4 passed
checking response for name "rac-db01 " from each of the name servers
specified in "/etc/resolv.conf"
Node Name Source Comment Status
------------ ------------------------ ------------------------ ----------
rac-db01 192.168.208.200 IPv4 passed
rac-db01 192.168.208.201 IPv4 passed
rac-db01 192.168.208.202 IPv4 passed
Verifying (Linux) resolv.conf Integrity ...PASSED
Verifying resolv.conf Integrity ...PASSED
Verifying DNS/NIS name service ...PASSED
Verifying Domain Sockets ...PASSED
Verifying /boot mount ...PASSED
Verifying Daemon "avahi-daemon" not configured and running ...
Node Name Configured Status
------------ ------------------------ ------------------------
rac-db02 no passed
rac-db01 no passed
Node Name Running? Status
------------ ------------------------ ------------------------
rac-db02 no passed
rac-db01 no passed
Verifying Daemon "avahi-daemon" not configured and running ...PASSED
Verifying Daemon "proxyt" not configured and running ...
Node Name Configured Status
------------ ------------------------ ------------------------
rac-db02 no passed
rac-db01 no passed
Node Name Running? Status
------------ ------------------------ ------------------------
rac-db02 no passed
rac-db01 no passed
Verifying Daemon "proxyt" not configured and running ...PASSED
Verifying User Equivalence ...PASSED
Verifying /dev/shm mounted as temporary file system ...PASSED
Verifying File system mount options for path /var ...PASSED
Verifying zeroconf check ...PASSED
Verifying ASM Filter Driver configuration ...PASSED
Pre-check for cluster services setup was successful.
CVU operation performed: stage -pre crsinst
Date: May 15, 2019 6:35:56 PM
CVU home: /u01/app/12.2.0.1/grid/
User: oracle
<8> Start patching GRID_HOME:
|
|__ $ cp p6880880_122010_Linux-x86-64.zip /u01/app/12.2.0.1/grid
|
|__ $ cd /u01/app/12.2.0.1/grid
|
|__ $ mv OPatch OPatch_05162019_orig
|
|__ $ unzip p6880880_122010_Linux-x86-64.zip
|
|__ $ ./opatch version
|
| OPatch Version: 12.2.0.1.16
| OPatch succeeded.
| Apply patch to software.
|
|__ $ /u01/app/12.2.0.1/grid/gridSetup.sh -applyPSU /u02/software/28828733
|
| ERROR: Unable to verify the graphical display setup. This application requires X display. Make sure that xdpyinfo exist under PATH variable.
| Preparing the home to patch...
| Applying the patch /u02/software/28828733/28828733...
| Successfully applied the patch.
| The log can be found at: /tmp/GridSetupActions2019-05-16_10-42-34AM/installerPatchActions_2019-05-16_10-42-34AM.log
|
| No X11 DISPLAY variable was set, but this program performed an operation which requires it.
|
|__ o. After patching completed, original OPatch has to be converted back:
|
|__ $ mv OPatch OPatch_higher_version
|
|__ $ mv OPatch_05162019_orig OPatch
<9> Config VOTE disks on Node 1:
|
|__ $ lsblk
NAME MAJ:MIN RM SIZE RO TYPE MOUNTPOINT
fd0 2:0 1 4K 0 disk
sda 8:0 0 60G 0 disk
├─sda1 8:1 0 1G 0 part /boot
└─sda2 8:2 0 59G 0 part
├─vgroot-root 253:0 0 19G 0 lvm /
├─vgroot-swap 253:1 0 16G 0 lvm [SWAP]
├─vgroot-tmp 253:3 0 10G 0 lvm
└─vgroot-var 253:4 0 10G 0 lvm /var
sdb 8:16 0 200G 0 disk
└─oracle-oraclelv 253:5 0 200G 0 lvm /u01
sdc 8:32 0 100G 0 disk
└─oracle_tracevg-oracle_tracelv 253:2 0 100G 0 lvm /u02
sdd 8:48 0 2T 0 disk
sde 8:64 0 2T 0 disk
sdf 8:80 0 2T 0 disk
sdg 8:96 0 80G 0 disk
sdh 8:112 0 80G 0 disk
sdi 8:128 0 80G 0 disk
sdj 8:144 0 500G 0 disk
sdk 8:160 0 500G 0 disk
sdl 8:176 0 500G 0 disk
sr0 11:0 1 4.3G 0 rom
<====== Run as root on NODE 1 =====>
export ORACLE_HOME=/u01/app/12.2.0.1/grid
export ORACLE_BASE=/u02/tmp
cd $ORACLE_HOME/bin
./asmcmd afd_label OVD1 /dev/sdg --init
./asmcmd afd_label OVD2 /dev/sdh --init
./asmcmd afd_label OVD3 /dev/sdi --init
./asmcmd afd_lslbl /dev/sdg
./asmcmd afd_lslbl /dev/sdh
./asmcmd afd_lslbl /dev/sdi
[root@RAC-DB01]# ./asmcmd afd_lslbl /dev/sdg
--------------------------------------------------------------------------------
Label Duplicate Path
================================================================================
OVD1 /dev/sdg
[root@RAC-DB01]# ./asmcmd afd_lslbl /dev/sdh
--------------------------------------------------------------------------------
Label Duplicate Path
================================================================================
OVD2 /dev/sdh
[root@RAC-DB01]# ./asmcmd afd_lslbl /dev/sdi
--------------------------------------------------------------------------------
Label Duplicate Path
================================================================================
OVD3 /dev/sdi
<10> Install grid software only as "ORACLE":
|
|__ $ /u01/app/12.2.0.1/grid/gridSetup.sh -silent -responseFile /u02/software/grid_swonly.rsp
|
| Launching Oracle Grid Infrastructure Setup Wizard...
|
| You can find the log of this install session at:
| /tmp/GridSetupActions2019-05-16_12-13-22PM/gridSetupActions2019-05-16_12-13-22PM.log
|
| As a root user, execute the following script(s):
| 1. /u01/app/oraInventory/orainstRoot.sh
| 2. /u01/app/12.2.0.1/grid/root.sh
|
| Execute /u01/app/oraInventory/orainstRoot.sh on the following nodes:
| [RAC-DB01, RAC-DB02]
| Execute /u01/app/12.2.0.1/grid/root.sh on the following nodes:
| [RAC-DB01, RAC-DB02]
|
|
| Successfully Setup Software.
| Moved the install session logs to:
| /u01/app/oraInventory/logs/GridSetupActions2019-05-16_12-13-22PM
|
|
|__ $ /u01/app/oraInventory/orainstRoot.sh [Both Nodes]
|
| Changing permissions of /u01/app/oraInventory.
| Adding read,write permissions for group.
| Removing read,write,execute permissions for world.
|
| Changing groupname of /u01/app/oraInventory to oinstall.
| The execution of the script is complete.
|
|
|__ $ /u01/app/12.2.0.1/grid/root.sh [Both Nodes]
Check /u01/app/12.2.0.1/grid/install/root_RAC-DB02_2019-05-16_12-24-27-504247993.log for the output of root script
<11> Config VOTE disks on Node 2:
|
|__ $ lsblk
NAME MAJ:MIN RM SIZE RO TYPE MOUNTPOINT
fd0 2:0 1 4K 0 disk
sda 8:0 0 60G 0 disk
├─sda1 8:1 0 1G 0 part /boot
└─sda2 8:2 0 59G 0 part
├─vgroot-root 253:0 0 19G 0 lvm /
├─vgroot-swap 253:1 0 16G 0 lvm [SWAP]
├─vgroot-tmp 253:3 0 10G 0 lvm
└─vgroot-var 253:4 0 10G 0 lvm /var
sdb 8:16 0 200G 0 disk
└─oracle-oraclelv 253:5 0 200G 0 lvm /u01
sdc 8:32 0 100G 0 disk
└─oracle_tracevg-oracle_tracelv 253:2 0 100G 0 lvm /u02
sdd 8:48 0 2T 0 disk
sde 8:64 0 2T 0 disk
sdf 8:80 0 2T 0 disk
sdg 8:96 0 80G 0 disk
sdh 8:112 0 80G 0 disk
sdi 8:128 0 80G 0 disk
sdj 8:144 0 500G 0 disk
sdk 8:160 0 500G 0 disk
sdl 8:176 0 500G 0 disk
sr0 11:0 1 4.3G 0 rom
<====== Run as root on NODE 2 =====>
export ORACLE_HOME=/u01/app/12.2.0.1/grid
export ORACLE_BASE=/u02/tmp
cd $ORACLE_HOME/bin
./asmcmd afd_scan /dev/sdg
./asmcmd afd_scan /dev/sdh
./asmcmd afd_scan /dev/sdi
./asmcmd afd_lslbl /dev/sdg
./asmcmd afd_lslbl /dev/sdh
./asmcmd afd_lslbl /dev/sdi
--------------------------------------------------------------------------------
Label Duplicate Path
================================================================================
OVD1 /dev/sdg
[root@RAC-DB02 bin]# ./asmcmd afd_lslbl /dev/sdh
--------------------------------------------------------------------------------
Label Duplicate Path
================================================================================
OVD2 /dev/sdh
[root@RAC-DB02 bin]# ./asmcmd afd_lslbl /dev/sdi
--------------------------------------------------------------------------------
Label Duplicate Path
================================================================================
OVD3 /dev/sdi
<12> Change one folder ownership to oracle on Node 2:
|
|__ $ cd /u01/app/12.2.0.1/grid/
chown -R oracle:oinstall log
chmod -R 777 log
<13> Config Cluster as "ORACLE" on only one node:
|
|__ $ vi /u02/software/grid_config.rsp
|
|__ $ /u01/app/12.2.0.1/grid/gridSetup.sh -silent -responseFile /u02/software/grid_config.rsp
|
|
| Launching Oracle Grid Infrastructure Setup Wizard...
|
| [WARNING] [INS-06009] SSH performance is detected to be slow, which may impact performance during remote node operations like
| copying the software and executing prerequisite checks.
| ACTION: Consider optimizing the ssh configuration.
|
| As a root user, execute the following script(s):
| 1. /u01/app/12.2.0.1/grid/root.sh
|
| Execute /u01/app/12.2.0.1/grid/root.sh on the following nodes:
| [RAC-DB02, tod2-db162]
|
| Run the script on the local node first. After successful completion, you can start the script in parallel on all other nodes.
|
| Successfully Setup Software.
| As install user, execute the following command to complete the configuration.
| /u01/app/12.2.0.1/grid/gridSetup.sh -executeConfigTools -responseFile /u02/software/grid_config.rsp [-silent]
|
|
|
|
| [root@RAC-DB02]# /u01/app/12.2.0.1/grid/root.sh
|
| shell-init: error retrieving current directory: getcwd: cannot access parent directories: No such file or directory
| Check /u01/app/12.2.0.1/grid/install/root_RAC-DB02_2019-05-16_15-10-30-390370879.log for the output of root script
|
|
| [root@tod2-db162]# /u01/app/12.2.0.1/grid/root.sh
|
| Check /u01/app/12.2.0.1/grid/install/root_tod2-db162_2019-05-16_15-44-14-786885442.log for the output of root script
|
| /u01/app/12.2.0.1/grid/perl/bin/perl -I/u01/app/12.2.0.1/grid/perl/lib -I/u01/app/12.2.0.1/grid/crs/install /u01/app/12.2.0.1//grid/crs/install/rootcrs.pl
| chown oracle:oinstall /u01/app/oracle/diag/crs/pod2-db172/crs/
|
|__ $ /u01/app/12.2.0.1/grid/gridSetup.sh -executeConfigTools -responseFile /u02/software/grid_config.rsp -silent
Launching Oracle Grid Infrastructure Setup Wizard...
You can find the logs of this session at:
/u01/app/oraInventory/logs/GridSetupActions2019-05-16_04-36-41PM
<14> Label on Node 1 as root:
|
|__ $ lsblk
NAME MAJ:MIN RM SIZE RO TYPE MOUNTPOINT
fd0 2:0 1 4K 0 disk
sda 8:0 0 60G 0 disk
├─sda1 8:1 0 1G 0 part /boot
└─sda2 8:2 0 59G 0 part
├─vgroot-root 253:0 0 19G 0 lvm /
├─vgroot-swap 253:1 0 16G 0 lvm [SWAP]
├─vgroot-tmp 253:3 0 10G 0 lvm
└─vgroot-var 253:4 0 10G 0 lvm /var
sdb 8:16 0 200G 0 disk
└─oracle-oraclelv 253:5 0 200G 0 lvm /u01
sdc 8:32 0 100G 0 disk
└─oracle_tracevg-oracle_tracelv 253:2 0 100G 0 lvm /u02
sdd 8:48 0 2T 0 disk
sde 8:64 0 2T 0 disk
sdf 8:80 0 2T 0 disk
sdg 8:96 0 80G 0 disk
sdh 8:112 0 80G 0 disk
sdi 8:128 0 80G 0 disk
sdj 8:144 0 500G 0 disk
sdk 8:160 0 500G 0 disk
sdl 8:176 0 500G 0 disk
sr0 11:0 1 4.3G 0 rom
export ORACLE_HOME=/u01/app/12.2.0.1/grid
export ORACLE_BASE=/u02/tmp
cd $ORACLE_HOME/bin
./asmcmd afd_label RECO1 /dev/sdj
./asmcmd afd_label RECO2 /dev/sdk
./asmcmd afd_label RECO3 /dev/sdl
./asmcmd afd_label DATA1 /dev/sdd
./asmcmd afd_label DATA2 /dev/sde
./asmcmd afd_label DATA3 /dev/sdf
[root@RAC-DB02 bin]# ./asmcmd afd_lslbl
--------------------------------------------------------------------------------
Label Duplicate Path
================================================================================
DATA1 /dev/sdd
DATA2 /dev/sde
DATA3 /dev/sdf
OVD1 /dev/sdg
OVD2 /dev/sdh
OVD3 /dev/sdi
RECO1 /dev/sdj
RECO2 /dev/sdk
RECO3 /dev/sdl
<15> Create Disk Group on Node 1 as "ORACLE":
|
|__ $ /u01/app/12.2.0.1/grid/bin/asmca -silent -createDiskGroup -diskGroupName RECO -diskList 'AFD:RECO1','AFD:RECO2','AFD:RECO3' -redundancy EXTERNAL -au_size 4
|
| Disk groups created successfully. Check /u01/app/oracle/cfgtoollogs/asmca/asmca-190517AM115902.log for details.
|
|__ $ /u01/app/12.2.0.1/grid/bin/asmca -silent -createDiskGroup -diskGroupName DATA -diskList 'AFD:DATA1','AFD:DATA2','AFD:DATA3' -redundancy EXTERNAL -au_size 4
Disk groups created successfully. Check /u01/app/oracle/cfgtoollogs/asmca/asmca-190517PM120236.log for details.
<16> Checking component status within cluster:
|
|__ $ /u01/app/12.2.0.1/grid/bin/crsctl stat res -t
--------------------------------------------------------------------------------
Name Target State Server State details
--------------------------------------------------------------------------------
Local Resources
--------------------------------------------------------------------------------
ora.ASMNET1LSNR_ASM.lsnr
ONLINE ONLINE RAC-DB01 STABLE
ONLINE ONLINE RAC-DB02 STABLE
ora.DATA.dg
ONLINE ONLINE RAC-DB01 STABLE
ONLINE ONLINE RAC-DB02 STABLE
ora.LISTENER.lsnr
ONLINE ONLINE RAC-DB01 STABLE
ONLINE ONLINE RAC-DB02 STABLE
ora.OVD.dg
ONLINE ONLINE RAC-DB01 STABLE
ONLINE ONLINE RAC-DB02 STABLE
ora.RECO.dg
ONLINE ONLINE RAC-DB01 STABLE
ONLINE ONLINE RAC-DB02 STABLE
ora.chad
ONLINE ONLINE RAC-DB01 STABLE
ONLINE ONLINE RAC-DB02 STABLE
ora.net1.network
ONLINE ONLINE RAC-DB01 STABLE
ONLINE ONLINE RAC-DB02 STABLE
ora.ons
ONLINE ONLINE RAC-DB01 STABLE
ONLINE ONLINE RAC-DB02 STABLE
ora.proxy_advm
OFFLINE OFFLINE RAC-DB01 STABLE
OFFLINE OFFLINE RAC-DB02 STABLE
--------------------------------------------------------------------------------
Cluster Resources
--------------------------------------------------------------------------------
ora.LISTENER_SCAN1.lsnr
1 ONLINE ONLINE RAC-DB02 STABLE
ora.LISTENER_SCAN2.lsnr
1 ONLINE ONLINE RAC-DB01 STABLE
ora.LISTENER_SCAN3.lsnr
1 ONLINE ONLINE RAC-DB01 STABLE
ora.MGMTLSNR
1 ONLINE ONLINE RAC-DB01 168.252.25.174 192.1
68.21.10,STABLE
ora.asm
1 ONLINE ONLINE RAC-DB01 Started,STABLE
2 ONLINE ONLINE RAC-DB02 Started,STABLE
3 OFFLINE OFFLINE STABLE
ora.cvu
1 ONLINE ONLINE RAC-DB01 STABLE
ora.mgmtdb
1 ONLINE ONLINE RAC-DB01 Open,STABLE
ora.qosmserver
1 ONLINE ONLINE RAC-DB01 STABLE
ora.scan1.vip
1 ONLINE ONLINE RAC-DB02 STABLE
ora.scan2.vip
1 ONLINE ONLINE RAC-DB01 STABLE
ora.scan3.vip
1 ONLINE ONLINE RAC-DB01 STABLE
ora.RAC-DB01.vip
1 ONLINE ONLINE RAC-DB01 STABLE
ora.RAC-DB02.vip
1 ONLINE ONLINE RAC-DB02 STABLE
--------------------------------------------------------------------------------
<17> Create ORACLE_HOME for Database on both nodes:
|
|__ $ mkdir -p /u01/app/oracle/product/11.2.0.4/dbhome_1
<18> Unzip database installer:
|
|__ $ pwd
|
| /u02/software/database
|
|
|__ $ ls -ltr
|
| p13390677_112040_Linux-x86-64_1of7.zip
| p13390677_112040_Linux-x86-64_2of7.zip
|
|
|__ $ unzip p13390677_112040_Linux-x86-64_1of7.zip
| unzip p13390677_112040_Linux-x86-64_2of7.zip
|
|
|__ $ ls -ltr
database
p13390677_112040_Linux-x86-64_1of7.zip
p13390677_112040_Linux-x86-64_2of7.zip
<19> Oracle database software installation based on response file on Node_1 only:
|
|__ $ cd /u02/software/database/database
|
|
|__ $ ./runInstaller -showProgress -responseFile /u02/software/db_install_sw.rsp -silent -ignoreSysPrereqs -ignorePrereq
Starting Oracle Universal Installer...
Checking Temp space: must be greater than 120 MB. Actual 15954 MB Passed
Checking swap space: must be greater than 150 MB. Actual 16377 MB Passed
Preparing to launch Oracle Universal Installer from /tmp/OraInstall2019-05-17_01-56-54PM. Please wait ...
You can find the log of this install session at: /u01/app/oraInventory/logs/installActions2019-05-17_01-56-54PM.log
Prepare in progress.
.................................................. 9% Done.
Prepare successful.
Copy files in progress.
.................................................. 15% Done.
.................................................. 20% Done.
.................................................. 25% Done.
.................................................. 30% Done.
.................................................. 36% Done.
.................................................. 41% Done.
.................................................. 46% Done.
.................................................. 51% Done.
.................................................. 56% Done.
Copy files successful.
..........
Link binaries in progress.
Link binaries successful.
.................................................. 77% Done.
Setup files in progress.
.................................................. 94% Done.
Setup files successful.
The installation of Oracle Database 11g was successful.
Please check '/u01/app/oraInventory/logs/silentInstall2019-05-17_01-56-54PM.log' for more details.
Execute Root Scripts in progress.
As a root user, execute the following script(s):
1. /u01/app/oracle/product/11.2.0.4/dbhome_1/root.sh
Execute /u01/app/oracle/product/11.2.0.4/dbhome_1/root.sh on the following nodes:
[tod2-db160, tod2-db162]
.................................................. 100% Done.
Execute Root Scripts successful.
Successfully Setup Software.
<20> Update /home/oracle/.bash_profile on both the nodes as oracle:
export CVUQDISK_GRP=oinstall
export TMP=/u02/tmp
export TMPDIR=$TMP
export ORACLE_BASE=/u01/app/oracle
export PATH=$PATH:$HOME/.local/bin:$HOME/bin:/usr/sbin
export GRID_HOME=/u01/app/12.2.0.1/grid
export ORACLE_SID=
export ORACLE_HOME=/u01/app/oracle/product/11.2.0.4/dbhome_1
export PATH=$ORACLE_HOME/bin:$PATH
<21> Apply database patch:
|
|__ o. patch: 27734982, 22241601, p6880880_112000_Linux-x86-64.zip
<22> Post-config:
|
|_ $ /u01/app/12.2.0.1/grid/bin/oclumon manage -disable diagsnap
|
| Diagsnap option is successfully Disabled on RAC-DB01
| Diagsnap option is successfully Disabled on RAC-DB02
| Successfully Disabled diagsnap
|
|
|__ o. Editing system file:
[root@RAC-DB01 ~]# vi /etc/systemd/logind.conf ==> Uncomment "RemoveIPC=no"
[root@RAC-DB02 ~]# vi /etc/systemd/logind.conf ==> Uncomment "RemoveIPC=no"
Your Comments