Current
scenario:
I have two nodes in the cluster presently.
Host names :
- rac1-pub.dba.com
- rac2-pub.dba.com
Node to be added:
- rac3-pub.dba.com
Procedure:
————————————
Prepare
the machine for third no
Hosts creation
[root@rac3-pub u01]# cat /etc/hosts
127.0.0.1
localhost.localdomain localhost
#########################PUBLIC IP#######
192.168.1.152
rac2-pub.dba.com rac2-pub
192.168.1.151
rac1-pub.dba.com rac1-pub
192.168.1.160
rac3-pub.dba.com rac3-pub
####RAC2 Private#
192.168.0.152
rac2-priv.dba.com rac2-priv
192.168.0.151
rac1-priv.dba.com rac1-priv
192.168.0.160
rac3-priv.dba.com rac3-priv
####VIRTUAL IP####
192.168.1.153 rac1-vip.dba.com rac1-vip
192.168.1.155
rac2-vip.dba.com rac2-vip
192.168.1.161
rac3-vip.dba.com rac3-vip
####SCANIP####
192.168.1.154
scanrac.dba.com scanrac
Add
node hostname and ip address in openfiler
[root@rac3-pub u01]# iscsiadm -m discovery -t st -p
192.168.1.156
Starting iscsid:
[ OK ]
192.168.1.156:3260,1
iqn.2006-01.com.openfiler:tsn.00950b8109c1
[root@rac3-pub u01]# service iscsi restart
Stopping iscsi:
[ OK ]
Starting iscsi:
[ OK ]
[root@rac3-pub u01]# fdisk -l
Disk /dev/sda: 751.6 GB, 751619276800 bytes
255 heads, 63 sectors/track, 91379 cylinders
Units = cylinders of 16065 * 512 = 8225280 bytes
Sector size (logical/physical): 512 bytes / 512
bytes
I/O size (minimum/optimal): 512 bytes / 512 bytes
Disk identifier: 0x00046e68
Device
Boot Start End Blocks
Id System
/dev/sda1
* 1 256
2048000 83 Linux
Partition 1 does not end on cylinder boundary.
/dev/sda2
256 38500 307200000
83 Linux
/dev/sda3
38500 43600 40960000
83 Linux
/dev/sda4
43600 91380
383794176 5 Extended
/dev/sda5
43600 44638 8340480
83 Linux
/dev/sda6
44638 45403 6144000
82 Linux swap / Solaris
/dev/sda7
45403 91380 369306624
83 Linux
Disk /dev/sdb: 53.7 GB, 53687091200 bytes
64 heads, 32 sectors/track, 51200 cylinders
Units = cylinders of 2048 * 512 = 1048576 bytes
Sector size (logical/physical): 512 bytes / 512
bytes
I/O size (minimum/optimal): 512 bytes / 512 bytes
Disk identifier: 0xec15c064
Device
Boot Start End Blocks
Id System
/dev/sdb1 1 51200
52428784 83 Linux
Disk /dev/sdd: 75.2 GB, 75161927680 bytes
255 heads, 63 sectors/track, 9137 cylinders
Units = cylinders of 16065 * 512 = 8225280 bytes
Sector size (logical/physical): 512 bytes / 512
bytes
I/O size (minimum/optimal): 512 bytes / 512 bytes
Disk identifier: 0xd4befbbd
Device
Boot Start End Blocks
Id System
/dev/sdd1 1 9137
73392921 83 Linux
Disk /dev/sde: 75.2 GB, 75161927680 bytes
255 heads, 63 sectors/track, 9137 cylinders
Units = cylinders of 16065 * 512 = 8225280 bytes
Sector size (logical/physical): 512 bytes / 512
bytes
I/O size (minimum/optimal): 512 bytes / 512 bytes
Disk identifier: 0x663f7332
Device
Boot Start End Blocks
Id System
/dev/sde1 1 9137
73392921 83 Linux
Disk /dev/sdf: 1073 MB, 1073741824 bytes
34 heads, 61 sectors/track, 1011 cylinders
Units = cylinders of 2074 * 512 = 1061888 bytes
Sector size (logical/physical): 512 bytes / 512
bytes
I/O size (minimum/optimal): 512 bytes / 512 bytes
Disk identifier: 0xd4e4e901
Device
Boot Start End Blocks
Id System
/dev/sdf1 1 1011
1048376+ 83
Linux
Disk /dev/sdc: 53.7 GB, 53687091200 bytes
64 heads, 32 sectors/track, 51200 cylinders
Units = cylinders of 2048 * 512 = 1048576 bytes
Sector size (logical/physical): 512 bytes / 512
bytes
I/O size (minimum/optimal): 512 bytes / 512 bytes
Disk identifier: 0xc4a613d3
Device
Boot Start End Blocks
Id System
/dev/sdc1 1 51200
52428784 83 Linux
Disk /dev/sdg: 1073 MB, 1073741824 bytes
34 heads, 61 sectors/track, 1011 cylinders
Units = cylinders of 2074 * 512 = 1061888 bytes
Sector size (logical/physical): 512 bytes / 512
bytes
I/O size (minimum/optimal): 512 bytes / 512 bytes
Disk identifier: 0xe8aded66
Device
Boot Start End Blocks
Id System
/dev/sdg1 1
1011 1048376+ 83
Linux
Disk /dev/sdh: 53.7 GB, 53687091200 bytes
64 heads, 32 sectors/track, 51200 cylinders
Units = cylinders of 2048 * 512 = 1048576 bytes
Sector size (logical/physical): 512 bytes / 512
bytes
I/O size (minimum/optimal): 512 bytes / 512 bytes
Disk identifier: 0x072ef5c3
Device
Boot Start End Blocks
Id System
/dev/sdh1 1 51200
52428784 83 Linux
[root@rac3-pub u01]#
Create users/groups
[root@rac3-pub u01]# userdel oracle
[root@rac3-pub u01]# groupdel oinstall
[root@rac3-pub u01]# groupdel dba
[root@rac3-pub u01]# groupadd -g 700 dba
[root@rac3-pub u01]# groupadd -g 701 oinstall
[root@rac3-pub u01]# groupadd -g 702 asmadmin
[root@rac3-pub u01]# groupadd -g 703 asmdba
[root@rac3-pub u01]# groupadd -g 704 asmoper
[root@rac3-pub
u01]# useradd -u 701 -g oinstall -G asmadmin,asmdba,asmoper grid
[root@rac3-pub home]# useradd -u
702 -g oinstall -G dba,asmdba oracle
[root@rac3-pub home]# chown -R oracle:oinstall
/home/oracle/
[root@rac3-pub home]# passwd grid
Changing password for user grid.
New password:
BAD PASSWORD: it is too short
BAD PASSWORD: is too simple
Retype new password:
passwd: all authentication tokens updated
successfully.
[root@rac3-pub home]# passwd oracle
Changing password for user oracle.
New password:
BAD PASSWORD: it is based on a dictionary word
BAD PASSWORD: is too simple
Retype new password:
passwd: all authentication tokens updated
successfully.
[root@rac3-pub home]#
Set kernel parameter
#Oracle-Validated
setting for core soft limit is unlimited
oracle soft
core unlimited
#Oracle-Validated
setting for core hard limit is unlimited
oracle hard
core unlimited
#Oracle-Validated
setting for memlock soft limit is 50000000
oracle
soft memlock 50000000
#Oracle-Validated
setting for memlock hard limit is 50000000
oracle
hard memlock 50000000
#
oracle-rdbms-server-11gR2-preinstall setting for nofile soft limit is 1024
oracle soft
nofile 1024
grid soft
nofile 1024
#
oracle-rdbms-server-11gR2-preinstall setting for nofile hard limit is 65536
oracle hard
nofile 65536
grid hard
nofile 65536
#
oracle-rdbms-server-11gR2-preinstall setting for nproc soft limit is 2047
oracle soft
nproc 2047
grid soft
nproc 2047
#
oracle-rdbms-server-11gR2-preinstall setting for nproc hard limit is 16384
oracle hard
nproc 16384
grid hard
nproc 16384
#
oracle-rdbms-server-11gR2-preinstall setting for stack soft limit is 10240KB
oracle soft
stack 10240
grid soft
stack 10240
#
oracle-rdbms-server-11gR2-preinstall setting for stack hard limit is 32768KB
oracle hard
stack 32768
grid hard
stack 32768
Make directories
[root@rac3-pub
home]# mkdir -p /u01/app/oraInventory
[root@rac3-pub
home]# chown -R grid:oinstall /u01/app/oraInventory/
[root@rac3-pub
home]# mkdir -p /u01/app/grid
[root@rac3-pub
home]# chown -R grid:oinstall /u01/app/grid/
[root@rac3-pub
home]# chmod -R 775 /u01/app/grid/
[root@rac3-pub
home]# mkdir -p /u01/app/11023/grid
[root@rac3-pub
home]# chown -R grid:oinstall /u01/app/11023/grid/
[root@rac3-pub
home]# chmod -R 775 /u01/app/11023/grid/
[root@rac3-pub
home]# mkdir -p /u01/app/oracle
[root@rac3-pubhome]# mkdir –p /u01/app/oracle/product/11203/db_home
[root@rac3-pub home]# chown -R oracle:oinstall
/u01/app/oracle/product/11203/db_home
[root@rac3-pub home]# chmod -R 775 /u01/app/oracle/
[root@rac3-pub home]# chmod -R 775 /u01/app/oracle/product/11203/db_home/
Install required rpm’s(OEL6)
[root@rac3-pub u01]# rpm -qa | grep oracleasm
oracleasm-support-2.1.8-1.el6.x86_64
[root@rac3-pub u01]# cd oel6_rpms_grid/
[root@rac3-pub oel6_rpms_grid]# ls
oracleasmlib-2.0.4-1.el6.x86_64.rpm oracleasm-support-2.1.8-1.el6.x86_64.rpm
[root@rac3-pub oel6_rpms_grid]# rpm -ivh
oracleasmlib-2.0.4-1.el6.x86_64.rpm
warning: oracleasmlib-2.0.4-1.el6.x86_64.rpm: Header
V3 RSA/SHA256 Signature, key ID ec551f03: NOKEY
Preparing...
########################################### [100%]
1:oracleasmlib ###########################################
[100%]
[root@rac3-pub oel6_rpms_grid]# rpm -ivh
oracleasm-support-2.1.8-1.el6.x86_64.rpm
warning: oracleasm-support-2.1.8-1.el6.x86_64.rpm:
Header V3 RSA/SHA256 Signature, key ID ec551f03: NOKEY
Preparing...
########################################### [100%]
package oracleasm-support-2.1.8-1.el6.x86_64 is already installed
Configure
OracleAsm
First disabled selinux
[root@rac3-pub u01]# cat /etc/selinux/config
Then disabled firewall
# This file controls the state of SELinux on the
system.
# SELINUX= can take one of these three values:
#
enforcing - SELinux security policy is enforced.
#
permissive - SELinux prints warnings instead of enforcing.
# disabled
- No SELinux policy is loaded.
SELINUX=disabled
# SELINUXTYPE= can take one of these two values:
# targeted
- Targeted processes are protected,
# mls -
Multi Level Security protection.
SELINUXTYPE=targeted
[root@rac3-pub oel6_rpms_grid]# oracleasm configure
-i
Configuring the Oracle ASM library driver.
This will configure the on-boot properties of the
Oracle ASM library
driver. The
following questions will determine whether the driver is
loaded on boot and what permissions it will
have. The current values
will be shown in brackets ('[]'). Hitting <ENTER> without typing an
answer will keep that current value. Ctrl-C will abort.
Default user to own the driver interface []: grid
Default group to own the driver interface []:
asmadmin
Start Oracle ASM library driver on boot (y/n) [n]: y
Scan for Oracle ASM disks on boot (y/n) [y]: y
Writing Oracle ASM library driver configuration:
done
[root@rac3-pub oel6_rpms_grid]# oracleasm init
Creating /dev/oracleasm mount point: /dev/oracleasm
Loading module "oracleasm": oracleasm
Configuring "oracleasm" to use device
physical block size
Mounting ASMlib driver filesystem: /dev/oracleasm
[root@rac3-pub u01]# oracleasm scandisks
Reloading disk partitions: done
Cleaning any stale ASM disks...
Scanning system for ASM disks...
[root@rac3-pub u01]# oracleasm listdisks
CRS1
CRS2
DATA1
DATA2
FRA1
FRA2
FRA3
[root@rac3-pub u01]# vi /etc/sysconfig/ntpd
[root@rac3-pub u01]# service restart ntpd restart
restart: unrecognized service
[root@rac3-pub u01]# service restart ntpd
restart: unrecognized service
[root@rac3-pub u01]# service ntpd restart
Shutting down ntpd:
[FAILED]
Starting ntpd:
[ OK ]
[root@rac3-pub u01]# chkconfig --level 5 ntpd off
[root@rac3-pub u01]# service ntpd restart
Shutting down ntpd: [ OK ]
Starting ntpd:
[ OK ]
[grid@rac1-pub grid]$ cd sshsetup/
[grid@rac1-pub sshsetup]$ ls
sshUserSetup.sh
[grid@rac1-pub sshsetup]$ ./sshUserSetup.sh -user grid -hosts
"rac1-pub rac2-pub rac3-pub" -noPromptPassphrase
The output of this script is also logged into
/tmp/sshUserSetup_2017-03-28-16-44-43.log
Hosts are rac1-pub rac2-pub rac3-pub
user is grid
Platform:- Linux
Checking if the remote hosts are reachable
PING rac1-pub.dba.com (192.168.1.151) 56(84) bytes
of data.
64 bytes from rac1-pub.dba.com (192.168.1.151):
icmp_seq=1 ttl=64 time=0.033 ms
64 bytes from rac1-pub.dba.com (192.168.1.151):
icmp_seq=2 ttl=64 time=0.040 ms
64 bytes from rac1-pub.dba.com (192.168.1.151):
icmp_seq=3 ttl=64 time=0.055 ms
64 bytes from rac1-pub.dba.com (192.168.1.151):
icmp_seq=4 ttl=64 time=0.049 ms
64 bytes from rac1-pub.dba.com (192.168.1.151):
icmp_seq=5 ttl=64 time=0.041 ms
--- rac1-pub.dba.com ping statistics ---
5 packets transmitted, 5 received, 0% packet loss,
time 4000ms
rtt min/avg/max/mdev = 0.033/0.043/0.055/0.010 ms
PING rac2-pub.dba.com (192.168.1.152) 56(84) bytes
of data.
64 bytes from rac2-pub.dba.com (192.168.1.152):
icmp_seq=1 ttl=64 time=0.272 ms
64 bytes from rac2-pub.dba.com (192.168.1.152):
icmp_seq=2 ttl=64 time=0.365 ms
64 bytes from rac2-pub.dba.com (192.168.1.152):
icmp_seq=3 ttl=64 time=0.319 ms
64 bytes from rac2-pub.dba.com (192.168.1.152):
icmp_seq=4 ttl=64 time=0.162 ms
64 bytes from rac2-pub.dba.com (192.168.1.152):
icmp_seq=5 ttl=64 time=0.241 ms
--- rac2-pub.dba.com ping statistics ---
5 packets transmitted, 5 received, 0% packet loss,
time 4001ms
rtt min/avg/max/mdev = 0.162/0.271/0.365/0.072 ms
PING rac3-pub.dba.com (192.168.1.160) 56(84) bytes
of data.
64 bytes from rac3-pub.dba.com (192.168.1.160):
icmp_seq=1 ttl=64 time=1.94 ms
64 bytes from rac3-pub.dba.com (192.168.1.160):
icmp_seq=2 ttl=64 time=0.286 ms
64 bytes from rac3-pub.dba.com (192.168.1.160):
icmp_seq=3 ttl=64 time=0.196 ms
64 bytes from rac3-pub.dba.com (192.168.1.160):
icmp_seq=4 ttl=64 time=0.288 ms
64 bytes from rac3-pub.dba.com (192.168.1.160):
icmp_seq=5 ttl=64 time=0.564 ms
--- rac3-pub.dba.com ping statistics ---
5 packets transmitted, 5 received, 0% packet loss,
time 4002ms
rtt min/avg/max/mdev = 0.196/0.655/1.941/0.654 ms
Remote host reachability check succeeded.
The following hosts are reachable: rac1-pub rac2-pub
rac3-pub.
The following hosts are not reachable: .
All hosts are reachable. Proceeding further...
firsthost rac1-pub
numhosts 3
The script will setup SSH connectivity from the host
rac1-pub to all
the remote hosts. After the script is executed, the
user can use SSH to run
commands on the remote hosts or copy files between
this host rac1-pub
and the remote hosts without being prompted for
passwords or confirmations.
NOTE 1:
As part of the setup procedure, this script will use
ssh and scp to copy
files between the local host and the remote hosts.
Since the script does not
store passwords, you may be prompted for the
passwords during the execution of
the script whenever ssh or scp is invoked.
NOTE 2:
AS PER SSH REQUIREMENTS, THIS SCRIPT WILL SECURE THE
USER HOME DIRECTORY
AND THE .ssh DIRECTORY BY REVOKING GROUP AND WORLD
WRITE PRIVILEDGES TO THESE
directories.
Do you want to continue and let the script make the
above mentioned changes (yes/no)?
yes
The user chose yes
User chose to skip passphrase related questions.
Creating .ssh directory on local host, if not
present already
Creating authorized_keys file on local host
Changing permissions on authorized_keys to 644 on
local host
Creating known_hosts file on local host
Changing permissions on known_hosts to 644 on local
host
Creating config file on local host
If a config file exists already at
/home/grid/.ssh/config, it would be backed up to /home/grid/.ssh/config.backup.
Creating .ssh directory and setting permissions on
remote host rac1-pub
THE SCRIPT WOULD ALSO BE REVOKING WRITE PERMISSIONS
FOR group AND others ON THE HOME DIRECTORY FOR grid. THIS IS AN SSH
REQUIREMENT.
The script would create ~grid/.ssh/config file on
remote host rac1-pub. If a config file exists already at ~grid/.ssh/config, it
would be backed up to ~grid/.ssh/config.backup.
The user may be prompted for a password here since
the script would be running SSH on host rac1-pub.
Warning: Permanently added 'rac1-pub,192.168.1.151'
(RSA) to the list of known hosts.
grid@rac1-pub's password:
Done with creating .ssh directory and setting
permissions on remote host rac1-pub.
Creating .ssh directory and setting permissions on
remote host rac2-pub
THE SCRIPT WOULD ALSO BE REVOKING WRITE PERMISSIONS
FOR group AND others ON THE HOME DIRECTORY FOR grid. THIS IS AN SSH
REQUIREMENT.
The script would create ~grid/.ssh/config file on
remote host rac2-pub. If a config file exists already at ~grid/.ssh/config, it
would be backed up to ~grid/.ssh/config.backup.
The user may be prompted for a password here since
the script would be running SSH on host rac2-pub.
Warning: Permanently added 'rac2-pub,192.168.1.152'
(RSA) to the list of known hosts.
Done with creating .ssh directory and setting
permissions on remote host rac2-pub.
Creating .ssh directory and setting permissions on
remote host rac3-pub
THE SCRIPT WOULD ALSO BE REVOKING WRITE PERMISSIONS
FOR group AND others ON THE HOME DIRECTORY FOR grid. THIS IS AN SSH
REQUIREMENT.
The script would create ~grid/.ssh/config file on
remote host rac3-pub. If a config file exists already at ~grid/.ssh/config, it
would be backed up to ~grid/.ssh/config.backup.
The user may be prompted for a password here since
the script would be running SSH on host rac3-pub.
Warning: Permanently added 'rac3-pub,192.168.1.160'
(RSA) to the list of known hosts.
grid@rac3-pub's password:
Done with creating .ssh directory and setting
permissions on remote host rac3-pub.
Copying local host public key to the remote host
rac1-pub
The user may be prompted for a password or passphrase
here since the script would be using SCP for host rac1-pub.
grid@rac1-pub's password:
Done copying local host public key to the remote
host rac1-pub
Copying local host public key to the remote host
rac2-pub
The user may be prompted for a password or
passphrase here since the script would be using SCP for host rac2-pub.
Done copying local host public key to the remote
host rac2-pub
Copying local host public key to the remote host
rac3-pub
The user may be prompted for a password or
passphrase here since the script would be using SCP for host rac3-pub.
grid@rac3-pub's password:
Done copying local host public key to the remote
host rac3-pub
cat: /home/grid/.ssh/known_hosts.tmp: No such file
or directory
cat: /home/grid/.ssh/authorized_keys.tmp: No such file
or directory
SSH setup is complete.
------------------------------------------------------------------------
Verifying SSH setup
===================
The script will now run the date command on the
remote nodes using ssh
to verify if ssh is setup correctly. IF THE SETUP IS
CORRECTLY SETUP,
THERE SHOULD BE NO OUTPUT OTHER THAN THE DATE AND
SSH SHOULD NOT ASK FOR
PASSWORDS. If you see any output other than date or
are prompted for the
password, ssh is not setup correctly and you will
need to resolve the
issue and set up ssh again.
The possible causes for failure could be:
1. The server settings in /etc/ssh/sshd_config file
do not allow ssh
for user grid.
2. The server may have disabled public key based
authentication.
3. The client public key on the server may be
outdated.
4. ~grid or ~grid/.ssh on the remote host may not be
owned by grid.
5. User may not have passed -shared option for
shared remote users or
may be passing the -shared option for non-shared
remote users.
6. If there is output in addition to the date, but
no password is asked,
it may be a security alert shown as part of company
policy. Append the
additional text to the <OMS
HOME>/sysman/prov/resources/ignoreMessages.txt file.
------------------------------------------------------------------------
--rac1-pub:--
Running /usr/bin/ssh -x -l grid rac1-pub date to
verify SSH connectivity has been setup from local host to rac1-pub.
IF YOU SEE ANY OTHER OUTPUT BESIDES THE OUTPUT OF
THE DATE COMMAND OR IF YOU ARE PROMPTED FOR A PASSWORD HERE, IT MEANS SSH SETUP
HAS NOT BEEN SUCCESSFUL. Please note that being prompted for a passphrase may
be OK but being prompted for a password is ERROR.
Tue Mar 28 16:45:18 IST 2017
------------------------------------------------------------------------
--rac2-pub:--
Running /usr/bin/ssh -x -l grid rac2-pub date to
verify SSH connectivity has been setup from local host to rac2-pub.
IF YOU SEE ANY OTHER OUTPUT BESIDES THE OUTPUT OF
THE DATE COMMAND OR IF YOU ARE PROMPTED FOR A PASSWORD HERE, IT MEANS SSH SETUP
HAS NOT BEEN SUCCESSFUL. Please note that being prompted for a passphrase may
be OK but being prompted for a password is ERROR.
Tue Mar 28 16:45:18 IST 2017
------------------------------------------------------------------------
--rac3-pub:--
Running /usr/bin/ssh -x -l grid rac3-pub date to
verify SSH connectivity has been setup from local host to rac3-pub.
IF YOU SEE ANY OTHER OUTPUT BESIDES THE OUTPUT OF
THE DATE COMMAND OR IF YOU ARE PROMPTED FOR A PASSWORD HERE, IT MEANS SSH SETUP
HAS NOT BEEN SUCCESSFUL. Please note that being prompted for a passphrase may
be OK but being prompted for a password is ERROR.
Tue Mar 28 22:14:24 IST 2017
------------------------------------------------------------------------
SSH verification complete.
[grid@rac1-pub grid]$ ./runcluvfy.sh stage -pre
crsinst -n rac1-pub,rac2-pub,rac3-pub -fixup -verbose
Performing pre-checks for cluster services setup
Checking node reachability...
Check: Node reachability from node
"rac1-pub"
Destination
Node Reachable?
------------------------------------
------------------------
rac1-pub
yes
rac2-pub
yes
rac3-pub
yes
Result: Node reachability check passed from node
"rac1-pub"
Checking user equivalence...
Check: User equivalence for user "grid"
Node
Name Status
------------------------------------
------------------------
rac1-pub
passed
rac3-pub
passed
rac2-pub
passed
Result: User equivalence check passed for user
"grid"
Checking node connectivity...
Checking hosts config file...
Node
Name Status
------------------------------------
------------------------
rac1-pub
passed
rac3-pub
passed
rac2-pub
passed
Verification of the hosts config file successful
Interface information for node "rac1-pub"
Name IP Address Subnet Gateway Def. Gateway HW Address MTU
------
--------------- --------------- --------------- ---------------
----------------- ------
eth0 192.168.1.151 192.168.1.0 0.0.0.0 192.168.1.1 00:0C:29:CF:DC:00 1500
eth0 192.168.1.154 192.168.1.0 0.0.0.0 192.168.1.1 00:0C:29:CF:DC:00 1500
eth0 192.168.1.155 192.168.1.0 0.0.0.0 192.168.1.1 00:0C:29:CF:DC:00 1500
eth0 192.168.1.153 192.168.1.0 0.0.0.0 192.168.1.1 00:0C:29:CF:DC:00 1500
eth1 192.168.0.151 192.168.0.0 0.0.0.0 192.168.1.1 00:0C:29:CF:DC:0A 1500
eth1 169.254.135.117 169.254.0.0 0.0.0.0 192.168.1.1 00:0C:29:CF:DC:0A 1500
virbr0
192.168.122.1 192.168.122.0 0.0.0.0 192.168.1.1 52:54:00:62:93:12 1500
Interface information for node "rac3-pub"
Name IP Address Subnet
Gateway Def. Gateway HW Address MTU
------
--------------- --------------- --------------- ---------------
----------------- ------
eth0 192.168.1.160 192.168.1.0 0.0.0.0 192.168.1.1 00:0C:29:A1:4E:45 1500
eth1 192.168.0.160 192.168.0.0 0.0.0.0 192.168.1.1 00:0C:29:A1:4E:4F 1500
virbr0
192.168.122.1 192.168.122.0 0.0.0.0 192.168.1.1 52:54:00:32:E8:AB 1500
Interface information for node "rac2-pub"
Name IP Address Subnet Gateway Def. Gateway HW Address MTU
------
--------------- --------------- --------------- ---------------
----------------- ------
eth0 192.168.1.152 192.168.1.0 0.0.0.0 192.168.1.1 00:0C:29:0B:8A:BC 1500
eth1 192.168.0.152 192.168.0.0 0.0.0.0 192.168.1.1 00:0C:29:0B:8A:C6 1500
eth1 169.254.204.65 169.254.0.0 0.0.0.0 192.168.1.1 00:0C:29:0B:8A:C6 1500
virbr0
192.168.122.1 192.168.122.0 0.0.0.0 192.168.1.1 52:54:00:86:C4:DB 1500
Check: Node connectivity for interface
"eth0"
Source Destination Connected?
------------------------------
------------------------------ ----------------
rac1-pub[192.168.1.151]
rac1-pub[192.168.1.154]
yes
rac1-pub[192.168.1.151]
rac1-pub[192.168.1.155]
yes
rac1-pub[192.168.1.151]
rac1-pub[192.168.1.153]
yes
rac1-pub[192.168.1.151]
rac3-pub[192.168.1.160]
yes
rac1-pub[192.168.1.151]
rac2-pub[192.168.1.152]
yes
rac1-pub[192.168.1.154]
rac1-pub[192.168.1.155]
yes
rac1-pub[192.168.1.154] rac1-pub[192.168.1.153] yes
rac1-pub[192.168.1.154]
rac3-pub[192.168.1.160]
yes
rac1-pub[192.168.1.154]
rac2-pub[192.168.1.152]
yes
rac1-pub[192.168.1.155]
rac1-pub[192.168.1.153]
yes
rac1-pub[192.168.1.155]
rac3-pub[192.168.1.160]
yes
rac1-pub[192.168.1.155]
rac2-pub[192.168.1.152]
yes
rac1-pub[192.168.1.153]
rac3-pub[192.168.1.160]
yes
rac1-pub[192.168.1.153]
rac2-pub[192.168.1.152]
yes
rac3-pub[192.168.1.160]
rac2-pub[192.168.1.152]
yes
Result: Node connectivity passed for interface "eth0"
Check: TCP connectivity of subnet
"192.168.1.0"
Source Destination Connected?
------------------------------
------------------------------
----------------
rac1-pub:192.168.1.151 rac1-pub:192.168.1.154 passed
rac1-pub:192.168.1.151
rac1-pub:192.168.1.155
passed
rac1-pub:192.168.1.151
rac1-pub:192.168.1.153
passed
rac1-pub:192.168.1.151
rac3-pub:192.168.1.160
passed
rac1-pub:192.168.1.151
rac2-pub:192.168.1.152
passed
Result: TCP connectivity check passed for subnet
"192.168.1.0"
Check: Node connectivity for interface
"eth1"
Source Destination Connected?
------------------------------
------------------------------
----------------
rac1-pub[192.168.0.151]
rac3-pub[192.168.0.160]
yes
rac1-pub[192.168.0.151]
rac2-pub[192.168.0.152]
yes
rac3-pub[192.168.0.160]
rac2-pub[192.168.0.152]
yes
Result: Node connectivity passed for interface
"eth1"
Check: TCP connectivity of subnet
"192.168.0.0"
Source Destination Connected?
------------------------------
------------------------------
----------------
rac1-pub:192.168.0.151
rac3-pub:192.168.0.160
passed
rac1-pub:192.168.0.151
rac2-pub:192.168.0.152
passed
Result: TCP connectivity check passed for subnet
"192.168.0.0"
Checking subnet mask consistency...
Subnet mask consistency check passed for subnet
"192.168.1.0".
Subnet mask consistency check passed for subnet "192.168.0.0".
Subnet mask consistency check passed.
Result: Node connectivity check passed
Checking multicast communication...
Checking subnet "192.168.1.0" for
multicast communication with multicast group "230.0.1.0"...
Check of subnet "192.168.1.0" for
multicast communication with multicast group "230.0.1.0" passed.
Checking subnet "192.168.0.0" for
multicast communication with multicast group "230.0.1.0"...
Check of subnet "192.168.0.0" for
multicast communication with multicast group "230.0.1.0" passed.
Check of multicast communication passed.
Checking ASMLib configuration.
Node
Name Status
------------------------------------
------------------------
rac1-pub
passed
rac3-pub passed
rac2-pub
passed
Result: Check for ASMLib configuration passed.
Check: Total memory
Node
Name Available Required Status
------------
------------------------
------------------------
----------
rac1-pub 1.9472GB
(2041760.0KB) 1.5GB (1572864.0KB) passed
rac3-pub 983.9102MB
(1007524.0KB) 1.5GB (1572864.0KB) failed
rac2-pub 1.9472GB (2041760.0KB) 1.5GB (1572864.0KB) passed
Result: Total memory check failed
Check: Available memory
Node
Name Available Required Status
------------
------------------------
------------------------ ----------
rac1-pub 872.0508MB
(892980.0KB) 50MB (51200.0KB) passed
rac3-pub 692.6719MB
(709296.0KB) 50MB (51200.0KB) passed
rac2-pub 832.8789MB
(852868.0KB) 50MB (51200.0KB) passed
Result: Available memory check passed
Check: Swap space
Node
Name Available Required Status
------------
------------------------
------------------------
----------
rac1-pub 5.9805GB
(6270972.0KB) 2.9208GB
(3062640.0KB) passed
rac3-pub 5.8594GB
(6143996.0KB) 1.5GB (1572864.0KB) passed
rac2-pub 5.9805GB
(6270972.0KB) 2.9208GB
(3062640.0KB) passed
Result: Swap space check passed
Check: Free disk space for
"rac1-pub:/u01/app/11203/grid"
Path Node Name Mount point Available
Required Status
----------------
------------ ------------ ------------
------------ ------------
/u01/app/11203/grid rac1-pub /u01 311.3691GB 5.5GB passed
Result: Free disk space check passed for
"rac1-pub:/u01/app/11203/grid"
Check: Free disk space for
"rac3-pub:/u01/app/11203/grid"
Path Node Name Mount point Available
Required Status
----------------
------------ ------------ ------------
------------ ------------
/u01/app/11203/grid rac3-pub /u01 286.8242GB 5.5GB passed
Result: Free disk space check passed for
"rac3-pub:/u01/app/11203/grid"
Check: Free disk space for
"rac2-pub:/u01/app/11203/grid"
Path Node Name Mount point Available
Required Status
----------------
------------ ------------ ------------
------------ ------------
/u01/app/11203/grid rac2-pub /u01
323.3857GB 5.5GB passed
Result: Free disk space check passed for
"rac2-pub:/u01/app/11203/grid"
Check: Free disk space for "rac1-pub:/tmp"
Path Node Name Mount point Available
Required Status
---------------- ------------
------------ ------------ ------------
------------
/tmp rac1-pub /tmp 7.5966GB 1GB passed
Result: Free disk space check passed for
"rac1-pub:/tmp"
Check: Free disk space for "rac3-pub:/tmp"
Path Node Name Mount point Available
Required Status
----------------
------------ ------------ ------------
------------ ------------
/tmp rac3-pub /tmp 7.6309GB 1GB
passed
Result: Free disk space check passed for
"rac3-pub:/tmp"
Check: Free disk space for "rac2-pub:/tmp"
Path Node Name Mount point Available
Required Status
----------------
------------ ------------ ------------ ------------
------------
/tmp rac2-pub /tmp 7.6182GB 1GB passed
Result: Free disk space check passed for
"rac2-pub:/tmp"
Check: User existence for "grid"
Node
Name Status Comment
------------
------------------------
------------------------
rac1-pub passed exists(700)
rac3-pub passed exists(701)
rac2-pub passed exists(700)
ERROR:
PRVF-4123 : Inconsistent user IDs found for user
"grid"
User ID is "701" on nodes:rac3-pub
User ID is "700" on nodes:rac1-pub,rac2-pub
Result: User existence check failed for
"grid"
Check: Group existence for "oinstall"
Node
Name Status Comment
------------
------------------------
------------------------
rac1-pub passed exists
rac3-pub passed exists
rac2-pub passed exists
ERROR:
PRVF-4020 : Inconsistent group IDs found for group
"oinstall"
Group ID is "702" on nodes:rac3-pub
Group ID is "701" on nodes:rac1-pub,rac2-pub
Result: Group existence check failed for
"oinstall"
Check: Group existence for "dba"
Node Name
Status Comment
------------
------------------------
------------------------
rac1-pub passed exists
rac3-pub passed exists
rac2-pub passed exists
ERROR:
PRVF-4020 : Inconsistent group IDs found for group
"dba"
Group ID is "701" on nodes:rac3-pub
Group ID is "700" on nodes:rac1-pub,rac2-pub
Result: Group existence check failed for
"dba"
Check: Membership of user "grid" in group
"oinstall" [as Primary]
Node
Name User Exists Group Exists
User in Group Primary Status
----------------
------------ ------------ ------------
------------ ------------
rac1-pub yes yes yes yes passed
rac3-pub yes yes yes yes passed
rac2-pub yes yes yes yes passed
Result: Membership check for user "grid"
in group "oinstall" [as Primary] passed
Check: Membership of user "grid" in group
"dba"
Node
Name User Exists Group Exists
User in Group Status
----------------
------------ ------------ ------------
----------------
rac1-pub yes yes no failed
rac3-pub yes yes no failed
rac2-pub yes yes no failed
Result: Membership check for user "grid" in
group "dba" failed
Check: Run level
Node
Name run level Required Status
------------
------------------------
------------------------
----------
rac1-pub 5 3,5 passed
rac3-pub 5 3,5 passed
rac2-pub 5 3,5 passed
Result: Run level check passed
Check: Hard limits for "maximum open file
descriptors"
Node
Name Type Available Required Status
----------------
------------ ------------ ------------
----------------
rac1-pub hard 65536 65536 passed
rac3-pub hard 65536 65536 passed
rac2-pub hard 65536 65536 passed
Result: Hard limits check passed for "maximum
open file descriptors"
Check: Soft limits for "maximum open file
descriptors"
Node
Name Type Available Required Status
----------------
------------ ------------ ------------
----------------
rac1-pub soft 1024 1024 passed
rac3-pub soft 1024 1024 passed
rac2-pub soft 1024 1024 passed
Result: Soft limits check passed for "maximum
open file descriptors"
Check: Hard limits for "maximum user
processes"
Node
Name Type Available Required Status
----------------
------------ ------------ ------------
----------------
rac1-pub hard 16384 16384 passed
rac3-pub hard 16384 16384 passed
rac2-pub hard 16384 16384 passed
Result: Hard limits check passed for "maximum
user processes"
Check: Soft limits for "maximum user
processes"
Node
Name Type Available Required Status
----------------
------------ ------------ ------------
----------------
rac1-pub soft 2047 2047 passed
rac3-pub soft 2047 2047 passed
rac2-pub soft 2047 2047 passed
Result: Soft limits check passed for "maximum
user processes"
Check: System architecture
Node
Name Available Required Status
------------
------------------------
------------------------
----------
rac1-pub x86_64 x86_64 passed
rac3-pub x86_64 x86_64 passed
rac2-pub x86_64 x86_64 passed
Result: System architecture check passed
Check: Kernel version
Node
Name Available Required Status
------------
------------------------
------------------------
----------
rac1-pub
2.6.39-400.17.1.el6uek.x86_64
2.6.32 passed
rac3-pub
2.6.39-400.17.1.el6uek.x86_64
2.6.32 passed
rac2-pub
2.6.39-400.17.1.el6uek.x86_64
2.6.32 passed
Result: Kernel version check passed
Check: Kernel parameter for "semmsl"
Node
Name Current Configured Required Status Comment
----------------
------------ ------------ ------------
------------ ------------
rac1-pub 250 250 250 passed
rac3-pub 250 250 250 passed
rac2-pub 250 250 250 passed
Result: Kernel parameter check passed for
"semmsl"
Check: Kernel parameter for "semmns"
Node
Name Current Configured Required Status Comment
----------------
------------ ------------ ------------
------------ ------------
rac1-pub 32000 32000 32000 passed
rac3-pub 32000 32000 32000 passed
rac2-pub 32000 32000 32000 passed
Result: Kernel parameter check passed for
"semmns"
Check: Kernel parameter for "semopm"
Node
Name Current Configured Required Status Comment
----------------
------------ ------------ ------------
------------ ------------
rac1-pub 100 100 100 passed
rac3-pub 100 100 100 passed
rac2-pub 100 100 100 passed
Result: Kernel parameter check passed for
"semopm"
Check: Kernel parameter for "semmni"
Node
Name Current Configured Required Status Comment
---------------- ------------
------------ ------------ ------------
------------
rac1-pub 128 128 128 passed
rac3-pub 128 128 128 passed
rac2-pub 128 128
128 passed
Result: Kernel parameter check passed for
"semmni"
Check: Kernel parameter for "shmmax"
Node
Name Current Configured Required Status Comment
----------------
------------ ------------ ------------
------------ ------------
rac1-pub
4398046511104 4398046511104 1045381120
passed
rac3-pub
4398046511104 4398046511104 515852288
passed
rac2-pub 4398046511104 4398046511104
1045381120 passed
Result: Kernel parameter check passed for
"shmmax"
Check: Kernel parameter for "shmmni"
Node
Name Current Configured Required Status Comment
----------------
------------ ------------ ------------
------------ ------------
rac1-pub 4096 4096 4096 passed
rac3-pub 4096 4096 4096 passed
rac2-pub 4096 4096 4096 passed
Result: Kernel parameter check passed for
"shmmni"
Check: Kernel parameter for "shmall"
Node
Name Current Configured Required Status Comment
----------------
------------ ------------ ------------
------------ ------------
rac1-pub 1073741824 1073741824 2097152 passed
rac3-pub 1073741824 1073741824 2097152 passed
rac2-pub 1073741824 1073741824 2097152 passed
Result: Kernel parameter check passed for
"shmall"
Check: Kernel parameter for "file-max"
Node
Name Current Configured Required Status Comment
----------------
------------ ------------ ------------
------------ ------------
rac1-pub 6815744 6815744
6815744 passed
rac3-pub 6815744 6815744 6815744 passed
rac2-pub 6815744 6815744 6815744 passed
Result: Kernel parameter check passed for
"file-max"
Check: Kernel parameter for
"ip_local_port_range"
Node
Name Current Configured Required Status Comment
----------------
------------ ------------ ------------
------------ ------------
rac1-pub between 9000.0
& 65500.0 between 9000.0 &
65500.0 between 9000.0 &
65500.0 passed
rac3-pub between 9000.0
& 65500.0 between 9000.0 &
65500.0 between 9000.0 & 65500.0 passed
rac2-pub between 9000.0
& 65500.0 between 9000.0 &
65500.0 between 9000.0 & 65500.0 passed
Result: Kernel parameter check passed for
"ip_local_port_range"
Check: Kernel parameter for "rmem_default"
Node
Name Current Configured Required Status Comment
----------------
------------ ------------ ------------
------------ ------------
rac1-pub 262144 262144 262144 passed
rac3-pub 262144 262144 262144 passed
rac2-pub 262144 262144 262144 passed
Result: Kernel parameter check passed for
"rmem_default"
Check: Kernel parameter for "rmem_max"
Node
Name Current Configured Required Status Comment
----------------
------------ ------------ ------------
------------ ------------
rac1-pub 4194304 4194304 4194304 passed
rac3-pub 4194304 4194304 4194304 passed
rac2-pub 4194304 4194304 4194304 passed
Result: Kernel parameter check passed for
"rmem_max"
Check: Kernel parameter for "wmem_default"
Node
Name Current Configured Required Status Comment
----------------
------------ ------------ ------------
------------ ------------
rac1-pub 262144 262144 262144
passed
rac3-pub 262144 262144 262144 passed
rac2-pub 262144 262144 262144 passed
Result: Kernel parameter check passed for
"wmem_default"
Check: Kernel parameter for "wmem_max"
Node
Name Current Configured Required Status Comment
----------------
------------ ------------ ------------
------------ ------------
rac1-pub 1048576 1048576 1048576 passed
rac3-pub 1048576 1048576 1048576 passed
rac2-pub 1048576 1048576 1048576 passed
Result: Kernel parameter check passed for
"wmem_max"
Check: Kernel parameter for "aio-max-nr"
Node
Name Current Configured Required Status Comment
----------------
------------ ------------ ------------
------------ ------------
rac1-pub 1048576 1048576 1048576 passed
rac3-pub 1048576 1048576 1048576 passed
rac2-pub 1048576 1048576 1048576 passed
Result: Kernel parameter check passed for
"aio-max-nr"
Check: Package existence for "binutils"
Node
Name Available Required Status
------------
------------------------
------------------------
----------
rac1-pub
binutils-2.20.51.0.2-5.36.el6
binutils-2.20.51.0.2 passed
rac3-pub
binutils-2.20.51.0.2-5.36.el6
binutils-2.20.51.0.2 passed
rac2-pub binutils-2.20.51.0.2-5.36.el6 binutils-2.20.51.0.2 passed
Result: Package existence check passed for
"binutils"
Check: Package existence for
"compat-libcap1"
Node
Name Available Required Status
------------
------------------------
------------------------
----------
rac1-pub
compat-libcap1-1.10-1
compat-libcap1-1.10 passed
rac3-pub
compat-libcap1-1.10-1
compat-libcap1-1.10 passed
rac2-pub compat-libcap1-1.10-1 compat-libcap1-1.10 passed
Result: Package existence check passed for
"compat-libcap1"
Check: Package existence for
"compat-libstdc++-33(x86_64)"
Node
Name Available Required Status
------------ ------------------------ ------------------------ ----------
rac1-pub
compat-libstdc++-33(x86_64)-3.2.3-69.el6
compat-libstdc++-33(x86_64)-3.2.3
passed
rac3-pub
compat-libstdc++-33(x86_64)-3.2.3-69.el6
compat-libstdc++-33(x86_64)-3.2.3
passed
rac2-pub
compat-libstdc++-33(x86_64)-3.2.3-69.el6
compat-libstdc++-33(x86_64)-3.2.3
passed
Result: Package existence check passed for
"compat-libstdc++-33(x86_64)"
Check: Package existence for
"libgcc(x86_64)"
Node
Name Available Required Status
------------
------------------------
------------------------
----------
rac1-pub
libgcc(x86_64)-4.4.7-3.el6
libgcc(x86_64)-4.4.4 passed
rac3-pub
libgcc(x86_64)-4.4.7-3.el6
libgcc(x86_64)-4.4.4 passed
rac2-pub
libgcc(x86_64)-4.4.7-3.el6
libgcc(x86_64)-4.4.4 passed
Result: Package existence check passed for
"libgcc(x86_64)"
Check: Package existence for
"libstdc++(x86_64)"
Node
Name Available Required Status
------------
------------------------
------------------------
----------
rac1-pub
libstdc++(x86_64)-4.4.7-3.el6
libstdc++(x86_64)-4.4.4 passed
rac3-pub
libstdc++(x86_64)-4.4.7-3.el6
libstdc++(x86_64)-4.4.4 passed
rac2-pub
libstdc++(x86_64)-4.4.7-3.el6
libstdc++(x86_64)-4.4.4 passed
Result: Package existence check passed for
"libstdc++(x86_64)"
Check: Package existence for
"libstdc++-devel(x86_64)"
Node
Name Available Required Status
------------
------------------------
------------------------
----------
rac1-pub
libstdc++-devel(x86_64)-4.4.7-3.el6
libstdc++-devel(x86_64)-4.4.4
passed
rac3-pub libstdc++-devel(x86_64)-4.4.7-3.el6 libstdc++-devel(x86_64)-4.4.4 passed
rac2-pub
libstdc++-devel(x86_64)-4.4.7-3.el6
libstdc++-devel(x86_64)-4.4.4
passed
Result: Package existence check passed for
"libstdc++-devel(x86_64)"
Check: Package existence for "sysstat"
Node
Name Available Required Status
------------
------------------------
------------------------
----------
rac1-pub
sysstat-9.0.4-20.el6
sysstat-9.0.4 passed
rac3-pub sysstat-9.0.4-20.el6 sysstat-9.0.4 passed
rac2-pub
sysstat-9.0.4-20.el6
sysstat-9.0.4 passed
Result: Package existence check passed for
"sysstat"
Check: Package existence for "gcc"
Node
Name Available Required Status
------------
------------------------
------------------------
----------
rac1-pub gcc-4.4.7-3.el6 gcc-4.4.4 passed
rac3-pub gcc-4.4.7-3.el6 gcc-4.4.4 passed
rac2-pub gcc-4.4.7-3.el6 gcc-4.4.4 passed
Result: Package existence check passed for
"gcc"
Check: Package existence for "gcc-c++"
Node
Name Available Required Status
------------
------------------------
------------------------
----------
rac1-pub
gcc-c++-4.4.7-3.el6
gcc-c++-4.4.4 passed
rac3-pub
gcc-c++-4.4.7-3.el6
gcc-c++-4.4.4 passed
rac2-pub gcc-c++-4.4.7-3.el6 gcc-c++-4.4.4 passed
Result: Package existence check passed for
"gcc-c++"
Check: Package existence for "ksh"
Node
Name Available Required Status
------------ ------------------------ ------------------------ ----------
rac1-pub
ksh-20100621-19.el6
ksh-20100621 passed
rac3-pub
ksh-20100621-19.el6
ksh-20100621 passed
rac2-pub
ksh-20100621-19.el6
ksh-20100621 passed
Result: Package existence check passed for
"ksh"
Check: Package existence for "make"
Node
Name Available Required Status
------------
------------------------
------------------------
----------
rac1-pub
make-3.81-20.el6
make-3.81 passed
rac3-pub
make-3.81-20.el6
make-3.81 passed
rac2-pub
make-3.81-20.el6
make-3.81 passed
Result: Package existence check passed for
"make"
Check: Package existence for
"glibc(x86_64)"
Node
Name Available Required Status
------------
------------------------
------------------------
----------
rac1-pub
glibc(x86_64)-2.12-1.107.el6
glibc(x86_64)-2.12
passed
rac3-pub
glibc(x86_64)-2.12-1.107.el6
glibc(x86_64)-2.12 passed
rac2-pub
glibc(x86_64)-2.12-1.107.el6
glibc(x86_64)-2.12 passed
Result: Package existence check passed for
"glibc(x86_64)"
Check: Package existence for
"glibc-devel(x86_64)"
Node
Name Available Required Status
------------
------------------------
------------------------
----------
rac1-pub glibc-devel(x86_64)-2.12-1.107.el6 glibc-devel(x86_64)-2.12 passed
rac3-pub
glibc-devel(x86_64)-2.12-1.107.el6
glibc-devel(x86_64)-2.12 passed
rac2-pub
glibc-devel(x86_64)-2.12-1.107.el6
glibc-devel(x86_64)-2.12 passed
Result: Package existence check passed for
"glibc-devel(x86_64)"
Check: Package existence for
"libaio(x86_64)"
Node
Name Available Required Status
------------
------------------------
------------------------
----------
rac1-pub libaio(x86_64)-0.3.107-10.el6 libaio(x86_64)-0.3.107 passed
rac3-pub
libaio(x86_64)-0.3.107-10.el6
libaio(x86_64)-0.3.107 passed
rac2-pub
libaio(x86_64)-0.3.107-10.el6
libaio(x86_64)-0.3.107 passed
Result: Package existence check passed for
"libaio(x86_64)"
Check: Package existence for
"libaio-devel(x86_64)"
Node
Name Available Required Status
------------
------------------------
------------------------
----------
rac1-pub libaio-devel(x86_64)-0.3.107-10.el6 libaio-devel(x86_64)-0.3.107 passed
rac3-pub
libaio-devel(x86_64)-0.3.107-10.el6
libaio-devel(x86_64)-0.3.107
passed
rac2-pub
libaio-devel(x86_64)-0.3.107-10.el6
libaio-devel(x86_64)-0.3.107
passed
Result: Package existence check passed for
"libaio-devel(x86_64)"
Checking for multiple users with UID value 0
Result: Check for multiple users with UID value 0
passed
Check: Current group ID
Result: Current group ID check passed
Starting check for consistency of primary group of
root user
Node
Name Status
------------------------------------
------------------------
rac1-pub
passed
rac3-pub
passed
rac2-pub passed
Check for consistency of root user's primary group
passed
Starting Clock synchronization checks using Network
Time Protocol(NTP)...
NTP Configuration file check started...
Network Time Protocol(NTP) configuration file not
found on any of the nodes. Oracle Cluster Time Synchronization Service(CTSS)
can be used instead of NTP for time synchronization on the cluster nodes
No NTP Daemons or Services were found to be running
Result: Clock synchronization check using Network
Time Protocol(NTP) passed
Checking Core file name pattern consistency...
Core file name pattern consistency check passed.
Checking to make sure user "grid" is not
in "root" group
Node
Name Status Comment
------------ ------------------------ ------------------------
rac1-pub passed does not exist
rac3-pub passed does not exist
rac2-pub passed does not exist
Result: User "grid" is not part of
"root" group. Check passed
Check default user file creation mask
Node
Name Available Required Comment
------------
------------------------
------------------------
----------
rac1-pub 0022 0022 passed
rac3-pub 0022 0022 passed
rac2-pub 0022 0022 passed
Result: Default user file creation mask check passed
Checking consistency of file
"/etc/resolv.conf" across nodes
Checking the file "/etc/resolv.conf" to
make sure only one of domain and search entries is defined
File "/etc/resolv.conf" does not have both
domain and search entries defined
Checking if domain entry in file
"/etc/resolv.conf" is consistent across the nodes...
domain entry in file "/etc/resolv.conf" is
consistent across nodes
Checking if search entry in file
"/etc/resolv.conf" is consistent across the nodes...
search entry in file "/etc/resolv.conf" is
consistent across nodes
Checking DNS response time for an unreachable node
Node
Name Status
------------------------------------
------------------------
rac1-pub
failed
rac3-pub failed
rac2-pub
failed
PRVF-5636 : The DNS response time for an unreachable
node exceeded "15000" ms on following nodes:
rac1-pub,rac3-pub,rac2-pub
File "/etc/resolv.conf" is not consistent
across nodes
Check: Time zone consistency
Result: Time zone consistency check passed
Starting check for Reverse path filter setting ...
Reverse path filter setting is correct for all
private interconnect network interfaces on node "rac1-pub".
Reverse path filter setting is correct for all
private interconnect network interfaces on node "rac3-pub".
Reverse path filter setting is correct for all
private interconnect network interfaces on node "rac2-pub".
Check for Reverse path filter setting passed
Fixup information has been generated for following
node(s):
rac3-pub,rac2-pub,rac1-pub
Please run the following script on each node as
"root" user to execute the fixups:
'/tmp/CVU_11.2.0.4.0_grid/runfixup.sh'
Pre-check for cluster services setup was unsuccessful
on all the nodes.
[grid@rac1-pub bin]$ ./runcluvfy.sh stage
-pre nodeadd -n rac3-pub -fixup -verbose
[grid@rac1-pub
bin]$ export IGNORE_PREADDNODE_CHECKS=Y
[grid@rac1-pub bin]$ ./addNode.sh -ignoreSysPrereqs
-ignorePrereq -silent "CLUSTER_NEW_NODES={rac3-pub}"
"CLUSTER_NEW_VIRTUAL_HOSTNAMES={rac3-vip}"
[root@rac3-pub ~]#
/u01/app/oraInventory/orainstRoot.sh
Creating the Oracle inventory pointer file
(/etc/oraInst.loc)
Changing permissions of /u01/app/oraInventory.
Adding read,write permissions for group.
Removing read,write,execute permissions for world.
Changing groupname of /u01/app/oraInventory to
oinstall.
The execution of the script is complete.
[root@rac3-pub ~]#
/u01/app/oraInventory/orainstRoot.sh
Creating the Oracle inventory pointer file
(/etc/oraInst.loc)
Changing permissions of /u01/app/oraInventory.
Adding read,write permissions for group.
Removing read,write,execute permissions for world.
Changing groupname of /u01/app/oraInventory to
oinstall.
The execution of the script is complete.
Navigate to the $ORACLE_HOME/oui/bin directory on node1 and run the addNode.sh script using the following syntax
[oracle@rac1-pub
bin]$ ./runSSHSetup.sh -user oracle -hosts "rac1-pub rac2-pub
rac3-pub" -advanced –exverify
Starting Oracle
Universal Installer...
Checking swap space:
must be greater than 500 MB. Actual
5389 MB Passed
Oracle Universal
Installer, Version 11.2.0.4.0 Production
Copyright (C) 1999,
2013, Oracle. All rights reserved.
Performing tests to
see whether nodes rac2-pub,rac3-pub are available
...............................................................
100% Done.
..
-----------------------------------------------------------------------------
Cluster Node Addition
Summary
Global Settings
Source:
/u01/app/oracle/product/11203/db_home
New Nodes
Space Requirements
New Nodes
rac3-pub
/u01: Required 4.95GB : Available 263.28GB
Installed Products
Product Names
Oracle Database 11g 11.2.0.4.0
Java Development Kit 1.5.0.51.10
Installer SDK Component 11.2.0.4.0
Oracle One-Off Patch Installer 11.2.0.3.4
Oracle Universal Installer 11.2.0.4.0
Oracle USM Deconfiguration 11.2.0.4.0
Oracle Configuration Manager
Deconfiguration 10.3.1.0.0
Oracle DBCA Deconfiguration 11.2.0.4.0
Oracle RAC Deconfiguration 11.2.0.4.0
Oracle Database Deconfiguration
11.2.0.4.0
Oracle Configuration Manager Client
10.3.2.1.0
Oracle Configuration Manager 10.3.8.1.0
Oracle ODBC Driverfor Instant Client
11.2.0.4.0
LDAP Required Support Files 11.2.0.4.0
SSL Required Support Files for
InstantClient 11.2.0.4.0
Bali Share 1.1.18.0.0
Oracle Extended Windowing Toolkit
3.4.47.0.0
Oracle JFC Extended Windowing Toolkit
4.2.36.0.0
Oracle Real Application Testing
11.2.0.4.0
Oracle Database Vault J2EE Application
11.2.0.4.0
Oracle Label Security 11.2.0.4.0
Oracle Data Mining RDBMS Files 11.2.0.4.0
Oracle OLAP RDBMS Files 11.2.0.4.0
Oracle OLAP API 11.2.0.4.0
Platform Required Support Files
11.2.0.4.0
Oracle Database Vault option 11.2.0.4.0
Oracle RAC Required Support Files-HAS
11.2.0.4.0
SQL*Plus Required Support Files
11.2.0.4.0
Oracle Display Fonts 9.0.2.0.0
Oracle Ice Browser 5.2.3.6.0
Oracle JDBC Server Support Package
11.2.0.4.0
Oracle SQL Developer 11.2.0.4.0
Oracle Application Express 11.2.0.4.0
XDK Required Support Files 11.2.0.4.0
RDBMS Required Support Files for Instant
Client 11.2.0.4.0
SQLJ Runtime 11.2.0.4.0
Database Workspace Manager 11.2.0.4.0
RDBMS Required Support Files Runtime
11.2.0.4.0
Oracle Globalization Support 11.2.0.4.0
Exadata Storage Server 11.2.0.1.0
Provisioning Advisor Framework 10.2.0.4.3
Enterprise Manager Database Plugin --
Repository Support 11.2.0.4.0
Enterprise Manager Repository Core Files
10.2.0.4.5
Enterprise Manager Database Plugin --
Agent Support 11.2.0.4.0
Enterprise Manager Grid Control Core
Files 10.2.0.4.5
Enterprise Manager Common Core Files
10.2.0.4.5
Enterprise Manager Agent Core Files
10.2.0.4.5
RDBMS Required Support Files 11.2.0.4.0
regexp 2.1.9.0.0
Agent Required Support Files 10.2.0.4.5
Oracle 11g Warehouse Builder Required
Files 11.2.0.4.0
Oracle Notification Service (eONS)
11.2.0.4.0
Oracle Text Required Support Files
11.2.0.4.0
Parser Generator Required Support Files
11.2.0.4.0
Oracle Database 11g Multimedia Files
11.2.0.4.0
Oracle Multimedia Java Advanced Imaging
11.2.0.4.0
Oracle Multimedia Annotator 11.2.0.4.0
Oracle JDBC/OCI Instant Client 11.2.0.4.0
Oracle Multimedia Locator RDBMS Files
11.2.0.4.0
Precompiler Required Support Files
11.2.0.4.0
Oracle Core Required Support Files
11.2.0.4.0
Sample Schema Data 11.2.0.4.0
Oracle Starter Database 11.2.0.4.0
Oracle Message Gateway Common Files
11.2.0.4.0
Oracle XML Query 11.2.0.4.0
XML Parser for Oracle JVM 11.2.0.4.0
Oracle Help For Java 4.2.9.0.0
Installation Plugin Files 11.2.0.4.0
Enterprise Manager Common Files
10.2.0.4.5
Expat libraries 2.0.1.0.1
Deinstallation Tool 11.2.0.4.0
Oracle Quality of Service Management
(Client) 11.2.0.4.0
Perl Modules 5.10.0.0.1
JAccelerator (COMPANION) 11.2.0.4.0
Oracle Containers for Java 11.2.0.4.0
Perl Interpreter 5.10.0.0.2
Oracle Net Required Support Files 11.2.0.4.0
Secure Socket Layer 11.2.0.4.0
Oracle Universal Connection Pool
11.2.0.4.0
Oracle JDBC/THIN Interfaces 11.2.0.4.0
Oracle Multimedia Client Option
11.2.0.4.0
Oracle Java Client 11.2.0.4.0
Character Set Migration Utility
11.2.0.4.0
Oracle Code Editor 1.2.1.0.0I
PL/SQL Embedded Gateway 11.2.0.4.0
OLAP SQL Scripts 11.2.0.4.0
Database SQL Scripts 11.2.0.4.0
Oracle Locale Builder 11.2.0.4.0
Oracle Globalization Support 11.2.0.4.0
SQL*Plus Files for Instant Client
11.2.0.4.0
Required Support Files 11.2.0.4.0
Oracle Database User Interface 2.2.13.0.0
Oracle ODBC Driver 11.2.0.4.0
Oracle Notification Service 11.2.0.3.0
XML Parser for Java 11.2.0.4.0
Oracle Security Developer Tools
11.2.0.4.0
Oracle Wallet Manager 11.2.0.4.0
Cluster Verification Utility Common Files
11.2.0.4.0
Oracle Clusterware RDBMS Files 11.2.0.4.0
Oracle UIX 2.2.24.6.0
Enterprise Manager plugin Common Files
11.2.0.4.0
HAS Common Files 11.2.0.4.0
Precompiler Common Files 11.2.0.4.0
Installation Common Files 11.2.0.4.0
Oracle Help for the Web 2.0.14.0.0
Oracle LDAP administration 11.2.0.4.0
Buildtools Common Files 11.2.0.4.0
Assistant Common Files 11.2.0.4.0
Oracle Recovery Manager 11.2.0.4.0
PL/SQL 11.2.0.4.0
Generic Connectivity Common Files
11.2.0.4.0
Oracle Database Gateway for ODBC
11.2.0.4.0
Oracle Programmer 11.2.0.4.0
Oracle Database Utilities 11.2.0.4.0
Enterprise Manager Agent 10.2.0.4.5
SQL*Plus 11.2.0.4.0
Oracle Netca Client 11.2.0.4.0
Oracle Multimedia Locator 11.2.0.4.0
Oracle Call Interface (OCI) 11.2.0.4.0
Oracle Multimedia 11.2.0.4.0
Oracle Net 11.2.0.4.0
Oracle XML Development Kit 11.2.0.4.0
Oracle Internet Directory Client
11.2.0.4.0
Database Configuration and Upgrade
Assistants 11.2.0.4.0
Oracle JVM 11.2.0.4.0
Oracle Advanced Security 11.2.0.4.0
Oracle Net Listener 11.2.0.4.0
Oracle Enterprise Manager Console DB
11.2.0.4.0
HAS Files for DB 11.2.0.4.0
Oracle Text 11.2.0.4.0
Oracle Net Services 11.2.0.4.0
Oracle Database 11g 11.2.0.4.0
Oracle OLAP 11.2.0.4.0
Oracle Spatial 11.2.0.4.0
Oracle Partitioning 11.2.0.4.0
Enterprise Edition Options 11.2.0.4.0
-----------------------------------------------------------------------------
Instantiating scripts
for add node (Wednesday, March 29, 2017 4:21:13 PM IST)
.
1% Done.
Instantiation of add
node scripts complete
Copying to remote
nodes (Wednesday, March 29, 2017 4:21:20 PM IST)
............................................................................................... 96% Done.
Home copied to new
nodes
Saving inventory on
nodes (Wednesday, March 29, 2017 4:33:32 PM IST)
.
100% Done.
Save inventory
complete
WARNING:
The following
configuration scripts need to be executed as the "root" user in each
new cluster node. Each script in the list below is followed by a list of nodes.
/u01/app/oracle/product/11203/db_home/root.sh
#On nodes rac3-pub
To execute the
configuration scripts:
1. Open a terminal window
2. Log in as "root"
3. Run the scripts in each cluster node
The Cluster Node
Addition of /u01/app/oracle/product/11203/db_home was successful.
Please check
'/tmp/silentInstall.log' for more details
[oracle@rac3-pub
db_home]$ cd dbs/
[oracle@rac3-pub
dbs]$ mv initPROD1.ora initPROD3.ora
[oracle@rac3-pub
dbs]$ mv orapwPROD1 orapwPROD3
[oracle@rac3-pub
dbs]$ cat initPROD3.ora
SPFILE='+DATA/PROD/spfilePROD.ora'
[oracle@rac3-pub
dbs]$ cd /u01
[oracle@rac3-pub
u01]$ ls
app database.env
grid.env lost+found oel6_rpms_grid
[oracle@rac3-pub
u01]$ cd app/ora
-bash: cd: app/ora:
No such file or directory
[oracle@rac3-pub
u01]$ cd app/oracle/
[oracle@rac3-pub
oracle]$ ls
cfgtoollogs product
[oracle@rac3-pub
oracle]$ mkdir -p admin/PROD/adump
[oracle@rac3-pub oracle]$
ls
admin cfgtoollogs
product
[oracle@rac3-pub
oracle]$ ll
total 12
drwxr-xr-x 3 oracle oinstall 4096 Mar 29 09:23 admin
drwxr-x--- 3 oracle oinstall 4096 Mar 29 07:24
cfgtoollogs
drwxrwxr-x. 3 oracle
oinstall 4096 Mar 28 19:43 product
[oracle@rac3-pub
oracle]$ mkdir -p admin/PROD/dpdump
[oracle@rac3-pub
oracle]$ ls
admin cfgtoollogs
product
[oracle@rac3-pub
oracle]$ mkdir -p admin/PROD/hdump
[oracle@rac3-pub
oracle]$ mkdir -p admin/PROD/pfile
[oracle@rac3-pub
oracle]$ mkdir diag
[oracle@rac3-pub
oracle]$ ll
total 16
drwxr-xr-x 3 oracle oinstall 4096 Mar 29 09:23 admin
drwxr-x--- 3 oracle oinstall 4096 Mar 29 07:24
cfgtoollogs
drwxr-xr-x 2 oracle oinstall 4096 Mar 29 09:24 diag
drwxrwxr-x. 3 oracle
oinstall 4096 Mar 28 19:43 product
[oracle@rac3-pub
oracle]$ cd /u01
Manual method
[oracle@rac1-pub
u01]$ export ORACLE_SID=PROD1
[oracle@rac1-pub
u01]$ sqlplus "/as sysdba"
SQL*Plus: Release
11.2.0.4.0 Production on Fri Mar 31 13:08:17 2017
Copyright (c) 1982,
2013, Oracle. All rights reserved.
Connected to:
Oracle Database 11g
Enterprise Edition Release 11.2.0.4.0 - 64bit Production
With the
Partitioning, Real Application Clusters, Automatic Storage Management, OLAP,
Data Mining and Real
Application Testing options
SQL> alter database
add logfile thread 3 group 5 ('+FRA','+DATA') size 50M, group 6
('+FRA','+DATA') size 50M;
Database altered.
SQL> alter database enable public thread 3;
Database altered.
SQL> alter system
set undo_tablespace=undotbs3 scope=spfile sid='PROD3';
System altered.
SQL> alter system
set instance_number=3 scope=spfile sid='PROD3';
System altered.
SQL> alter system
set cluster_database_instances=3 scope=spfile sid='*';
System altered.
SQL>
[oracle@rac3-pub u01]$ . database.env
[oracle@rac3-pub u01]$ srvctl add instance -d PROD -i PROD3 -n
rac3-pub [oracle@rac3-pub
u01]$ srvctl status database -d PROD -v
Instance PROD1 is running on node rac1-pub. Instance
status: Open.
Instance PROD2 is running on node rac2-pub. Instance
status: Open.
Instance PROD3 is not running on node rac3-pub
[oracle@rac3-pub u01]$ srvctl config database -d
PROD
Database unique name: PROD
Database name: PROD
Oracle home: /u01/app/oracle/product/11203/db_home
Oracle user: oracle
Spfile: +DATA/PROD/spfilePROD.ora
Domain:
Start options: open
Stop options: immediate
Database role: PRIMARY
Management policy: AUTOMATIC
Server pools: PROD
Database instances: PROD1,PROD2,PROD3
Disk Groups: DATA
Mount point paths:
Services:
Type: RAC
Database is administrator managed
[oracle@rac3-pub u01]$
