Saturday, October 10, 2020

Find and Clear INACTIVE SESSIONS

select 'alter system kill session '||' '||""||s.sid||','||s.serial# ||"' immediate;' FROM v$session s
WHERE s.type!= 'BACKGROUND'
AND S.TYPE='USER'
AND S.USERNAME='<SCHEMA NAME>'
AND TRUNC(S.LOGON_TIME) < '28-JUN-2018'
AND S.STATUS='INACTIVE'
— and last_call_et > 30 — more than 30 mins inactive 

To check INACTIVE sessions with HIGH DISK IO

 select p.spid,s.username, s.sid,s.status,t.disk_reads, s.last_call_et/3600 last_call_et_Hrs,s.action,s.program,s.machine cli_mach,s.process cli_process,lpad(t.sql_text,30) “Last SQL”
from gv$session s, gv$sqlarea t,v$process p
where s.sql_address =t.address and
s.sql_hash_value =t.hash_value and
p.addr=s.paddr and
t.disk_reads > 5000
and s.status=’INACTIVE’
and s.process=’1234′
order by S.PROGRAM;

Query to find out the Disk Group Details in RAC

Very Useful Oracle ASM query for day to day activities for Oracle database administrator

Conn as sqlplus / as sysasm
set lines 255
col path for a35
col Diskgroup for a15
col DiskName for a20
col disk# for 999
col total_mb for 999,999,999
col free_mb for 999,999,999
compute sum of total_mb on DiskGroup
compute sum of free_mb on DiskGroup
break on DiskGroup skip 1 on report
set pages 255
select a.name DiskGroup, b.disk_number Disk#, b.name DiskName, b.os_mb,b.total_mb, b.free_mb, b.path, b.header_status
from v$asm_disk b, v$asm_diskgroup a
where a.group_number (+) =b.group_number
order by b.group_number, b.disk_number, b.name
/

Query to find the session that is generating more Archives

 col program for a10

col username for a10

select to_char(sysdate,’hh24:mi’), username, program , a.sid, a.serial#, b.name, c.value
from v$session a, v$statname b, v$sesstat c

where b.STATISTIC# =c.STATISTIC#
and c.sid=a.sid and b.name like ‘redo%’
order by value;

To check the standby sync status with primary

 SELECT ARCH.THREAD# “Thread”, ARCH.SEQUENCE# “Last Sequence Received”, APPL.SEQUENCE# “Last Sequence Applied”, (ARCH.SEQUENCE# – APPL.SEQUENCE#) “Difference” FROM (SELECT THREAD# ,SEQUENCE# FROM V$ARCHIVED_LOG WHERE (THREAD#,FIRST_TIME ) IN (SELECT THREAD#,MAX(FIRST_TIME) FROM V$ARCHIVED_LOG GROUP BY THREAD#)) ARCH,(SELECT THREAD# ,SEQUENCE# FROM V$LOG_HISTORY WHERE (THREAD#,FIRST_TIME ) IN (SELECT THREAD#,MAX(FIRST_TIME) FROM V$LOG_HISTORY GROUP BY THREAD#)) APPL WHERE ARCH.THREAD# = APPL.THREAD# ORDER BY 1;

ADOP Prepare Phase Fails With Error determining status of Internal Concurrent Manager

 ERROR:-

/R12APPROD/oracle/PROD/fs_ne/EBSapps/log/adop/32/20201009_174221/prepare/validate/remote_execution_result_level1.xml: 
---------------------------------------------------------------------------------------------------------------------
/R12APPROD/oracle/PROD/fs_ne/EBSapps/log/adop/32/20201009_174221/prepare/validate/remote_execution_result_level2.xml: 
---------------------------------------------------------------------------------------------------------------------
/R12APPROD/oracle/PROD/fs_ne/EBSapps/log/adop/32/20201009_174221/prepare/panserver/adop.log: 
------------------------------------------------------------------------------------------
Lines #(206-212):
    [STATEMENT] ICM status cannot be determined.
    [STATEMENT] [END   2020/10/09 17:50:21] Check if ICM is running
    [UNEXPECTED]Error determining status of Internal Concurrent Manager
    [UNEXPECTED]Error calling runConcurrentProgram subroutine.
    [ERROR]     Prepare phase has failed.
    [PROCEDURE] [START 2020/10/09 17:50:22] Updating adop session status
    [STATEMENT] SQL statement : "  update ad_adop_sessions
/R12APPROD/oracle/PROD/fs_ne/EBSapps/log/adop/32/20201009_174221/prepare/panserver1/adop.log: 
------------------------------------------------------------------------------------------
Lines #(149-155):
    Will wait for another minute and retry.
    [UNEXPECTED]Detected a failed session on another node(s): panserver and 
    [UNEXPECTED]This session will fail as no patch edition exists.
    [ERROR]     Prepare phase has failed.
    [PROCEDURE] [START 2020/10/09 17:50:42] Updating adop session status
    [STATEMENT] SQL statement : "  update ad_adop_sessions
/R12APPROD/oracle/PROD/fs_ne/EBSapps/log/adop/32/20201009_174221/prepare/remote_execution_result_level1.xml: 
------------------------------------------------------------------------------------------------------------
Status of remote command on Node panserver1 is failed.
Error string was found in the above file.
Please check the adoplog files created in panserver1 for more details.
Status of remote command on Node panserver1 is failed.
/R12APPROD/oracle/PROD/fs_ne/EBSapps/log/adop/32/20201009_174221/prepare/validate/remote_execution_result_level1.xml: 
---------------------------------------------------------------------------------------------------------------------
/R12APPROD/oracle/PROD/fs_ne/EBSapps/log/adop/32/20201009_174221/prepare/validate/remote_execution_result_level2.xml: 
---------------------------------------------------------------------------------------------------------------------
/R12APPROD/oracle/PROD/fs_ne/EBSapps/log/adop/32/20201009_174221/prepare/panserver/adop.log: 
------------------------------------------------------------------------------------------
Lines #(206-212):
    [STATEMENT] ICM status cannot be determined.
    [STATEMENT] [END   2020/10/09 17:50:21] Check if ICM is running
    [UNEXPECTED]Error determining status of Internal Concurrent Manager
    [UNEXPECTED]Error calling runConcurrentProgram subroutine.
    [ERROR]     Prepare phase has failed.
    [PROCEDURE] [START 2020/10/09 17:50:22] Updating adop session status
    [STATEMENT] SQL statement : "  update ad_adop_sessions
/R12APPROD/oracle/PROD/fs_ne/EBSapps/log/adop/32/20201009_174221/prepare/panserver1/adop.log: 
------------------------------------------------------------------------------------------
Lines #(149-155):
    Will wait for another minute and retry.
    [UNEXPECTED]Detected a failed session on another node(s): panserver and 
    [UNEXPECTED]This session will fail as no patch edition exists.
    [ERROR]     Prepare phase has failed.
    [PROCEDURE] [START 2020/10/09 17:50:42] Updating adop session status
    [STATEMENT] SQL statement : "  update ad_adop_sessions
/R12APPROD/oracle/PROD/fs_ne/EBSapps/log/adop/32/20201009_174221/prepare/remote_execution_result_level1.xml: 
------------------------------------------------------------------------------------------------------------
Status of remote command on Node panserver1 is failed.
Error string was found in the above file.
Please check the adoplog files created in panserver1 for more details.


Status of remote command on Node panserver1 is failed.

Solution:-

In the current directory from where you are running the adop parepare command check if any older DBC file exist, if so remove or move it to some backup folder.
And retry the command.

applprod@panserver:/home/applprod>> mkdir dbc_backup
applprod@panserver:/home/applprod>> mv pansoft_prod.dbc_1202 PROD.dbc dbc_backup
applprod@panserver:/home/applprod>>
applprod@panserver:/home/applprod>> mkdir dbc_backup
applprod@panserver:/home/applprod>> mv pansoft_prod.dbc_1202 PROD.dbc dbc_backup
applprod@panserver:/home/applprod>>

Friday, October 9, 2020

Change Weblogic admin password in Oracle E-Business Suite R12.2.x

Pre-requisite:

R12.AD.C.Delta.7 and R12.TXK.C.Delta.7 or later.

Solution:

Shut down all application tier services except the Admin Server.

 On the primary node, run the command:

$ /adstpall.sh -skipNM -skipAdmin

On all secondary nodes, run the command:

$ /adstpall.sh

perl $FND_TOP/patch/115/bin/txkUpdateEBSDomain.pl -action=updateAdminPassword


[applprod@pandba security]$ perl $FND_TOP/patch/115/bin/txkUpdateEBSDomain.pl -action=updateAdminPassword

AdminServer will be re started after changing WebLogic Admin Password
All Mid Tier services should be SHUTDOWN before changing WebLogic Admin Password
Confirm if all Mid Tier services are in SHUTDOWN state. Enter "Yes" to proceed or anything else to exit: Yes

Enter the full path of Applications Context File [DEFAULT - /u01/oracle/EBSPROD/fs1/inst/apps/EBSPROD_pandba/appl/admin/EBSPROD_pandba.xml]:
Enter the WLS Admin Password:
Enter the new WLS Admin Password:
Enter the APPS user password:

Executing: /u02/oracle/EBSPROD/fs1/FMW_Home/webtier/perl/bin/perl /u02/oracle/EBSPROD/fs1/EBSapps/appl/ad/12.0.0/patch/115/bin/adProvisionEBS.pl ebs-get-serverstatus -contextfile=/u01/oracle/EBSPROD/fs1/inst/apps/EBSPROD_pandba/appl/admin/EBSPROD_pandba.xml -servername=AdminServer -promptmsg=hide -logfile=/u01/oracle/EBSPROD/fs1/inst/apps/EBSPROD_pandba/logs/appl/rgf/TXK/txkUpdateEBSDomain_Mon_OCT_12_23_34_03_2019/EBSProvisioner.log

Updating Weblogic Domain in online mode
---------------------------------------
Backup Location : /u01/oracle/EBSPROD/fs1/inst/apps/EBSPROD_pandba/logs/appl/rgf/TXK/txkUpdateEBSDomain_Mon_OCT_12_23_34_03_2019
Logfile Location: /u01/oracle/EBSPROD/fs1/inst/apps/EBSPROD_pandba/logs/appl/rgf/TXK/txkUpdateEBSDomain_Mon_OCT_12_23_34_03_2019/updateAdminPassword.log

Executing: /u02/oracle/EBSPROD/fs1/EBSapps/comn/util/jdk32/jre/bin/java -classpath :/u02/oracle/EBSPROD/fs1/FMW_Home/wlserver_10.3/server/lib/weblogic.jar:/u02/oracle/EBSPROD/fs1/FMW_Home/Oracle_EBS-app1/oui/jlib/srvm.jar:/u02/oracle/EBSPROD/fs1/EBSapps/comn/java/classes:/u02/oracle/EBSPROD/fs1/EBSapps/comn/shared-libs/ebs-3rdparty/WEB-INF/lib/ebs3rdpartyManifest.jar:/u02/oracle/EBSPROD/fs1/FMW_Home/Oracle_EBS-app1/shared-libs/ebs-appsborg/WEB-INF/lib/ebsAppsborgManifest.jar oracle.apps.ad.util.UpdateEBSDomain updateAdminPassword -contextfile /u01/oracle/EBSPROD/fs1/inst/apps/EBSPROD_pandba/appl/admin/EBSPROD_pandba.xml -promptmsg hide -logdir /u01/oracle/EBSPROD/fs1/inst/apps/EBSPROD_pandba/logs/appl/rgf/TXK/txkUpdateEBSDomain_Mon_OCT_12_23_34_03_2019 -logfile /u01/oracle/EBSPROD/fs1/inst/apps/EBSPROD_pandba/logs/appl/rgf/TXK/txkUpdateEBSDomain_Mon_OCT_12_23_34_03_2019/updateAdminPassword.log
 
Domain updated successfully
Restarting AdminServer with new Admin Password.
 
You are running adadminsrvctl.sh version 120.10.12020000.10
 
Stopping WLS Admin Server...
Refer /u01/oracle/EBSPROD/fs1/inst/apps/EBSPROD_pandba/logs/appl/admin/log/adadminsrvctl.txt for details
 
AdminServer logs are located at /u02/oracle/EBSPROD/fs1/FMW_Home/user_projects/domains/EBS_domain_EBSPROD/servers/AdminServer/logs
 
adadminsrvctl.sh: exiting with status 0
 
adadminsrvctl.sh: check the logfile /u01/oracle/EBSPROD/fs1/inst/apps/EBSPROD_pandba/logs/appl/admin/log/adadminsrvctl.txt for more information ...

 
You are running adnodemgrctl.sh version 120.11.12020000.12

 
NodeManager log is located at /u02/oracle/EBSPROD/fs1/FMW_Home/wlserver_10.3/common/nodemanager/nmHome1
 
adnodemgrctl.sh: exiting with status 0
 
adnodemgrctl.sh: check the logfile /u01/oracle/EBSPROD/fs1/inst/apps/EBSPROD_pandba/logs/appl/admin/log/adnodemgrctl.txt for more information ...
 
 
You are running adadminsrvctl.sh version 120.10.12020000.10
 
Starting WLS Admin Server...
Refer /u01/oracle/EBSPROD/fs1/inst/apps/EBSPROD_pandba/logs/appl/admin/log/adadminsrvctl.txt for details
 
AdminServer logs are located at /u02/oracle/EBSPROD/fs1/FMW_Home/user_projects/domains/EBS_domain_EBSPROD/servers/AdminServer/logs
 
adadminsrvctl.sh: exiting with status 0
 
adadminsrvctl.sh: check the logfile /u01/oracle/EBSPROD/fs1/inst/apps/EBSPROD_pandba/logs/appl/admin/log/adadminsrvctl.txt for more information ...
 
 
*************** IMPORTANT ****************
WebLogic Admin Password is changed.
Restart all application tier services using control scripts.
********************************************


Start all the application services using adstrtal.sh script.
 
Try to login to the Weblogic Console using the new weblogic admin password.

Sunday, October 4, 2020

How to add space in existing disk group ASM


[root@pansoftrules.d]# rescan-scsi-bus.sh -s

 Scanning SCSI subsystem for new devices
Searching for resized LUNs
0 new or changed device(s) found.
0 remapped or resized device(s) found.
0 device(s) removed.
[root@pansoftrules.d]# multipath -ll
crs4 (360002ac00000000009002625000157e7) dm-6 3PARdata,VV
size=10G features='1 queue_if_no_path' hwhandler='1 alua' wp=rw
`-+- policy='round-robin 0' prio=50 status=active
  |- 2:0:0:6 sdi               8:128  active ready running
  |- 3:0:0:6 sdaa              65:160 active ready running
  |- 2:0:1:6 sdr               65:16  active ready running
  `- 3:0:1:6 sdaj              66:48  active ready running
crs3 (360002ac00000000009002626000157e7) dm-9 3PARdata,VV
size=10G features='1 queue_if_no_path' hwhandler='1 alua' wp=rw
`-+- policy='round-robin 0' prio=50 status=active
  |- 2:0:0:7 sdj               8:144  active ready running
  |- 3:0:0:7 sdab              65:176 active ready running
  |- 2:0:1:7 sds               65:32  active ready running
  `- 3:0:1:7 sdak              66:64  active ready running
crs2 (360002ac00000000009002627000157e7) dm-8 3PARdata,VV
size=10G features='1 queue_if_no_path' hwhandler='1 alua' wp=rw
`-+- policy='round-robin 0' prio=50 status=active
  |- 2:0:0:8 sdk               8:160  active ready running
  |- 3:0:0:8 sdac              65:192 active ready running
  |- 2:0:1:8 sdt               65:48  active ready running
  `- 3:0:1:8 sdal              66:80  active ready running
crs1 (360002ac00000000009002622000157e7) dm-3 3PARdata,VV
size=10G features='1 queue_if_no_path' hwhandler='1 alua' wp=rw
`-+- policy='round-robin 0' prio=50 status=active
  |- 2:0:0:2 sde               8:64   active ready running
  |- 3:0:0:2 sdw               65:96  active ready running
  |- 2:0:1:2 sdn               8:208  active ready running
  `- 3:0:1:2 sdaf              65:240 active ready running
mpathk (360002ac0000000000900d2cf000157e7) dm-5 3PARdata,VV
size=300G features='1 queue_if_no_path' hwhandler='1 alua' wp=rw
`-+- policy='round-robin 0' prio=50 status=active
  |- 2:0:1:3 sdo               8:224  active ready running
  |- 3:0:0:3 sdx               65:112 active ready running
  |- 2:0:0:3 sdf               8:80   active ready running
  `- 3:0:1:3 sdag              66:0   active ready running
fra (360002ac000000000090025b3000157e7) dm-4 3PARdata,VV
size=300G features='1 queue_if_no_path' hwhandler='1 alua' wp=rw
`-+- policy='round-robin 0' prio=50 status=active
  |- 2:0:0:1 sdd               8:48   active ready running
  |- 3:0:0:1 sdv               65:80  active ready running
  |- 2:0:1:1 sdm               8:192  active ready running
  `- 3:0:1:1 sdae              65:224 active ready running
data (360002ac000000000090025b2000157e7) dm-2 3PARdata,VV
size=900G features='1 queue_if_no_path' hwhandler='1 alua' wp=rw
`-+- policy='round-robin 0' prio=50 status=active
  |- 2:0:0:0 sdc               8:32   active ready running
  |- 3:0:0:0 sdu               65:64  active ready running
  |- 2:0:1:0 sdl               8:176  active ready running
  `- 3:0:1:0 sdad              65:208 active ready running
crs5 (360002ac00000000009002623000157e7) dm-7 3PARdata,VV
size=10G features='1 queue_if_no_path' hwhandler='1 alua' wp=rw
`-+- policy='round-robin 0' prio=50 status=active
  |- 2:0:0:4 sdg               8:96   active ready running
  |- 3:0:0:4 sdy               65:128 active ready running
  |- 2:0:1:4 sdp               8:240  active ready running
  `- 3:0:1:4 sdah              66:16  active ready running
mpathf (360002ac00000000009002624000157e7) dm-10 3PARdata,VV
size=10G features='1 queue_if_no_path' hwhandler='1 alua' wp=rw
`-+- policy='round-robin 0' prio=50 status=active
  |- 2:0:0:5 sdh               8:112  active ready running
  |- 3:0:0:5 sdz               65:144 active ready running
  |- 2:0:1:5 sdq               65:0   active ready running
  `- 3:0:1:5 sdai              66:32  active ready running

[root@pansoftrules.d]# systemctl status multipathd

 multipathd.service - Device-Mapper Multipath Device Controller
   Loaded: loaded (/usr/lib/systemd/system/multipathd.service; enabled; vendor preset: enabled)
   Active: active (running) since Sun 2020-01-12 13:26:23 +03; 3 months 6 days ago
  Process: 6287 ExecStart=/sbin/multipathd (code=exited, status=0/SUCCESS)
  Process: 6230 ExecStartPre=/sbin/multipath -A (code=exited, status=0/SUCCESS)
  Process: 6183 ExecStartPre=/sbin/modprobe dm-multipath (code=exited, status=0/SUCCESS)
 Main PID: 6353 (multipathd)
   CGroup: /system.slice/multipathd.service
Jan 12 13:27:16 pansoft.dba.com multipathd[6353]: ofsctl: add path (uevent)
Jan 12 13:27:16 pansoft.dba.com multipathd[6353]: ofsctl: spurious uevent, path already in pathvec
Jan 12 13:27:16 pansoft.dba.com multipathd[6353]: ofsctl: HDIO_GETGEO failed with 25
Jan 12 13:27:16 pansoft.dba.com multipathd[6353]: ofsctl: failed to get path uid
Jan 12 13:27:16 pansoft.dba.com multipathd[6353]: uevent trigger error
Jan 12 13:27:26 pansoft.dba.com multipathd[6353]: ofsctl: add path (uevent)
Jan 12 13:27:26 pansoft.dba.com multipathd[6353]: ofsctl: spurious uevent, path already in pathvec
Jan 12 13:27:26 pansoft.dba.com multipathd[6353]: ofsctl: HDIO_GETGEO failed with 25
Jan 12 13:27:26 pansoft.dba.com multipathd[6353]: ofsctl: failed to get path uid
Jan 12 13:27:26 pansoft.dba.com multipathd[6353]: uevent trigger error
[root@pansoftrules.d]# systemctl restart multipathd
[root@pansoftrules.d]# systemctl status multipathd
multipathd.service - Device-Mapper Multipath Device Controller
   Loaded: loaded (/usr/lib/systemd/system/multipathd.service; enabled; vendor preset: enabled)
   Active: active (running) since Sun 2020-04-19 12:06:59 +03; 2s ago
  Process: 4134 ExecStart=/sbin/multipathd (code=exited, status=0/SUCCESS)
  Process: 4131 ExecStartPre=/sbin/multipath -A (code=exited, status=0/SUCCESS)
  Process: 4129 ExecStartPre=/sbin/modprobe dm-multipath (code=exited, status=0/SUCCESS)
 Main PID: 4137 (multipathd)
   CGroup: /system.slice/multipathd.service
           


Apr 19 12:07:00 pansoft.dba.com multipathd[4137]: data: event checker started
Apr 19 12:07:00 pansoft.dba.com multipathd[4137]: fra: event checker started
Apr 19 12:07:00 pansoft.dba.com multipathd[4137]: crs1: event checker started
Apr 19 12:07:00 pansoft.dba.com multipathd[4137]: mpathk: event checker started
Apr 19 12:07:00 pansoft.dba.com multipathd[4137]: crs5: event checker started
Apr 19 12:07:00 pansoft.dba.com multipathd[4137]: mpathf: event checker started
Apr 19 12:07:00 pansoft.dba.com multipathd[4137]: crs4: event checker started
Apr 19 12:07:00 pansoft.dba.com multipathd[4137]: crs3: event checker started
Apr 19 12:07:00 pansoft.dba.com multipathd[4137]: crs2: event checker started
Apr 19 12:07:00 pansoft.dba.com multipathd[4137]: path checkers start up
[root@pansoftrules.d]#

[root@pansoftrules.d]# multipath -ll

crs4 (360002ac00000000009002625000157e7) dm-6 3PARdata,VV
size=10G features='1 queue_if_no_path' hwhandler='1 alua' wp=rw
`-+- policy='round-robin 0' prio=50 status=active
  |- 2:0:0:6 sdi               8:128  active ready running
  |- 3:0:0:6 sdaa              65:160 active ready running
  |- 2:0:1:6 sdr               65:16  active ready running
  `- 3:0:1:6 sdaj              66:48  active ready running
crs3 (360002ac00000000009002626000157e7) dm-9 3PARdata,VV
size=10G features='1 queue_if_no_path' hwhandler='1 alua' wp=rw
`-+- policy='round-robin 0' prio=50 status=active
  |- 2:0:0:7 sdj               8:144  active ready running
  |- 3:0:0:7 sdab              65:176 active ready running
  |- 2:0:1:7 sds               65:32  active ready running
  `- 3:0:1:7 sdak              66:64  active ready running
crs2 (360002ac00000000009002627000157e7) dm-8 3PARdata,VV
size=10G features='1 queue_if_no_path' hwhandler='1 alua' wp=rw
`-+- policy='round-robin 0' prio=50 status=active
  |- 2:0:0:8 sdk               8:160  active ready running
  |- 3:0:0:8 sdac              65:192 active ready running
  |- 2:0:1:8 sdt               65:48  active ready running
  `- 3:0:1:8 sdal              66:80  active ready running
crs1 (360002ac00000000009002622000157e7) dm-3 3PARdata,VV
size=10G features='1 queue_if_no_path' hwhandler='1 alua' wp=rw
`-+- policy='round-robin 0' prio=50 status=active
  |- 2:0:0:2 sde               8:64   active ready running
  |- 3:0:0:2 sdw               65:96  active ready running
  |- 2:0:1:2 sdn               8:208  active ready running
  `- 3:0:1:2 sdaf              65:240 active ready running
mpathk (360002ac0000000000900d2cf000157e7) dm-5 3PARdata,VV
size=300G features='1 queue_if_no_path' hwhandler='1 alua' wp=rw
`-+- policy='round-robin 0' prio=50 status=active
  |- 2:0:1:3 sdo               8:224  active ready running
  |- 3:0:0:3 sdx               65:112 active ready running
  |- 2:0:0:3 sdf               8:80   active ready running
  `- 3:0:1:3 sdag              66:0   active ready running
fra (360002ac000000000090025b3000157e7) dm-4 3PARdata,VV
size=300G features='1 queue_if_no_path' hwhandler='1 alua' wp=rw
`-+- policy='round-robin 0' prio=50 status=active
  |- 2:0:0:1 sdd               8:48   active ready running
  |- 3:0:0:1 sdv               65:80  active ready running
  |- 2:0:1:1 sdm               8:192  active ready running
  `- 3:0:1:1 sdae              65:224 active ready running
data (360002ac000000000090025b2000157e7) dm-2 3PARdata,VV
size=900G features='1 queue_if_no_path' hwhandler='1 alua' wp=rw
`-+- policy='round-robin 0' prio=50 status=active
  |- 2:0:0:0 sdc               8:32   active ready running
  |- 3:0:0:0 sdu               65:64  active ready running
  |- 2:0:1:0 sdl               8:176  active ready running
  `- 3:0:1:0 sdad              65:208 active ready running
crs5 (360002ac00000000009002623000157e7) dm-7 3PARdata,VV
size=10G features='1 queue_if_no_path' hwhandler='1 alua' wp=rw
`-+- policy='round-robin 0' prio=50 status=active
  |- 2:0:0:4 sdg               8:96   active ready running
  |- 3:0:0:4 sdy               65:128 active ready running
  |- 2:0:1:4 sdp               8:240  active ready running
  `- 3:0:1:4 sdah              66:16  active ready running
mpathf (360002ac00000000009002624000157e7) dm-10 3PARdata,VV
size=10G features='1 queue_if_no_path' hwhandler='1 alua' wp=rw
`-+- policy='round-robin 0' prio=50 status=active
  |- 2:0:0:5 sdh               8:112  active ready running
  |- 3:0:0:5 sdz               65:144 active ready running
  |- 2:0:1:5 sdq               65:0   active ready running
  `- 3:0:1:5 sdai              66:32  active ready running

[root@pansoftrules.d]# multipathd resize fra

multipath-tools v0.4.9 (05/33, 2016)
CLI commands reference:
 list|show paths
 list|show paths format $format
 list|show paths raw format $format
 list|show status
 list|show daemon
 list|show maps|multipaths
 list|show maps|multipaths status
 list|show maps|multipaths stats
 list|show maps|multipaths format $format
 list|show maps|multipaths raw format $format
 list|show maps|multipaths topology
 list|show maps|multipaths json
 list|show topology
 list|show map|multipath $map topology
 list|show map|multipath $map json
 list|show config
 list|show blacklist
 list|show devices
 list|show wildcards
 reset maps|multipaths stats
 reset map|multipath $map stats
 add path $path
 remove|del path $path
 add map|multipath $map
 remove|del map|multipath $map
 switch|switchgroup map|multipath $map group $group
 reconfigure
 suspend map|multipath $map
 resume map|multipath $map
 resize map|multipath $map
 reset map|multipath $map
 reload map|multipath $map
 disablequeueing map|multipath $map
 restorequeueing map|multipath $map
 disablequeueing maps|multipaths
 restorequeueing maps|multipaths
 reinstate path $path
 fail path $path
 quit|exit
 shutdown
 map|multipath $map getprstatus
 map|multipath $map setprstatus
 map|multipath $map unsetprstatus
 map|multipath $map getprkey
 map|multipath $map setprkey key $key
 map|multipath $map unsetprkey
 forcequeueing daemon
 restorequeueing daemon

[root@pansoftrules.d]# multipath -ll

crs4 (360002ac00000000009002625000157e7) dm-6 3PARdata,VV
size=10G features='1 queue_if_no_path' hwhandler='1 alua' wp=rw
`-+- policy='round-robin 0' prio=50 status=active
  |- 2:0:0:6 sdi               8:128  active ready running
  |- 3:0:0:6 sdaa              65:160 active ready running
  |- 2:0:1:6 sdr               65:16  active ready running
  `- 3:0:1:6 sdaj              66:48  active ready running
crs3 (360002ac00000000009002626000157e7) dm-9 3PARdata,VV
size=10G features='1 queue_if_no_path' hwhandler='1 alua' wp=rw
`-+- policy='round-robin 0' prio=50 status=active
  |- 2:0:0:7 sdj               8:144  active ready running
  |- 3:0:0:7 sdab              65:176 active ready running
  |- 2:0:1:7 sds               65:32  active ready running
  `- 3:0:1:7 sdak              66:64  active ready running
crs2 (360002ac00000000009002627000157e7) dm-8 3PARdata,VV
size=10G features='1 queue_if_no_path' hwhandler='1 alua' wp=rw
`-+- policy='round-robin 0' prio=50 status=active
  |- 2:0:0:8 sdk               8:160  active ready running
  |- 3:0:0:8 sdac              65:192 active ready running
  |- 2:0:1:8 sdt               65:48  active ready running
  `- 3:0:1:8 sdal              66:80  active ready running
crs1 (360002ac00000000009002622000157e7) dm-3 3PARdata,VV
size=10G features='1 queue_if_no_path' hwhandler='1 alua' wp=rw
`-+- policy='round-robin 0' prio=50 status=active
  |- 2:0:0:2 sde               8:64   active ready running
  |- 3:0:0:2 sdw               65:96  active ready running
  |- 2:0:1:2 sdn               8:208  active ready running
  `- 3:0:1:2 sdaf              65:240 active ready running
mpathk (360002ac0000000000900d2cf000157e7) dm-5 3PARdata,VV
size=300G features='1 queue_if_no_path' hwhandler='1 alua' wp=rw
`-+- policy='round-robin 0' prio=50 status=active
  |- 2:0:1:3 sdo               8:224  active ready running
  |- 3:0:0:3 sdx               65:112 active ready running
  |- 2:0:0:3 sdf               8:80   active ready running
  `- 3:0:1:3 sdag              66:0   active ready running
fra (360002ac000000000090025b3000157e7) dm-4 3PARdata,VV
size=300G features='1 queue_if_no_path' hwhandler='1 alua' wp=rw
`-+- policy='round-robin 0' prio=50 status=active
  |- 2:0:0:1 sdd               8:48   active ready running
  |- 3:0:0:1 sdv               65:80  active ready running
  |- 2:0:1:1 sdm               8:192  active ready running
  `- 3:0:1:1 sdae              65:224 active ready running
data (360002ac000000000090025b2000157e7) dm-2 3PARdata,VV
size=900G features='1 queue_if_no_path' hwhandler='1 alua' wp=rw
`-+- policy='round-robin 0' prio=50 status=active
  |- 2:0:0:0 sdc               8:32   active ready running
  |- 3:0:0:0 sdu               65:64  active ready running
  |- 2:0:1:0 sdl               8:176  active ready running
  `- 3:0:1:0 sdad              65:208 active ready running
crs5 (360002ac00000000009002623000157e7) dm-7 3PARdata,VV
size=10G features='1 queue_if_no_path' hwhandler='1 alua' wp=rw
`-+- policy='round-robin 0' prio=50 status=active
  |- 2:0:0:4 sdg               8:96   active ready running
  |- 3:0:0:4 sdy               65:128 active ready running
  |- 2:0:1:4 sdp               8:240  active ready running
  `- 3:0:1:4 sdah              66:16  active ready running
mpathf (360002ac00000000009002624000157e7) dm-10 3PARdata,VV
size=10G features='1 queue_if_no_path' hwhandler='1 alua' wp=rw
`-+- policy='round-robin 0' prio=50 status=active
  |- 2:0:0:5 sdh               8:112  active ready running
  |- 3:0:0:5 sdz               65:144 active ready running
  |- 2:0:1:5 sdq               65:0   active ready running
  `- 3:0:1:5 sdai              66:32  active ready running

[oragrid@pansoft~]$ . grid.env
[oragrid@pansoft~]$ asmca
[oragrid@pansoft~]$ asmca
[oragrid@pansoft~]$ sqlplus / as sysasm
SQL*Plus: Release 12.1.0.2.0 Production on Sun Apr 19 11:53:07 2020
Copyright (c) 1982, 2014, Oracle.  All rights reserved.
Connected to:
Oracle Database 12c Enterprise Edition Release 12.1.0.2.0 - 64bit Production
With the Real Application Clusters and Automatic Storage Management options
SQL> desc v$asm_diskgroup;
 Name                                      Null?    Type
 ----------------------------------------- -------- ----------------------------
 GROUP_NUMBER                                       NUMBER
 NAME                                               VARCHAR2(30)
 SECTOR_SIZE                                        NUMBER
 BLOCK_SIZE                                         NUMBER
 ALLOCATION_UNIT_SIZE                               NUMBER
 STATE                                              VARCHAR2(11)
 TYPE                                               VARCHAR2(6)
 TOTAL_MB                                           NUMBER
 FREE_MB                                            NUMBER
 HOT_USED_MB                                        NUMBER
 COLD_USED_MB                                       NUMBER
 REQUIRED_MIRROR_FREE_MB                            NUMBER
 USABLE_FILE_MB                                     NUMBER
 OFFLINE_DISKS                                      NUMBER
 COMPATIBILITY                                      VARCHAR2(60)
 DATABASE_COMPATIBILITY                             VARCHAR2(60)
 VOTING_FILES                                       VARCHAR2(1)
 CON_ID                                             NUMBER
SQL> select name, total_mb/1024 "Total GiB" from v$asm_diskgroup;
NAME                            Total GiB
------------------------------ ----------
FRA                                   250
DATA                                  900
CRS                                    50
SQL> alter diskgroup FRA resize all;
Diskgroup altered.
NAME                            Total GiB
------------------------------ ----------
FRA                                   300
DATA                                  900
CRS                                    50
SQL>


SQL>  select name, total_mb/1024 "Total GiB" from v$asm_diskgroup;

Add new disks to ASM DISKSPACE PROD

 ASMCMD>

ASMCMD> lsdsk -t -g FRA

ASMCMD> lsdsk -t -G FRA

Create_Date  Mount_Date  Repair_Timer  Path

10-JAN-19    26-FEB-20   0             /dev/dm-8

09-MAR-17    26-FEB-20   0             /dev/dm-9

ASMCMD> lsdsk -t -G FRA

Create_Date  Mount_Date  Repair_Timer  Path

10-JAN-19    26-FEB-20   0             /dev/dm-8

09-MAR-17    26-FEB-20   0             /dev/dm-9

ASMCMD> lsdsk -t -G DATA

Create_Date  Mount_Date  Repair_Timer  Path

02-MAR-19    26-FEB-20   0             /dev/dm-10

25-SEP-19    26-FEB-20   0             /dev/dm-12

09-MAR-17    26-FEB-20   0             /dev/dm-5

16-SEP-18    26-FEB-20   0             /dev/dm-6

09-MAR-17    26-FEB-20   0             /dev/dm-7

ASMCMD>


Add below lines in 20asm-devices.rules


KERNEL=="dm-*", PROGRAM="scsi_id --page=0x83 --whitelisted --device=/dev/%k",RESULT=="360002ac0000000000b007ba3000157e7",Name="FRA9", OWNER:="oraprod", GROUP:="oinstall"

KERNEL=="dm-*", PROGRAM="scsi_id --page=0x83 --whitelisted --device=/dev/%k",RESULT=="360002ac0000000000b007ba1000157e7",Name="DATA9", OWNER:="oraprod", GROUP:="oinstall"


Final contents of 20asm-devices.rules 

Make sure 20asm-devices.rules file backup is taken before modifying.


After modifying asm rules file complete below steps:
=======================================================


/sbin/udevadm control --reload-rules
/sbin/udevadm trigger --type=devices --action=change
ll /dev/dm-*

pract:
======
-bash-4.1#
-bash-4.1# /sbin/udevadm control --reload-rules
-bash-4.1# ll /dev/dm-*
brw-rw----. 1 root    disk     253,  0 Feb 26 17:24 /dev/dm-0
brw-rw----. 1 root    disk     253,  1 Feb 26 17:24 /dev/dm-1
brw-rw----. 1 oraprod oinstall 253, 10 Apr 19 15:09 /dev/dm-10
brw-rw----. 1 root    disk     253, 11 Feb 26 17:26 /dev/dm-11
brw-rw----. 1 oraprod oinstall 253, 12 Apr 19 15:09 /dev/dm-12
brw-rw----. 1 root    disk     253, 13 Feb 26 17:26 /dev/dm-13
brw-rw----. 1 root    disk     253, 14 Feb 26 17:26 /dev/dm-14
brw-rw----. 1 root    disk     253, 15 Feb 26 17:25 /dev/dm-15
brw-rw----. 1 root    disk     253, 16 Feb 26 17:24 /dev/dm-16
brw-rw----. 1 root    disk     253, 17 Feb 26 17:24 /dev/dm-17
brw-rw----. 1 root    disk     253, 18 Feb 26 17:24 /dev/dm-18
brw-rw----. 1 root    disk     253, 19 Feb 26 17:24 /dev/dm-19
brw-rw----. 1 oragrid oinstall 253,  2 Apr 19 15:09 /dev/dm-2
brw-rw----. 1 root    disk     253, 20 Feb 26 17:24 /dev/dm-20
brw-rw----. 1 root    disk     253, 21 Feb 26 17:24 /dev/dm-21
brw-rw----. 1 root    disk     253, 22 Feb 26 17:24 /dev/dm-22
brw-rw----. 1 root    disk     253, 23 Apr 19 13:46 /dev/dm-23
brw-rw----. 1 root    disk     253, 24 Apr 19 13:46 /dev/dm-24
brw-rw----. 1 oragrid oinstall 253,  3 Apr 19 14:01 /dev/dm-3
brw-rw----. 1 oragrid oinstall 253,  4 Apr 19 14:01 /dev/dm-4
brw-rw----. 1 oragrid oinstall 253,  5 Apr 19 15:09 /dev/dm-5
brw-rw----. 1 oragrid oinstall 253,  6 Apr 19 15:09 /dev/dm-6
brw-rw----. 1 oragrid oinstall 253,  7 Apr 19 15:09 /dev/dm-7
brw-rw----. 1 oraprod oinstall 253,  8 Apr 19 15:09 /dev/dm-8
brw-rw----. 1 oragrid oinstall 253,  9 Apr 19 15:09 /dev/dm-9
-bash-4.1# /sbin/udevadm trigger --type=devices --action=change
-bash-4.1# ll /dev/dm-*
brw-rw----. 1 root    disk     253,  0 Apr 19 15:10 /dev/dm-0
brw-rw----. 1 root    disk     253,  1 Apr 19 15:10 /dev/dm-1
brw-rw----. 1 oraprod oinstall 253, 10 Apr 19 15:10 /dev/dm-10
brw-rw----. 1 root    disk     253, 11 Apr 19 15:10 /dev/dm-11
brw-rw----. 1 oraprod oinstall 253, 12 Apr 19 15:10 /dev/dm-12
brw-rw----. 1 root    disk     253, 13 Apr 19 15:10 /dev/dm-13
brw-rw----. 1 root    disk     253, 14 Apr 19 15:10 /dev/dm-14
brw-rw----. 1 root    disk     253, 15 Apr 19 15:10 /dev/dm-15
brw-rw----. 1 root    disk     253, 16 Apr 19 15:10 /dev/dm-16
brw-rw----. 1 root    disk     253, 17 Apr 19 15:10 /dev/dm-17
brw-rw----. 1 root    disk     253, 18 Apr 19 15:10 /dev/dm-18
brw-rw----. 1 root    disk     253, 19 Apr 19 15:10 /dev/dm-19
brw-rw----. 1 oragrid oinstall 253,  2 Apr 19 15:10 /dev/dm-2
brw-rw----. 1 root    disk     253, 20 Apr 19 15:10 /dev/dm-20
brw-rw----. 1 root    disk     253, 21 Apr 19 15:10 /dev/dm-21
brw-rw----. 1 root    disk     253, 22 Apr 19 15:10 /dev/dm-22
brw-rw----. 1 oraprod oinstall 253, 23 Apr 19 15:10 /dev/dm-23
brw-rw----. 1 oraprod oinstall 253, 24 Apr 19 15:10 /dev/dm-24
brw-rw----. 1 oragrid oinstall 253,  3 Apr 19 15:10 /dev/dm-3
brw-rw----. 1 oragrid oinstall 253,  4 Apr 19 15:10 /dev/dm-4
brw-rw----. 1 oragrid oinstall 253,  5 Apr 19 15:10 /dev/dm-5
brw-rw----. 1 oragrid oinstall 253,  6 Apr 19 15:10 /dev/dm-6
brw-rw----. 1 oragrid oinstall 253,  7 Apr 19 15:10 /dev/dm-7
brw-rw----. 1 oraprod oinstall 253,  8 Apr 19 15:10 /dev/dm-8
brw-rw----. 1 oragrid oinstall 253,  9 Apr 19 15:10 /dev/dm-9
-bash-4.1# pwd



oragrid@pansoft ~]$ sqlplus / as sysasm

SQL*Plus: Release 11.2.0.4.0 Production on Sun Apr 19 15:26:45 2020

Copyright (c) 1982, 2013, Oracle.  All rights reserved.


Connected to:
Oracle Database 11g Enterprise Edition Release 11.2.0.4.0 - 64bit Production
With the Real Application Clusters and Automatic Storage Management options

SQL>  select state, name, type from v$asm_diskgroup;

STATE       NAME                           TYPE
----------- ------------------------------ ------
MOUNTED     CRS                            EXTERN
MOUNTED     DATA                           EXTERN
MOUNTED     FRA                            EXTERN

SQL> exit
Disconnected from Oracle Database 11g Enterprise Edition Release 11.2.0.4.0 - 64bit Production
With the Real Application Clusters and Automatic Storage Management options
[oragrid@pansoft ~]$ asmcmd
ASMCMD> lsdg
State    Type    Rebal  Sector  Block       AU  Total_MB  Free_MB  Req_mir_free_MB  Usable_file_MB  Offline_disks  Voting_files  Name
MOUNTED  EXTERN  N         512   4096  1048576      3072     2672                0            2672              0             Y  CRS/
MOUNTED  EXTERN  N         512   4096  1048576   1536000   290164                0          290164              0             N  DATA/
MOUNTED  EXTERN  N         512   4096  1048576    358400   331470                0          331470              0             N  FRA/
ASMCMD> exit
[oragrid@pansoft ~]$ sqlplus / as sysasm

SQL*Plus: Release 11.2.0.4.0 Production on Sun Apr 19 15:28:27 2020

Copyright (c) 1982, 2013, Oracle.  All rights reserved.


Connected to:
Oracle Database 11g Enterprise Edition Release 11.2.0.4.0 - 64bit Production
With the Real Application Clusters and Automatic Storage Management options

SQL> select GROUP_NUMBER,MOUNT_STATUS,STATE,REDUNDANCY,NAME,PATH from v$asm_disk;

GROUP_NUMBER MOUNT_S STATE    REDUNDA NAME
------------ ------- -------- ------- ------------------------------
PATH
--------------------------------------------------------------------------------
           0 CLOSED  NORMAL   UNKNOWN
/dev/dm-24

           0 CLOSED  NORMAL   UNKNOWN
/dev/dm-23

           2 CACHED  NORMAL   UNKNOWN DATA_0004
/dev/dm-12


GROUP_NUMBER MOUNT_S STATE    REDUNDA NAME
------------ ------- -------- ------- ------------------------------
PATH
--------------------------------------------------------------------------------
           2 CACHED  NORMAL   UNKNOWN DATA_0003
/dev/dm-10

           3 CACHED  NORMAL   UNKNOWN FRA_0000
/dev/dm-9

           3 CACHED  NORMAL   UNKNOWN FRA_0001
/dev/dm-8


GROUP_NUMBER MOUNT_S STATE    REDUNDA NAME
------------ ------- -------- ------- ------------------------------
PATH
--------------------------------------------------------------------------------
           2 CACHED  NORMAL   UNKNOWN DATA_0001
/dev/dm-7

           2 CACHED  NORMAL   UNKNOWN DATA_0002
/dev/dm-6

           2 CACHED  NORMAL   UNKNOWN DATA_0000
/dev/dm-5


GROUP_NUMBER MOUNT_S STATE    REDUNDA NAME
------------ ------- -------- ------- ------------------------------
PATH
--------------------------------------------------------------------------------
           1 CACHED  NORMAL   UNKNOWN CRS_0002
/dev/dm-4

           1 CACHED  NORMAL   UNKNOWN CRS_0001
/dev/dm-3

           1 CACHED  NORMAL   UNKNOWN CRS_0000
/dev/dm-2


12 rows selected.

SQL> Alter diskgroup FRA add disk '/dev/dm-24' NAME FRA9;

Diskgroup altered.

SQL> select GROUP_NUMBER,MOUNT_STATUS,STATE,REDUNDANCY,NAME,PATH from v$asm_disk;

GROUP_NUMBER MOUNT_S STATE    REDUNDA NAME
------------ ------- -------- ------- ------------------------------
PATH
--------------------------------------------------------------------------------
           0 CLOSED  NORMAL   UNKNOWN
/dev/dm-23

           2 CACHED  NORMAL   UNKNOWN DATA_0004
/dev/dm-12

           2 CACHED  NORMAL   UNKNOWN DATA_0003
/dev/dm-10


GROUP_NUMBER MOUNT_S STATE    REDUNDA NAME
------------ ------- -------- ------- ------------------------------
PATH
--------------------------------------------------------------------------------
           3 CACHED  NORMAL   UNKNOWN FRA_0000
/dev/dm-9

           3 CACHED  NORMAL   UNKNOWN FRA_0001
/dev/dm-8

           2 CACHED  NORMAL   UNKNOWN DATA_0001
/dev/dm-7


GROUP_NUMBER MOUNT_S STATE    REDUNDA NAME
------------ ------- -------- ------- ------------------------------
PATH
--------------------------------------------------------------------------------
           2 CACHED  NORMAL   UNKNOWN DATA_0002
/dev/dm-6

           2 CACHED  NORMAL   UNKNOWN DATA_0000
/dev/dm-5

           1 CACHED  NORMAL   UNKNOWN CRS_0002
/dev/dm-4


GROUP_NUMBER MOUNT_S STATE    REDUNDA NAME
------------ ------- -------- ------- ------------------------------
PATH
--------------------------------------------------------------------------------
           1 CACHED  NORMAL   UNKNOWN CRS_0001
/dev/dm-3

           1 CACHED  NORMAL   UNKNOWN CRS_0000
/dev/dm-2

           3 CACHED  NORMAL   UNKNOWN FRA9
/dev/dm-24


12 rows selected.

SQL> Alter diskgroup DATA add disk '/dev/dm-23' NAME DATA9;

Diskgroup altered.

SQL> select GROUP_NUMBER,MOUNT_STATUS,STATE,REDUNDANCY,NAME,PATH from v$asm_disk;

GROUP_NUMBER MOUNT_S STATE    REDUNDA NAME
------------ ------- -------- ------- ------------------------------
PATH
--------------------------------------------------------------------------------
           2 CACHED  NORMAL   UNKNOWN DATA_0004
/dev/dm-12

           2 CACHED  NORMAL   UNKNOWN DATA_0003
/dev/dm-10

           3 CACHED  NORMAL   UNKNOWN FRA_0000
/dev/dm-9


GROUP_NUMBER MOUNT_S STATE    REDUNDA NAME
------------ ------- -------- ------- ------------------------------
PATH
--------------------------------------------------------------------------------
           3 CACHED  NORMAL   UNKNOWN FRA_0001
/dev/dm-8

           2 CACHED  NORMAL   UNKNOWN DATA_0001
/dev/dm-7

           2 CACHED  NORMAL   UNKNOWN DATA_0002
/dev/dm-6


GROUP_NUMBER MOUNT_S STATE    REDUNDA NAME
------------ ------- -------- ------- ------------------------------
PATH
--------------------------------------------------------------------------------
           2 CACHED  NORMAL   UNKNOWN DATA_0000
/dev/dm-5

           1 CACHED  NORMAL   UNKNOWN CRS_0002
/dev/dm-4

           1 CACHED  NORMAL   UNKNOWN CRS_0001
/dev/dm-3


GROUP_NUMBER MOUNT_S STATE    REDUNDA NAME
------------ ------- -------- ------- ------------------------------
PATH
--------------------------------------------------------------------------------
           1 CACHED  NORMAL   UNKNOWN CRS_0000
/dev/dm-2

           3 CACHED  NORMAL   UNKNOWN FRA9
/dev/dm-24

           2 CACHED  NORMAL   UNKNOWN DATA9
/dev/dm-23


12 rows selected.

SQL> select GROUP_NUMBER,MOUNT_STATUS,STATE,REDUNDANCY,NAME,PATH from v$asm_disk;

GROUP_NUMBER MOUNT_S STATE    REDUNDA NAME
------------ ------- -------- ------- ------------------------------
PATH
--------------------------------------------------------------------------------
           2 CACHED  NORMAL   UNKNOWN DATA_0004
/dev/dm-12

           2 CACHED  NORMAL   UNKNOWN DATA_0003
/dev/dm-10

           3 CACHED  NORMAL   UNKNOWN FRA_0000
/dev/dm-9


GROUP_NUMBER MOUNT_S STATE    REDUNDA NAME
------------ ------- -------- ------- ------------------------------
PATH
--------------------------------------------------------------------------------
           3 CACHED  NORMAL   UNKNOWN FRA_0001
/dev/dm-8

           2 CACHED  NORMAL   UNKNOWN DATA_0001
/dev/dm-7

           2 CACHED  NORMAL   UNKNOWN DATA_0002
/dev/dm-6


GROUP_NUMBER MOUNT_S STATE    REDUNDA NAME
------------ ------- -------- ------- ------------------------------
PATH
--------------------------------------------------------------------------------
           2 CACHED  NORMAL   UNKNOWN DATA_0000
/dev/dm-5

           1 CACHED  NORMAL   UNKNOWN CRS_0002
/dev/dm-4

           1 CACHED  NORMAL   UNKNOWN CRS_0001
/dev/dm-3


GROUP_NUMBER MOUNT_S STATE    REDUNDA NAME
------------ ------- -------- ------- ------------------------------
PATH
--------------------------------------------------------------------------------
           1 CACHED  NORMAL   UNKNOWN CRS_0000
/dev/dm-2

           3 CACHED  NORMAL   UNKNOWN FRA9
/dev/dm-24

           2 CACHED  NORMAL   UNKNOWN DATA9
/dev/dm-23


12 rows selected.

SQL> select operation, state,power, actual, sofar, est_work, est_minutes
from v$asm_operation where group_number=1;  2

no rows selected

SQL> select state, name, type from v$asm_diskgroup;

STATE       NAME                           TYPE
----------- ------------------------------ ------
MOUNTED     CRS                            EXTERN
MOUNTED     DATA                           EXTERN
MOUNTED     FRA                            EXTERN

SQL> select name, total_mb/1024 "Total GiB" from v$asm_diskgroup;

NAME                            Total GiB
------------------------------ ----------
CRS                                     3
DATA                                 1800
FRA                                   500

SQL>


TAF basic policy RAC

 PUNE =
  (DESCRIPTION =
    (ADDRESS = (PROTOCOL = TCP)(HOST = racscan)(PORT = 1521))
    (CONNECT_DATA =
      (SERVER = DEDICATED)
      (SERVICE_NAME = pune)
      (FAILOVER_MODE=(METHOD=basic)(TYPE=select))
     (LOAD_BALANCE=YES)
     (FAILOVER=ON)
    )
  )

SQL> select INSTANCE_NAME, status from v$instance;
INSTANCE_NAME    STATUS
---------------- ------------
pune1            OPEN

SQL> select INSTANCE_NAME, status from v$instance;
INSTANCE_NAME    STATUS
---------------- ------------
pune2            OPEN
On a different window:
----------------------

[oracle@rac1pub117 admin]$ sqlplus shoaib/shoaib@pune

sql> select * from dba_source;

On Node 2:
----------
[oracle@rac1pub117 admin]$ sqlplus / as sysdba
sql> select inst_id,username,service_name,failover_type,failover_method,failed_over from gv$session where username='SHOAIB';
INST_ID   USERNAME SERVICE_NAME FAILOVER_TYPE FAILOVER_METHOD FAILED-OVER
-------------------------------------------------------------------------
         1 SHOAIB    pune           SELECT BASIC         NO


On Node 1:
----------

sql> shut immediate;
On Node 2:
----------
sql>select inst_id,username,service_name,failover_type,failover_method,failed_over from gv$session where username='SHOAIB';
INST_ID   USERNAME SERVICE_NAME FAILOVER_TYPE FAILOVER_METHOD FAILED-OVER
-------------------------------------------------------------------------
         2 SHOAIB    pune           SELECT BASIC         YES



RAC How to apply database patch on both nodes

 Ceck Oracle service status


[root@rac1pub108 Patch]# crs_stat -t


2: Stop database instance one by one


Stop database instance one by one

[oracle@rac-node1 ~]$ srvctl stop instance -i prod1 -d prod

[oracle@rac-node1 ~]$ srvctl stop instance -i prod2 -d prod



3: Stop ASM instance on each node one by one


[oracle@rac-node1 ~]$ srvctl stop asm -n rac-node1

[oracle@rac-node1 ~]$ srvctl stop asm -n rac-node2


4: Stop nodapplications one by one on each node


[oracle@rac-node1 ~]$ srvctl stop nodeapps -n rac-node1

[oracle@rac-node1 ~]$ srvctl stop nodeapps -n rac-node2




5: Check status again


[oracle@rac-node1 ~]$ crs_stat -t



[oracle@rac1pub108 17811429]$ opatch apply -all_nodes


OCM Patching Procedure RAC

 How to apply a patch using ocm file
Run this script on below location
[grid@rac1pub108 bin]$ pwd
/u01/app/11204/grid/OPatch/ocm/bin
[grid@rac1pub108 bin]$
[grid@rac1pub108 bin]$ ./emocmrsp
The OCM configuration response file (ocm.rsp) was successfully created.
[grid@rac1pub108 bin]$ ls -ltr
total 16
-rwxr-x--- 1 grid oinstall 9063 Dec  5 14:26 emocmrsp
-rw-r--r-- 1 grid oinstall  621 Dec  6 14:59 ocm.rsp
[grid@rac1pub108 bin]$
 
Check invalid objects
SQL> select count(*) from all_objects where status='INVALID';
  COUNT(*)
----------
         0
SQL>
First copy database and grid patch in one folder
[root@rac1pub108 DB_GRID_PATCH]# ll
total 8
drwxr-xr-x 4 root root 4096 Dec  6 15:05 17811429
drwxr-xr-x 5 root root 4096 Dec  6 15:03 25920335
[root@rac1pub108 DB_GRID_PATCH]# chown -R grid:oinstall 25920335/
[root@rac1pub108 DB_GRID_PATCH]# chown -R oracle:oinstall 17811429/
[root@rac1pub108 DB_GRID_PATCH]# ll
total 8
drwxr-xr-x 4 oracle oinstall 4096 Dec  6 15:05 17811429
drwxr-xr-x 5 grid   oinstall 4096 Dec  6 15:03 25920335
[root@rac1pub108 DB_GRID_PATCH]#
[oracle@rac2pub111 u01]$ srvctl  status database -d prod
Instance prod1 is running on node rac1pub108
Instance prod2 is running on node rac2pub111
[oracle@rac2pub111 u01]$
[root@rac1pub108 u01]# opatch auto /u01/DB_GRID_PATCH/ -ocmrf /u01/app/11204/grid/OPatch/ocm/bin/ocm.rsp -oh /u01/app/11204/grid/ -oh /u01/app/oracle/product/11204/dbhome_1/
[root@rac1pub108 u01]# opatch auto /u01/DB_GRID_PATCH/ -ocmrf /u01/app/11204/grid/OPatch/ocm/bin/ocm.rsp -oh /u01/app/11204/grid/ -oh /u01/app/oracle/product/11204/dbhome_1/
Executing /u01/app/11204/grid/perl/bin/perl /u01/app/oracle/product/11204/dbhome_1/OPatch/crs/patch11203.pl -patchdir /u01 -patchn DB_GRID_PATCH -ocmrf /u01/app/11204/grid/OPatch/ocm/bin/ocm.rsp -oh /u01/app/11204/grid/ -oh /u01/app/oracle/product/11204/dbhome_1/ -paramfile /u01/app/11204/grid/crs/install/crsconfig_params
This is the main log file: /u01/app/oracle/product/11204/dbhome_1/cfgtoollogs/opatchauto2017-12-06_15-35-54.log
This file will show your detected configuration and all the steps that opatchauto attempted to do on your system:
/u01/app/oracle/product/11204/dbhome_1/cfgtoollogs/opatchauto2017-12-06_15-35-54.report.log
2017-12-06 15:35:54: Starting Clusterware Patch Setup
Using configuration parameter file: /u01/app/11204/grid/crs/install/crsconfig_params
Enter 'yes' if you have unzipped this patch to an empty directory to proceed  (yes/no):yes
Enter 'yes' if you have unzipped this patch to an empty directory to proceed  (yes/no):yes
Stopping RAC /u01/app/oracle/product/11204/dbhome_1 ...
Stopped RAC /u01/app/oracle/product/11204/dbhome_1 successfully
patch /u01/DB_GRID_PATCH/18203835  apply successful for home  /u01/app/oracle/product/11204/dbhome_1
Starting RAC /u01/app/oracle/product/11204/dbhome_1 ...
Started RAC /u01/app/oracle/product/11204/dbhome_1 successfully
opatch auto succeeded.
[root@rac1pub108 u01]#
Grid patch auto
[root@rac1pub108 DB_GRID_PATCH]# opatch auto /u01/DB_GRID_PATCH/ -ocmrf /u01/app/11204/grid/OPatch/ocm/bin/ocm.rsp -oh /u01/app/11204/grid/
Executing /u01/app/11204/grid/perl/bin/perl /u01/app/oracle/product/11204/dbhome_1/OPatch/crs/patch11203.pl -patchdir /u01 -patchn DB_GRID_PATCH -ocmrf /u01/app/11204/grid/OPatch/ocm/bin/ocm.rsp -oh /u01/app/11204/grid/ -paramfile /u01/app/11204/grid/crs/install/crsconfig_params
This is the main log file: /u01/app/oracle/product/11204/dbhome_1/cfgtoollogs/opatchauto2017-12-06_15-41-43.log
This file will show your detected configuration and all the steps that opatchauto attempted to do on your system:
/u01/app/oracle/product/11204/dbhome_1/cfgtoollogs/opatchauto2017-12-06_15-41-43.report.log
2017-12-06 15:41:43: Starting Clusterware Patch Setup
Using configuration parameter file: /u01/app/11204/grid/crs/install/crsconfig_params
Enter 'yes' if you have unzipped this patch to an empty directory to proceed  (yes/no):yes
Enter 'yes' if you have unzipped this patch to an empty directory to proceed  (yes/no):yes
Stopping CRS...
Stopped CRS successfully
patch /u01/DB_GRID_PATCH/25920335  apply successful for home  /u01/app/11204/grid
Starting CRS...
Installing Trace File Analyzer
CRS-4123: Oracle High Availability Services has been started.
opatch auto succeeded.
[root@rac1pub108 bin]# tail -f /u01/app/oracle/product/11204/dbhome_1/cfgtoollogs/opatchauto2017-12-06_15-28-34.report.log
***********  Configuration Data  ***********
* It shows only those targets that will be patched in this session *
rac_home=/u01/app/oracle/product/11204/dbhome_1      owner=oracle      opatch_ver=11.2.0.3.17
*********** Steps to be executed as owner unless specified as root ***********


1: /u01/app/oracle/product/11204/dbhome_1/OPatch/opatch prereq CheckComponents -ph /u01/DB_GRID_PATCH/17811429 -oh /u01/app/oracle/product/11204/dbhome_1
2: /u01/app/oracle/product/11204/dbhome_1/OPatch/opatch prereq CheckComponents -ph /u01/DB_GRID_PATCH/25920335 -oh /u01/app/oracle/product/11204/dbhome_1
:q!
^[:L^C
[root@rac1pub108 bin]# tail -f /u01/app/oracle/product/11204/dbhome_1/cfgtoollogs/opatchauto2017-12-06_15-41-43.report.log
***********  Configuration Data  ***********
* It shows only those targets that will be patched in this session *

crs_home=/u01/app/11204/grid      owner=grid      opatch_ver=11.2.0.3.17
*********** Steps to be executed as owner unless specified as root ***********

1: /u01/app/11204/grid/OPatch/opatch prereq CheckComponents -ph /u01/DB_GRID_PATCH/25920335 -oh /u01/app/11204/grid
2: /u01/app/11204/grid/OPatch/opatch prereq CheckConflictAgainstOH -ph /u01/DB_GRID_PATCH/25920335 -oh /u01/app/11204/grid
3: /u01/app/11204/grid/crs/install/rootcrs.pl -unlock : run as root
4: /u01/app/11204/grid/tfa/bin/tfactl stop : run as root
5: /sbin/fuser -k /u01/app/11204/grid/bin/crsctl.bin : run as root
6: /u01/app/11204/grid/OPatch/opatch prereq CheckApplicable -ph /u01/DB_GRID_PATCH/25920335 -oh /u01/app/11204/grid
7: /u01/app/11204/grid/OPatch/opatch napply /u01/DB_GRID_PATCH/25920335 -local -silent -ocmrf /u01/app/11204/grid/OPatch/ocm/bin/ocm.rsp -oh /u01/app/11204/grid -invPtrLoc /u01/app/11204/grid/oraInst.loc
8: /u01/app/11204/grid/bin/emctl start dbconsole
9: /u01/app/11204/grid/rdbms/install/rootadd_rdbms.sh : run as root
10: /u01/app/11204/grid/crs/install/rootcrs.pl -patch : run as root



Featured post

Migrate OCR & vote from external to normal or High redundancy in ASM

How to Move OCR & Vote from external to Normal or high. 1)  Create New diskgroup(CRS) with suitable redundancy for OCR and Voting files....

Popular Posts