一,   Oracle11g RAC (ASM) Primary DB开关机  


关机 :  

1.  首先以grid用戶在任意一个节点執行crs_stat -t查詢當前RAC的狀態
(注意：其中有一些服务本身就是offline的)  

wsjrac01<*+ASM1*/home/grid>$crs_stat -t 
Name           Type           Target    State     Host        
------------------------------------------------------------
ora.DATA.dg    ora....up.type ONLINE    ONLINE    wsjrac01    
ora.INDX.dg    ora....up.type ONLINE    ONLINE    wsjrac01    
ora....ER.lsnr ora....er.type ONLINE    ONLINE    wsjrac01    
ora....N1.lsnr ora....er.type ONLINE    ONLINE    wsjrac02    
ora.asm        ora.asm.type   ONLINE    ONLINE    wsjrac01    
ora.cvu        ora.cvu.type   ONLINE    ONLINE    wsjrac02    
ora.gsd        ora.gsd.type   OFFLINE   OFFLINE               
ora....network ora....rk.type ONLINE    ONLINE    wsjrac01    
ora.oc4j       ora.oc4j.type  ONLINE    ONLINE    wsjrac02    
ora.ons        ora.ons.type   ONLINE    ONLINE    wsjrac01    
ora....ry.acfs ora....fs.type ONLINE    ONLINE    wsjrac01    
ora.scan1.vip  ora....ip.type ONLINE    ONLINE    wsjrac02    
ora.wsjdell.db ora....se.type ONLINE    ONLINE    wsjrac01    
ora....SM1.asm application    ONLINE    ONLINE    wsjrac01    
ora....01.lsnr application    ONLINE    ONLINE    wsjrac01    
ora....c01.gsd application    OFFLINE   OFFLINE               
ora....c01.ons application    ONLINE    ONLINE    wsjrac01    
ora....c01.vip ora....t1.type ONLINE    ONLINE    wsjrac01    
ora....SM2.asm application    ONLINE    ONLINE    wsjrac02    
ora....02.lsnr application    ONLINE    ONLINE    wsjrac02    
ora....c02.gsd application    OFFLINE   OFFLINE               
ora....c02.ons application    ONLINE    ONLINE    wsjrac02    
ora....c02.vip ora....t1.type ONLINE    ONLINE    wsjrac02    
ora....SM3.asm application    ONLINE    ONLINE    wsjrac03    
ora....03.lsnr application    ONLINE    ONLINE    wsjrac03    
ora....c03.gsd application    OFFLINE   OFFLINE               
ora....c03.ons application    ONLINE    ONLINE    wsjrac03    
ora....c03.vip ora....t1.type ONLINE    ONLINE    wsjrac03    
wsjrac01<*+ASM1*/home/grid>$


2.  以grid用户登入, 然后保留grid环境,  切换到root 权限 , 停止Oracle11g  RAC
环境 (在任意一個node執行)  

------------------------------------------------
其实也可以直接root登入,  在执行命令的时候需要执行绝对路径： 
[root@rac01 bin]# pwd
/u01/grid/11.2.0/bin  
[root@rac01 bin]# ./crsctl stop  cluster  -all  
------------------------------------------------

crsctl stop cluster –all 命令中不加入 -all  就是关闭本机实例 .   

下面我们以第一种方式运行关闭整个RAC：   
wsjrac01<*+ASM1*/home/grid>$id
uid=500(grid) gid=500(oinstall) groups=500(oinstall),501(asmadmin),502(asmdba),503(asmoper)

wsjrac01<*+ASM1*/home/grid>$su      ---- su   切换到root权限但是保留grid环境  
Password: 
wsjrac01<*+ASM1*/home/grid>$id
uid=0(root) gid=0(root) groups=0(root),1(bin),2(daemon),3(sys),4(adm),6(disk),10(wheel),105(pkcs11)
wsjrac01<*+ASM1*/home/grid>$crsctl stop cluster –all
CRS-2673: Attempting to stop 'ora.crsd' on 'wsjrac02'
CRS-2673: Attempting to stop 'ora.crsd' on 'wsjrac01'
CRS-2673: Attempting to stop 'ora.crsd' on 'wsjrac03'
CRS-2790: Starting shutdown of Cluster Ready Services-managed resources on 'wsjrac01'
CRS-2673: Attempting to stop 'ora.LISTENER.lsnr' on 'wsjrac01'
CRS-2673: Attempting to stop 'ora.registry.acfs' on 'wsjrac01'
CRS-2673: Attempting to stop 'ora.wsjdell.db' on 'wsjrac01'
CRS-2790: Starting shutdown of Cluster Ready Services-managed resources on 'wsjrac02'
CRS-2673: Attempting to stop 'ora.LISTENER.lsnr' on 'wsjrac02'
CRS-2673: Attempting to stop 'ora.registry.acfs' on 'wsjrac02'
CRS-2673: Attempting to stop 'ora.wsjdell.db' on 'wsjrac02'
CRS-2790: Starting shutdown of Cluster Ready Services-managed resources on 'wsjrac03'
CRS-2673: Attempting to stop 'ora.LISTENER.lsnr' on 'wsjrac03'
CRS-2673: Attempting to stop 'ora.registry.acfs' on 'wsjrac03'
CRS-2673: Attempting to stop 'ora.wsjdell.db' on 'wsjrac03'
CRS-2673: Attempting to stop 'ora.cvu' on 'wsjrac03'
CRS-2673: Attempting to stop 'ora.LISTENER_SCAN1.lsnr' on 'wsjrac03'
CRS-2673: Attempting to stop 'ora.oc4j' on 'wsjrac03'
CRS-2677: Stop of 'ora.cvu' on 'wsjrac03' succeeded
CRS-2677: Stop of 'ora.LISTENER.lsnr' on 'wsjrac01' succeeded
CRS-2673: Attempting to stop 'ora.wsjrac01.vip' on 'wsjrac01'
CRS-2677: Stop of 'ora.LISTENER.lsnr' on 'wsjrac02' succeeded
CRS-2673: Attempting to stop 'ora.wsjrac02.vip' on 'wsjrac02'
CRS-2677: Stop of 'ora.wsjrac01.vip' on 'wsjrac01' succeeded
CRS-2677: Stop of 'ora.wsjrac02.vip' on 'wsjrac02' succeeded
CRS-2677: Stop of 'ora.LISTENER_SCAN1.lsnr' on 'wsjrac03' succeeded
CRS-2673: Attempting to stop 'ora.scan1.vip' on 'wsjrac03'
CRS-2677: Stop of 'ora.LISTENER.lsnr' on 'wsjrac03' succeeded
CRS-2673: Attempting to stop 'ora.wsjrac03.vip' on 'wsjrac03'
CRS-2677: Stop of 'ora.scan1.vip' on 'wsjrac03' succeeded
CRS-2677: Stop of 'ora.wsjrac03.vip' on 'wsjrac03' succeeded
CRS-2677: Stop of 'ora.registry.acfs' on 'wsjrac01' succeeded
CRS-2677: Stop of 'ora.registry.acfs' on 'wsjrac02' succeeded
CRS-2677: Stop of 'ora.registry.acfs' on 'wsjrac03' succeeded
CRS-2677: Stop of 'ora.wsjdell.db' on 'wsjrac01' succeeded
CRS-2673: Attempting to stop 'ora.DATA.dg' on 'wsjrac01'
CRS-2673: Attempting to stop 'ora.INDX.dg' on 'wsjrac01'
CRS-2677: Stop of 'ora.wsjdell.db' on 'wsjrac02' succeeded
CRS-2673: Attempting to stop 'ora.DATA.dg' on 'wsjrac02'
CRS-2673: Attempting to stop 'ora.INDX.dg' on 'wsjrac02'
CRS-2677: Stop of 'ora.wsjdell.db' on 'wsjrac03' succeeded
CRS-2673: Attempting to stop 'ora.DATA.dg' on 'wsjrac03'
CRS-2673: Attempting to stop 'ora.INDX.dg' on 'wsjrac03'
CRS-2677: Stop of 'ora.INDX.dg' on 'wsjrac01' succeeded
CRS-2677: Stop of 'ora.INDX.dg' on 'wsjrac02' succeeded
CRS-2677: Stop of 'ora.oc4j' on 'wsjrac03' succeeded
CRS-2677: Stop of 'ora.INDX.dg' on 'wsjrac03' succeeded
CRS-2677: Stop of 'ora.DATA.dg' on 'wsjrac01' succeeded
CRS-2673: Attempting to stop 'ora.asm' on 'wsjrac01'
CRS-2677: Stop of 'ora.asm' on 'wsjrac01' succeeded
CRS-2673: Attempting to stop 'ora.ons' on 'wsjrac01'
CRS-2677: Stop of 'ora.DATA.dg' on 'wsjrac02' succeeded
CRS-2673: Attempting to stop 'ora.asm' on 'wsjrac02'
CRS-2677: Stop of 'ora.asm' on 'wsjrac02' succeeded
CRS-2673: Attempting to stop 'ora.ons' on 'wsjrac02'
CRS-2677: Stop of 'ora.DATA.dg' on 'wsjrac03' succeeded
CRS-2673: Attempting to stop 'ora.asm' on 'wsjrac03'
CRS-2677: Stop of 'ora.asm' on 'wsjrac03' succeeded
CRS-2677: Stop of 'ora.ons' on 'wsjrac01' succeeded
CRS-2673: Attempting to stop 'ora.net1.network' on 'wsjrac01'
CRS-2677: Stop of 'ora.net1.network' on 'wsjrac01' succeeded
CRS-2792: Shutdown of Cluster Ready Services-managed resources on 'wsjrac01' has completed
CRS-2677: Stop of 'ora.ons' on 'wsjrac02' succeeded
CRS-2673: Attempting to stop 'ora.net1.network' on 'wsjrac02'
CRS-2677: Stop of 'ora.net1.network' on 'wsjrac02' succeeded
CRS-2792: Shutdown of Cluster Ready Services-managed resources on 'wsjrac02' has completed
CRS-2673: Attempting to stop 'ora.ons' on 'wsjrac03'
CRS-2677: Stop of 'ora.ons' on 'wsjrac03' succeeded
CRS-2673: Attempting to stop 'ora.net1.network' on 'wsjrac03'
CRS-2677: Stop of 'ora.net1.network' on 'wsjrac03' succeeded
CRS-2792: Shutdown of Cluster Ready Services-managed resources on 'wsjrac03' has completed
CRS-2677: Stop of 'ora.crsd' on 'wsjrac01' succeeded
CRS-2673: Attempting to stop 'ora.ctssd' on 'wsjrac01'
CRS-2673: Attempting to stop 'ora.evmd' on 'wsjrac01'
CRS-2673: Attempting to stop 'ora.asm' on 'wsjrac01'
CRS-2677: Stop of 'ora.crsd' on 'wsjrac02' succeeded
CRS-2673: Attempting to stop 'ora.ctssd' on 'wsjrac02'
CRS-2673: Attempting to stop 'ora.evmd' on 'wsjrac02'
CRS-2673: Attempting to stop 'ora.asm' on 'wsjrac02'
CRS-2677: Stop of 'ora.crsd' on 'wsjrac03' succeeded
CRS-2673: Attempting to stop 'ora.ctssd' on 'wsjrac03'
CRS-2673: Attempting to stop 'ora.evmd' on 'wsjrac03'
CRS-2673: Attempting to stop 'ora.asm' on 'wsjrac03'
CRS-2677: Stop of 'ora.asm' on 'wsjrac01' succeeded
CRS-2673: Attempting to stop 'ora.cluster_interconnect.haip' on 'wsjrac01'
CRS-2677: Stop of 'ora.asm' on 'wsjrac02' succeeded
CRS-2673: Attempting to stop 'ora.cluster_interconnect.haip' on 'wsjrac02'
CRS-2677: Stop of 'ora.evmd' on 'wsjrac02' succeeded
CRS-2677: Stop of 'ora.asm' on 'wsjrac03' succeeded
CRS-2673: Attempting to stop 'ora.cluster_interconnect.haip' on 'wsjrac03'
CRS-2677: Stop of 'ora.evmd' on 'wsjrac03' succeeded
CRS-2677: Stop of 'ora.evmd' on 'wsjrac01' succeeded
CRS-2677: Stop of 'ora.cluster_interconnect.haip' on 'wsjrac03' succeeded
CRS-2677: Stop of 'ora.cluster_interconnect.haip' on 'wsjrac01' succeeded
CRS-2677: Stop of 'ora.ctssd' on 'wsjrac01' succeeded
CRS-2673: Attempting to stop 'ora.cssd' on 'wsjrac01'
CRS-2677: Stop of 'ora.ctssd' on 'wsjrac02' succeeded
CRS-2677: Stop of 'ora.ctssd' on 'wsjrac03' succeeded
CRS-2673: Attempting to stop 'ora.cssd' on 'wsjrac03'
CRS-2677: Stop of 'ora.cssd' on 'wsjrac01' succeeded
CRS-2673: Attempting to stop 'ora.diskmon' on 'wsjrac01'
CRS-2677: Stop of 'ora.cssd' on 'wsjrac03' succeeded
CRS-2673: Attempting to stop 'ora.diskmon' on 'wsjrac03'
CRS-2677: Stop of 'ora.diskmon' on 'wsjrac01' succeeded
CRS-2677: Stop of 'ora.diskmon' on 'wsjrac03' succeeded
CRS-2675: Stop of 'ora.cluster_interconnect.haip' on 'wsjrac02' failed
CRS-2679: Attempting to clean 'ora.cluster_interconnect.haip' on 'wsjrac02'
CRS-2681: Clean of 'ora.cluster_interconnect.haip' on 'wsjrac02' succeeded
CRS-2673: Attempting to stop 'ora.cssd' on 'wsjrac02'
CRS-2677: Stop of 'ora.cssd' on 'wsjrac02' succeeded
CRS-2673: Attempting to stop 'ora.diskmon' on 'wsjrac02'
CRS-2677: Stop of 'ora.diskmon' on 'wsjrac02' succeeded
wsjrac01<*+ASM1*/home/grid>$  

3.   查看現在RAC的狀態(在每個node下)
wsjrac03<*+ASM1*/home/grid>$crs_stat -t
CRS-0184: Cannot communicate with the CRS daemon. --全部關閉的狀態
wsjrac03<*+ASM2*/home/grid>$crs_stat -t
CRS-0184: Cannot communicate with the CRS daemon.
wsjrac03<*+ASM3*/home/grid>$crs_stat -t
CRS-0184: Cannot communicate with the CRS daemon.

4.  然后# init 0 (#shutdown -h now)关闭服务器（如果重新启动#init 6）


关机 :  

开机过程中, 如果Linux有重新启动,   ASM及RAC都会自动开启,  不需要手工
干预.  如果开启有问题或OS没有重新启动, 手工开启的命令差不多 (stop换start即可).    
[root@rac01 bin]# pwd
/u01/grid/11.2.0/bin  
[root@rac01 bin]# ./crsctl  stop  resource  -all  






二,   Oracle11g RAC Active Dataguard DB (ASM单机) 开关机   

關閉Active Dataguard (單機oracle 11.2.0.2+ASM)

1.  首先关闭Oracle数据库实例：  
[root@wsjdelll10sty ~]# su - oracle
wsjdelll10sty<*wsjdell*/home/oracle>$sqlplus  '/as sysdba'    
SQL> shutdown immediate; 
Database closed.
Database dismounted.
ORACLE instance shut down.

2.  然后關閉ASM实例 ：   
[root@wsjdelll10sty ~]# su - grid
wsjdelll10sty<*+ASM*/home/grid>$sqlplus '/as sysasm'  

SQL>shutdown immediate;
ASM diskgroups dismounted
ASM instance shutdown 

3. 最后 # init 0   

PS: 
后來注意到ASM的standby也是由grid用戶管理，使用clusterware的一些命令好像也可以對他操作 
可能我按照先關閉database再關閉ASM的順序，直接使用crsctl stop cluster可能也可以成功關閉
standby，待驗證。






开启Active Dataguard (单机oracle 11.2.0.2+ASM)

1. 如果OS有重新启动,  那么当server启动后ASM自动被挂载上，standby database会
自动startup到read only状态(都是通过crs来管理的)，listener自动start，过程如同RAC
的启动，不需要手动启动。可以使用crs_stat -t查看状态 。 

wsjdelll10sty<*+ASM*/home/grid>$crs_stat -t  
Name           Type           Target    State     Host        
------------------------------------------------------------
ora.DATA.dg    ora....up.type ONLINE    ONLINE    wsjd...0sty 
ora.INDX.dg    ora....up.type ONLINE    ONLINE    wsjd...0sty 
ora....ER.lsnr ora....er.type ONLINE    ONLINE    wsjd...0sty 
ora.asm        ora.asm.type   ONLINE    ONLINE    wsjd...0sty 
ora.cssd       ora.cssd.type  ONLINE    ONLINE    wsjd...0sty 
ora.diskmon    ora....on.type ONLINE    ONLINE    wsjd...0sty 
ora.evmd       ora.evm.type   ONLINE    ONLINE    wsjd...0sty 
ora.ons        ora.ons.type   ONLINE    ONLINE    wsjd...0sty 
ora.wsjdell.db ora....se.type ONLINE    ONLINE    wsjd...0sty 

2.  切换到Oracle用户, 查看资料库状: 
  
[root@wsjdelll10sty ~]# su - oracle
wsjdelll10sty<*wsjdell*/home/oracle>$sqlplus '/as sysdba'   
Connected to:
Oracle Database 11g Enterprise Edition Release 11.2.0.2.0 - 64bit Production
With the Partitioning, Automatic Storage Management, Oracle Label Security, OLAP,
Data Mining, Oracle Database Vault and Real Application Testing options

SQL> select open_mode from v$database; 

OPEN_MODE
--------------------
READ ONLY

3.   查看监听状态, 是开启状态 :    
wsjdelll10sty<*wsjdell*/home/oracle>$lsnrctl status

4.  这时只需要开启standby的redo real-time apply(实时运用) (目前只是启动到read only)  
[root@wsjdelll10sty ~]# su - oracle
wsjdelll10sty<*wsjdell*/home/oracle>$sqlplus  '/as sysdba';
SQL> alter database recover managed standby database using current logfile disconnect;
SQL> select open_mode from v$database;
OPEN_MODE
--------------------
READ ONLY WITH APPLY





如果OS没有重新启动,  那么整个过程就需要手工操作:    

1.  首先需要开启ASM  
wsjdelll10sty<*+ASM*/home/grid>$id
uid=500(grid) gid=500(oinstall) groups=500(oinstall),501(asmadmin),502(asmdba),503(asmoper),504(dba)
wsjdelll10sty<*wsjdell*/home/oracle/dba/run>$export ORACLE_SID=+ASM
wsjdelll10sty<*+ASM*/home/grid>$sqlplus "/as sysasm"   
SQL> startup     
ASM instance started
Total System Global Area  283930624 bytes
Fixed Size                  2225792 bytes
Variable Size             256539008 bytes
ASM Cache                  25165824 bytes
ASM diskgroups mounted

也可以 ： 
SQL>startup nomount;
SQL>select name,state from v$asm_diskgroup;
SQL>alter diskgroup all mount;  


2.  继续开启Oracle DB standby  :  
[root@wsjdelll10sty ~]# su - oracle
wsjdelll10sty<*wsjdell*/home/oracle>$ 
wsjdelll10sty<*wsjdell*/home/oracle>$lsnrctl start
wsjdelll10sty<*wsjdell*/home/oracle>$sqlplus "/as sysdba"
SQL> startup  
ORACLE instance started. 
Total System Global Area 2.6724E+10 bytes
Fixed Size                  2239112 bytes
Variable Size            1.2818E+10 bytes
Database Buffers         1.3892E+10 bytes
Redo Buffers               12128256 bytes
Database mounted.
Database opened.
SQL> 
SQL> select open_mode from v$database; 
OPEN_MODE
--------------------
READ ONLY

SQL>alter database recover managed standby database using current logfile disconnect;

SQL> select open_mode from v$database; 
OPEN_MODE
--------------------
READ ONLY WITH APPLY








---------------------------------------------------------------  


PS:   如何使用crsctl 等命令关闭及开启ASM单机 .  

[root@wsjdelll10sty ~]# su - grid  
wsjdelll10sty<*+ASM*/home/grid>$crs_stat -t  
Name           Type           Target    State     Host        
------------------------------------------------------------
ora.DATA.dg    ora....up.type ONLINE    ONLINE    wsjd...0sty 
ora.INDX.dg    ora....up.type ONLINE    ONLINE    wsjd...0sty 
ora....ER.lsnr ora....er.type ONLINE    ONLINE    wsjd...0sty 
ora.asm        ora.asm.type   ONLINE    ONLINE    wsjd...0sty 
ora.cssd       ora.cssd.type  ONLINE    ONLINE    wsjd...0sty 
ora.diskmon    ora....on.type ONLINE    ONLINE    wsjd...0sty 
ora.evmd       ora.evm.type   ONLINE    ONLINE    wsjd...0sty 
ora.ons        ora.ons.type   ONLINE    ONLINE    wsjd...0sty 
ora.wsjdell.db ora....se.type ONLINE    ONLINE    wsjd...0sty  


wsjdelll10sty<*+ASM*/home/grid>$crsctl   stop   resource  -all 
CRS-2673: Attempting to stop 'ora.LISTENER.lsnr' on 'wsjdelll10sty'
CRS-2673: Attempting to stop 'ora.diskmon' on 'wsjdelll10sty'
CRS-2673: Attempting to stop 'ora.DATA.dg' on 'wsjdelll10sty'
CRS-2673: Attempting to stop 'ora.INDX.dg' on 'wsjdelll10sty'
CRS-2673: Attempting to stop 'ora.wsjdell.db' on 'wsjdelll10sty'
CRS-2673: Attempting to stop 'ora.evmd' on 'wsjdelll10sty'
CRS-2673: Attempting to stop 'ora.ons' on 'wsjdelll10sty'
CRS-2677: Stop of 'ora.LISTENER.lsnr' on 'wsjdelll10sty' succeeded
CRS-2677: Stop of 'ora.ons' on 'wsjdelll10sty' succeeded
CRS-2677: Stop of 'ora.evmd' on 'wsjdelll10sty' succeeded
CRS-2677: Stop of 'ora.diskmon' on 'wsjdelll10sty' succeeded
CRS-2675: Stop of 'ora.INDX.dg' on 'wsjdelll10sty' failed
CRS-2675: Stop of 'ora.DATA.dg' on 'wsjdelll10sty' failed
CRS-2677: Stop of 'ora.wsjdell.db' on 'wsjdelll10sty' succeeded
CRS-4000: Command Stop failed, or completed with errors.

wsjdelll10sty<*+ASM*/home/grid>$crs_stat   -t  
Name           Type           Target    State     Host        
------------------------------------------------------------
ora.DATA.dg    ora....up.type OFFLINE   ONLINE    wsjd...0sty 
ora.INDX.dg    ora....up.type OFFLINE   ONLINE    wsjd...0sty 
ora....ER.lsnr ora....er.type OFFLINE   OFFLINE               
ora.asm        ora.asm.type   OFFLINE   ONLINE    wsjd...0sty 
ora.cssd       ora.cssd.type  OFFLINE   ONLINE    wsjd...0sty 
ora.diskmon    ora....on.type OFFLINE   OFFLINE               
ora.evmd       ora.evm.type   OFFLINE   OFFLINE               
ora.ons        ora.ons.type   OFFLINE   OFFLINE               
ora.wsjdell.db ora....se.type OFFLINE   OFFLINE               
wsjdelll10sty<*+ASM*/home/grid>$


发现停止Diskgroup失败 , 只有用sqlplus关闭:  

wsjdelll10sty<*+ASM*/home/grid>$sqlplus '/as sysasm'    
Connected to:
Oracle Database 11g Enterprise Edition Release 11.2.0.2.0 - 64bit Production
With the Automatic Storage Management option

SQL> shutdown immediate  
ASM diskgroups dismounted
ASM instance shutdown

wsjdelll10sty<*+ASM*/home/grid>$crs_stat   -t  
Name           Type           Target    State     Host        
------------------------------------------------------------
ora.DATA.dg    ora....up.type OFFLINE   OFFLINE               
ora.INDX.dg    ora....up.type OFFLINE   OFFLINE               
ora....ER.lsnr ora....er.type OFFLINE   OFFLINE               
ora.asm        ora.asm.type   OFFLINE   OFFLINE               
ora.cssd       ora.cssd.type  OFFLINE   ONLINE    wsjd...0sty 
ora.diskmon    ora....on.type OFFLINE   OFFLINE               
ora.evmd       ora.evm.type   OFFLINE   OFFLINE               
ora.ons        ora.ons.type   OFFLINE   OFFLINE               
ora.wsjdell.db ora....se.type OFFLINE   OFFLINE               



奇怪的是，开启的时候使用 crsctl  start   resource  -all 可以开启diskgroup相关的 。

wsjdelll10sty<*+ASM*/home/grid>$crsctl start resource -all 
CRS-5702: Resource 'ora.DATA.dg' is already running on 'wsjdelll10sty'
CRS-5702: Resource 'ora.INDX.dg' is already running on 'wsjdelll10sty'
CRS-5702: Resource 'ora.LISTENER.lsnr' is already running on 'wsjdelll10sty'
CRS-5702: Resource 'ora.asm' is already running on 'wsjdelll10sty'
CRS-5702: Resource 'ora.cssd' is already running on 'wsjdelll10sty'
CRS-2672: Attempting to start 'ora.evmd' on 'wsjdelll10sty'
CRS-2672: Attempting to start 'ora.ons' on 'wsjdelll10sty'
CRS-2672: Attempting to start 'ora.diskmon' on 'wsjdelll10sty'
CRS-2676: Start of 'ora.evmd' on 'wsjdelll10sty' succeeded
CRS-2676: Start of 'ora.diskmon' on 'wsjdelll10sty' succeeded
CRS-2676: Start of 'ora.ons' on 'wsjdelll10sty' succeeded
CRS-2672: Attempting to start 'ora.wsjdell.db' on 'wsjdelll10sty'
CRS-5010: Update of configuration file "/u01/product/oracle/11.2.0/db_1/srvm/admin/oratab.bak.wsjdelll10sty" failed: details at "(:CLSN00011:)" in "/u01/product/grid/11.2.0/crs/log/wsjdelll10sty/agent/ohasd/oraagent_grid/oraagent_grid.log"
CRS-2676: Start of 'ora.wsjdell.db' on 'wsjdelll10sty' succeeded
CRS-4000: Command Start failed, or completed with errors.

wsjdelll10sty<*+ASM*/home/grid>$crs_stat -t  
Name           Type           Target    State     Host        
------------------------------------------------------------
ora.DATA.dg    ora....up.type ONLINE    ONLINE    wsjd...0sty 
ora.INDX.dg    ora....up.type ONLINE    ONLINE    wsjd...0sty 
ora....ER.lsnr ora....er.type ONLINE    ONLINE    wsjd...0sty 
ora.asm        ora.asm.type   ONLINE    ONLINE    wsjd...0sty 
ora.cssd       ora.cssd.type  ONLINE    ONLINE    wsjd...0sty 
ora.diskmon    ora....on.type ONLINE    ONLINE    wsjd...0sty 
ora.evmd       ora.evm.type   ONLINE    ONLINE    wsjd...0sty 
ora.ons        ora.ons.type   ONLINE    ONLINE    wsjd...0sty 
ora.wsjdell.db ora....se.type ONLINE    ONLINE    wsjd...0sty 
wsjdelll10sty<*+ASM*/home/grid>$