oracle CRS wont start after server reboot

one of our production server (part of RAC) restarted but crs worn’t start.

checking the logs.

2011-11-09 18:46:44.016: [ COMMCRS][1099135296]clsc_connect: (0x35cb500) no listener at (ADDRESS=(PROTOCOL=ipc)(KEY=OCSSD_LL_dbz30cnc_))

2011-11-09 18:46:44.017: [ CSSCLNT][4001583360]clsssInitNative: failed to connect to (ADDRESS=(PROTOCOL=ipc)(KEY=OCSSD_LL_dbz30cnc_)), rc 9

2011-11-09 18:46:44.017: [  CRSRTI][4001583360] CSS is not ready. Received status 3 from CSS. Waiting for good status ..

2011-11-09 18:46:45.197: [ COMMCRS][1099135296]clsc_connect: (0x35cb500) no listener at (ADDRESS=(PROTOCOL=ipc)(KEY=OCSSD_LL_dbz30cnc_))

2011-11-09 18:46:45.197: [ CSSCLNT][4001583360]clsssInitNative: failed to connect to (ADDRESS=(PROTOCOL=ipc)(KEY=OCSSD_LL_dbz30cnc_)), rc 9

2011-11-09 18:46:45.197: [  CRSRTI][4001583360] CSS is not ready. Received status 3 from CSS. Waiting for good status ..

2011-11-09 18:46:46.198: [    CRSD][4001583360][PANIC] CRSD exiting: Could not init the CSS context
2011-11-09 18:46:46.198: [    CRSD][4001583360] Done.


yyy01.xxx.com$ ./crsctl check crs
Failure 1 contacting Cluster Synchronization Services daemon
Cannot communicate with Cluster Ready Services
Cannot communicate with Event Manager

1. first corrective action we’ve done. is delete the lockfile in /tmp or /var/tmp

yyy01.xxx.com$ cd /var/tmp
yyy01.xxx.com$ ls -al
total 60
drwxrwxrwt  3 root root  4096 Oct 16 07:27 .
drwxr-xr-x 20 root root  4096 Oct 21  2009 ..
-rw-rw-r--  1 root root 25806 Oct 22 20:53 badlogs.log
-rw-r--r--  1 root root 10045 May 28  2010 opc_inst.log
drwxrwxrwt  2 root root  4096 Nov  9 18:07 .oracle
-rw-------  1 root root     0 Nov  9 18:07 osspi_boot.msg

after deleting the file we rebooted the server again. but did not work.

i tried to checked ip’s of both nodes and found that both can’t communicate using the PRIV ip.
ask UNIX to check and do whatever they need to do.

when UNIX team is done, they rebooted the server and the database and all of its services started.

Advertisements

4 thoughts on “oracle CRS wont start after server reboot

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s