HI,
During the RAC install I hit this problem. in the middle of a RAC install, where Grid, ASM and the patch for multicast have all been applied and installed correctly. I even have the clusterware up and running, but I noticed that the resource ora.LISTENER.lsnr is not running on one of the nodes. When I attempt to start the listener I am met with the following error.
Code:
bvecrcdrprep: >./crsctl start resource ora.LISTENER.lsnr -n rvecrcdrprep
CRS-5702: Resource 'ora.LISTENER.lsnr' is already running on 'rvecrcdrprep'
CRS-4000: Command Start failed, or completed with errors.
bvecrcdrprep: >./crsctl start resource ora.LISTENER.lsnr -n bvecrcdrprep
CRS-2805: Unable to start 'ora.LISTENER.lsnr' because it has a 'hard' dependency
So I had a look at the dependencies
Code:
bvecrcdrprep: >./crsctl stat res ora.LISTENER.lsnr -p|grep DEPENDENCIES
START_DEPENDENCIES=hard(type:ora.cluster_vip_net1.type) pullup(type:ora.cluster_
vip_net1.type)
STOP_DEPENDENCIES=hard(intermediate:type:ora.cluster_vip_net1.type)
As you can see clusterware is running on both nodes fine
Code:
rvecrcdrprep: >./crsctl check cluster -all
**************************************************************
bvecrcdrprep:
CRS-4537: Cluster Ready Services is online
CRS-4529: Cluster Synchronization Services is online
CRS-4533: Event Manager is online
**************************************************************
rvecrcdrprep:
CRS-4537: Cluster Ready Services is online
CRS-4529: Cluster Synchronization Services is online
CRS-4533: Event Manager is online
**************************************************************
When I issue an netstat -i on both nodes they are slightly different - is this normal behaviour ? The error I am getting is complaining about the vip on node bvecrcdrprep
Code:
netstat -i
Name Mtu Network Address Ipkts Ierrs Opkts Oerrs Coll
en0 1500 link#2 e6.3.fb.12.d.d 1389887 0 594673 0 0
en0 1500 10.210 rvecrcdrprepboot 1389887 0 594673 0 0
en0 1500 10.210 rvecrcdrprep-vip 1389887 0 594673 0 0
en0 1500 10.210 ecrcdrprep.hscni 1389887 0 594673 0 0
en1 1500 link#3 e6.3.fb.12.d.e 6204474 0 6590333 0 0
en1 1500 10.210.8 rvecrcdrprep.hsc 6204474 0 6590333 0 0
en2 1500 link#4 e6.3.fb.12.d.f 825697 0 753785 0 0
en2 1500 10 rvecrcdrprep-pri 825697 0 753785 0 0
en2 1500 169.254 169.254.209.75 825697 0 753785 0 0
lo0 16896 link#1 315291 0 315292 0 0
lo0 16896 127 loopback 315291 0 315292 0 0
lo0 16896 ::1%1 315291 0 315292 0 0
rvecrcdrprep: >
bvecrcdrprep: >netstat -i
Name Mtu Network Address Ipkts Ierrs Opkts Oerrs Coll
en0 1500 link#2 9e.fe.13.3e.54.d 747183 0 1238666 0 0
en0 1500 10.210 bvecrcdrprepboot 747183 0 1238666 0 0
en1 1500 link#3 9e.fe.13.3e.54.e 3364089 0 1732699 0 0
en1 1500 10.210.8 bvecrcdrprep.hsc 3364089 0 1732699 0 0
en2 1500 link#4 9e.fe.13.3e.54.f 747296 0 834697 0 0
en2 1500 10 bvecrcdrprep-pri 747296 0 834697 0 0
en2 1500 169.254 169.254.56.186 747296 0 834697 0 0
lo0 16896 link#1 216880 0 216879 0 0
lo0 16896 127 loopback 216880 0 216879 0 0
lo0 16896 ::1%1 216880 0 216879 0 0
bvecrcdrprep: >
=========================================
rvecrcdrprep: >
The error message in the RAC install details about the following:-
Code:
Node Application Existence - This test checks the existence of Node Applications on the system.
Check Failed on Nodes: [bvecrcdrprep] Check Succeeded On Nodes: [rvecrcdrprep]
Verification result of failed node: bvecrcdrprep
List of errors:
-
PRVF-4555 : Node application "ora.bvecrcdrprep.vip" does not exist on node "bvecrcdrprep" - Cause: Could not identify resource specified on the node specified. - Action: Ensure that the resource specified is available for the node specified.
The vip address in the grid install ran successfully and gave no errors. Like I said Clusterware, ASM, CRS all working as it should. I even rebooted the servers and the clusterware restarted successfully other than this listener, which gives the error.
Hopefully someone has some idea of what causes this and a fix.
BTW my RAC install has just completed successfully, but the LISTENER is still offline and will not start.
Many thanks