Listener restart frequently oracle rac

[dushyantmdave]

Hi,

In oracle rac setup 11.2.0.3.0 under solaris the listener restarts frequently kindly help.

Regards,
Dushyant

[gandolf989]

Does the listener only restart on one node or on all of the nodes? Have you
looked at the listener log file to see if there are any error messages in the
listener log file? What version of Solaris are you using? and have you had
other processes suddenly die?

[gandolf989]

Does the listener only restart on one node or on all of the nodes? Have you
looked at the listener log file to see if there are any error messages in the
listener log file? What version of Solaris are you using? and have you had
other processes suddenly die?

[dushyantmdave]

Hi gandolf989,

Thanks for reply, both the nodes listener restarts at different time.

Solaris 10
11.2.0.3.0

PFA logs :

Listener logs

07-JAN-2016 07:25:40 * (CONNECT_DATA=(CID=(PROGRAM=)(HOST=local)(USER=oracle))(COMMAND=stop)(ARGUMENTS=64)(SERVICE=LISTENER )(VERSION=186647296)) * stop * 0
Thu Jan 07 07:26:44 2016
System parameter file is /u01/app/crs/network/admin/listener.ora
Log messages written to /u01/app/oracle/diag/tnslsnr/local/listener/alert/log.xml
Trace information written to /u01/app/oracle/diag/tnslsnr/local/listener/trace/ora_9570_1.trc
Trace level is currently 0

Started with pid=9570
Listening on: (DESCRIPTION=(ADDRESS=(PROTOCOL=ipc)(KEY=LISTENER)))
Listener completed notification to CRS on start

Scan listener logs:
==================
07-JAN-2016 07:25:40 * (CONNECT_DATA=(CID=(PROGRAM=)(HOST=local)(USER=oracle))(COMMAND=status)(ARGUMENTS=64)(SERVICE=LISTEN ER_SCAN1)(VERSION=186647296)) * status * 0
07-JAN-2016 07:25:40 * service_died * LsnrAgt * 12537
No longer listening on: (DESCRIPTION=(ADDRESS=(PROTOCOL=ipc)(KEY=LISTENER_SCAN1)))
No longer listening on: (DESCRIPTION=(ADDRESS=(PROTOCOL=tcp)(HOST=)(PORT=1521)))
Listener completed notification to CRS on stop
07-JAN-2016 07:25:40 * (CONNECT_DATA=(CID=(PROGRAM=)(HOST=local)(USER=oracle))(COMMAND=stop)(ARGUMENTS=64)(SERVICE=LISTENER _SCAN1)(VERSION=186647296)) * stop * 0
crsd.log
======================
RESOURCE_START[ora.scan1.vip 1 1] ID 4098:196089
2016-01-07 01:25:36.493: [ AGFW][41] {0:3:3531} Agfw Proxy Server forwarding the message: RESOURCE_START[ora.scan1.vip 1 1] ID 4098:196089 to the agent /u01/app/crs/bin/orarootagent_root
2016-01-07 01:25:36.576: [ AGFW][41] {0:3:3531} Received the reply to the message: RESOURCE_START[ora.cvu 1 1] ID 4098:159384 from the agent /u01/app/crs/bin/scriptagent_oracle
2016-01-07 01:25:36.576: [ AGFW][41] {0:3:3531} Agfw Proxy Server sending the reply to PE for message:RESOURCE_START[ora.cvu 1 1] ID 4098:196087
2016-01-07 01:25:36.623: [ AGFW][41] {0:3:3531} Received the reply to the message: RESOURCE_START[ora.cvu 1 1] ID 4098:159384 from the agent /u01/app/crs/bin/scriptagent_oracle
2016-01-07 01:25:36.624: [ AGFW][41] {0:3:3531} Agfw Proxy Server sending the last reply to PE for message:RESOURCE_START[ora.cvu 1 1] ID 4098:196087
2016-01-07 01:25:38.665: [ AGFW][41] {0:3:3531} Received the reply to the message: RESOURCE_START[ora.local.vip 1 1] ID 4098:159386 from the agent /u01/app/crs/bin/orarootagent_root
2016-01-07 01:25:38.666: [ AGFW][41] {0:3:3531} Agfw Proxy Server sending the reply to PE for message:RESOURCE_START[ora.ec2db2.vip 1 1] ID 4098:196088
2016-01-07 01:25:38.665: [ AGFW][41] {0:3:3531} Received the reply to the message: RESOURCE_START[ora.local.vip 1 1] ID 4098:159386 from the agent /u01/app/crs/bin/orarootagent_root
2016-01-07 01:25:38.666: [ AGFW][41] {0:3:3531} Agfw Proxy Server sending the reply to PE for message:RESOURCE_START[ora.ec2db2.vip 1 1] ID 4098:196088
2016-01-07 01:25:38.666: [ AGFW][41] {0:3:3531} Received the reply to the message: RESOURCE_START[ora.local.vip 1 1] ID 4098:159386 from the agent /u01/app/crs/bin/orarootagent_root
2016-01-07 01:25:38.667: [ AGFW][41] {0:3:3531} Agfw Proxy Server sending the last reply to PE for message:RESOURCE_START[ora.ec2db2.vip 1 1] ID 4098:196088
2016-01-07 01:25:39.695: [ AGFW][41] {0:3:3531} Received the reply to the message: RESOURCE_START[ora.scan1.vip 1 1] ID 4098:159388 from the agent /u01/app/crs/bin/orarootagent_root
2016-01-07 01:25:39.696: [ AGFW][41] {0:3:3531} Agfw Proxy Server sending the reply to PE for message:RESOURCE_START[ora.scan1.vip 1 1] ID 4098:196089
2016-01-07 01:25:39.696: [ AGFW][41] {0:3:3531} Received the reply to the message: RESOURCE_START[ora.scan1.vip 1 1] ID 4098:159388 from the agent /u01/app/crs/bin/orarootagent_root
2016-01-07 01:25:39.696: [ AGFW][41] {0:3:3531} Agfw Proxy Server sending the last reply to PE for message:RESOURCE_START[ora.scan1.vip 1 1] ID 4098:196089
2016-01-07 01:25:39.715: [ AGFW][41] {0:3:3531} Agfw Proxy Server received the message: RESOURCE_START[ora.LISTENER_SCAN1.lsnr 1 1] ID 4098:196102
2016-01-07 01:25:39.715: [ AGFW][41] {0:3:3531} Agfw Proxy Server forwarding the message: RESOURCE_START[ora.LISTENER_SCAN1.lsnr 1 1] ID 4098:196102 to the agent /u01/app/crs/bin/oraagent_oracle
2016-01-07 01:25:39.841: [UiServer][48] CS(103d5d410)set Properties ( oracle,1045be490)
2016-01-07 01:25:39.852: [UiServer][47] {1:39918:3863} Container [ Name: UI_START
2016-01-07 01:25:39.852: [UiServer][47] {1:39918:3863} Sending message to PE. ctx= 104382550, Client PID: 39444
2016-01-07 01:25:39.860: [UiServer][47] {1:39918:3863} Container [ Name: ORDER
MESSAGE:
TextMessage[CRS-2545: Cannot operate on 'ora.LISTENER_SCAN1.lsnr'. It is locked by 'SYSTEM' for command 'Unplanned Resource State Change : ora.net1.network']
MSGTYPE:
TextMessage[1]
OBJID:
TextMessage[ora.LISTENER_SCAN1.lsnr]
WAIT:
TextMessage[0]
]