Patch apply failing!

Hi, I am trying to apply a patch to fix a bug for agent (10203)and it is failing with the errors ,HP-UX 11.1 , and read the read me doc and its not saying anything about taking down the agent but i took it down as it was complaining about agent process being busy so had to take it down any way here is the error.

ApplySession adding interim patch '5854190' to inventory

Verifying the update...
Inventory check OK: Patch ID 5854190 is registered in Oracle Home inventory with proper meta-data.
Files check OK: Files from Patch ID 5854190 are present in Oracle Home.
Running make for target client_sharedlib
Make failed to invoke "/usr/ccs/bin/make -f ins_rdbms.mk client_sharedlib ORACLE_HOME=/oracle/product/agent10g/agent10g"....'Make: Cannot load /oracle/product/agent10g/agent10g/bin/genoccish. Stop.

Stop.
'

The following make actions have failed :

Re-link fails on target "client_sharedlib".

--------------------------------------------------------------------------------
Failed to run make commands in file '/oracle/product/agent10g/agent10g/.patch_storage/5854190_May_8_2007_04_48_06/make.txt'
Invoke these commands manually to restore the binaries in the Oracle Home.
OPatch failed to restore OH '/oracle/product/agent10g/agent10g'. Consult OPatch document to restore the home manually before proceeding.
--------------------------------------------------------------------------------
The following warnings have occurred during OPatch execution:
1) OUI-67200:Make failed to invoke "/usr/ccs/bin/make -f ins_rdbms.mk client_sharedlib ORACLE_HOME=/oracle/product/agent10g/agent10g"....'Make: Cannot load /oracle/product/agent10g/agent10g/bin/genoccish. Stop.

Stop.
'
2) OUI-67124:Re-link fails on target "client_sharedlib".

3) OUI-67200:Make failed to invoke "/usr/ccs/bin/make -f ins_rdbms.mk client_sharedlib ORACLE_HOME=/oracle/product/agent10g/agent10g"....'Make: Cannot load /oracle/product/agent10g/agent10g/bin/genoccish. Stop.

Stop.
-----------------------------------------------------------------

$ opatch rollback -id 5854190
Invoking OPatch 10.2.0.3.0

Oracle interim Patch Installer version 10.2.0.3.0
Copyright (c) 2005, Oracle Corporation. All rights reserved..


Oracle Home : /oracle/product/agent10g/agent10g
Central Inventory : /oracle/oraInventory
from : /var/opt/oracle/oraInst.loc
OPatch version : 10.2.0.3.0
OUI version : 10.2.0.3.0
OUI location : /oracle/product/agent10g/agent10g//oui
Log file location : /oracle/product/agent10g/agent10g/cfgtoollogs/opatch/opatch2007-12-07_21-12-46PM.log

RollbackSession rolling back interim patch '5854190' from OH '/oracle/product/agent10g/agent10g'
RollbackSession failed: Interim patch 5854190 does not exist in this Oracle Home inventory.
System intact, OPatch will not attempt to restore the system





Please let me know what needs to be done ?

Hi

Post the contents of ins_rdbms.mk something strange with it i think.

regards
Hrishy

Sorry, but how and where to see the contents of ins_rdbms.mk from?its an patch to be applied against $AGENT_HOME.

Attached are the contents of ins_rdbms.mk

Hi

Try commenting this line in the mk file

$(GENOCCISH)

make it as
#$(GENOCCISH)

and try again.

I am not very sure if the make file is right

regards
Hrishy

Thank you sir!

Hrishy after taking agent down and re-applying the patch it succeeded,thank you very much sir!

HIi ,after applying the agent patch(5854190) i need to apply rdbms(5868695) patch, the following are the errors i am getting
$ export ORACLE_HOME=/u01/OID
$ export PATH=$ORACLE_HOME/bin:$ORACLE_HOME/OPatch:$PATH:.
$ opatch lsinventory

Oracle Interim Patch Installer version 1.0.0.0.52
Copyright (c) 2005 Oracle Corporation. All Rights Reserved..

We recommend you refer to the OPatch documentation under
OPatch/docs for usage reference. We also recommend using
the latest OPatch version. For the latest OPatch version
and other support related issues, please refer to document
293369.1 which is viewable from metalink.oracle.com

Oracle Home = /u01/OID
Location of Oracle Universal Installer components = /u01/OID/oui
Location of OraInstaller.jar = "/u01/OID/oui/jlib"
Oracle Universal Installer shared library = /u01/OID/oui/lib/hpunix/liboraInstaller.sl
Location of Oracle Inventory Pointer = /var/opt/oracle/oraInst.loc
Location of Oracle Inventory = /u01/OID/inventory
Path to Java = /u01/OID/jre/1.4.2/bin/java
Log file = /u01/OID/.patch_storage//*.log

/usr/lib/dld.sl: Call to mmap() failed - TEXT /u01/OID/jre/1.4.2/lib/PA_RISC2.0/server/libjvm.sl
/usr/lib/dld.sl: Permission denied
sh: 29617 Abort(coredump)
Creating log file "/u01/OID/.patch_storage/LsInventory__12-11-2007_15-47-01.log"

/usr/lib/dld.sl: Call to mmap() failed - TEXT /u01/OID/jre/1.4.2/lib/PA_RISC2.0/server/libjvm.sl
/usr/lib/dld.sl: Permission denied
sh: 29624 Abort(coredump)
Result:



OPatch succeeded.

I changed the permission on /u01/OID/jre/1.4.2/lib/PA_RISC2.0/server/libjvm.sl and /u01/OID/jre/1.4.2/lib/PA_RISC2.0/native_threads/libhpi.sl to 755 and now i am getting this error

$ opatch lsinventory

Oracle Interim Patch Installer version 1.0.0.0.52
Copyright (c) 2005 Oracle Corporation. All Rights Reserved..

We recommend you refer to the OPatch documentation under
OPatch/docs for usage reference. We also recommend using
the latest OPatch version. For the latest OPatch version
and other support related issues, please refer to document
293369.1 which is viewable from metalink.oracle.com

Oracle Home = /u01/OID
Location of Oracle Universal Installer components = /u01/OID/oui
Location of OraInstaller.jar = "/u01/OID/oui/jlib"
Oracle Universal Installer shared library = /u01/OID/oui/lib/hpunix/liboraInstaller.sl
Location of Oracle Inventory Pointer = /var/opt/oracle/oraInst.loc
Location of Oracle Inventory = /u01/OID/inventory
Path to Java = /u01/OID/jre/1.4.2/bin/java
Log file = /u01/OID/.patch_storage//*.log

Creating log file "/u01/OID/.patch_storage/LsInventory__12-11-2007_16-25-29.log"

Result:

Error occurred during initialization of VM
Unable to load native library: permission denied.

Hi

./emctl stop agent

cd $ORACLE_HOME/sysman/lib

and then relink the agent

make -f ins_emagent.mk agent

and then run the root.sh script from oracle home
$./root.sh

and the start the agent again

./emctl start agent

then try using opatch again.

Get a help of a DBA to do this.

regards
Hrishy

I applied the agent patch successfully after commenting out $GENOCCISH as suggested by you but now when i am about to apply the RDBMS patch i set my environment export ORACLE_HOME=/u01/OID(RDBMS OH) which is different from my agent OH(/oracle/product/agent10g/agent10g) export PATH=$PATH:$ORACLE_HOME/bin:$ORACLE_HOME/OPatch:.
and did opatch lsinventory thats when i got this error.

Error occurred during initialization of VM
Unable to load native library: permission denied.

Now when you say i need to relink the agent i am kind of confused as this is RDBM patch which needs to be run against its OH ,so please clarify it

Quote:

---

./emctl stop agent

cd $ORACLE_HOME/sysman/lib

and then relink the agent

make -f ins_emagent.mk agent

and then run the root.sh script from oracle home
$./root.sh

and the start the agent again

./emctl start agent

then try using opatch again.

---

what should be my OH when applying RDBMS patch i think it should be rdbms OH ?please can you clarify on this

sorry if i did't put my question clear to you earlier, I am not doing opatch lsinventory against agent OH( /oracle/product/agent10g/agent10g),i am done with the agent patch .

$ opatch lsinventory
Invoking OPatch 10.2.0.3.0

Oracle interim Patch Installer version 10.2.0.3.0
Copyright (c) 2005, Oracle Corporation. All rights reserved..


Oracle Home : /oracle/product/agent10g/agent10g
Central Inventory : /oracle/oraInventory
from : /var/opt/oracle/oraInst.loc
OPatch version : 10.2.0.3.0
OUI version : 10.2.0.3.0
OUI location : /oracle/product/agent10g/agent10g//oui
Log file location : /oracle/product/agent10g/agent10g/cfgtoollogs/opatch/opatch2007-12-12_19-25-19PM.log

Lsinventory Output file location : /oracle/product/agent10g/agent10g/cfgtoollogs/opatch/lsinv/lsinventory2007-12-12_19-25-19PM.txt

--------------------------------------------------------------------------------
Installed Top-level Products (1):

Oracle Management Agent 10.2.0.3.0
There are 1 products installed in this Oracle Home.


Interim patches (1) :

Patch 5854190 : applied on Tue Dec 11 15:41:22 GMT 2007
Created on 8 May 2007, 04:48:06 hrs US/Pacific
Bugs fixed:
5854190


--------------------------------------------------------------------------------

OPatch succeeded.

And now i am ready to patch(5868695) RDBMS OH and here are my commands
export ORACLE_HOME=/u01/OID
export PATH=$ORACLE_HOME/bin:$ORACLE_HOME/OPATCH:$PATH:.

$ opatch lsinventory

Oracle Interim Patch Installer version 1.0.0.0.52
Copyright (c) 2005 Oracle Corporation. All Rights Reserved..

We recommend you refer to the OPatch documentation under
OPatch/docs for usage reference. We also recommend using
the latest OPatch version. For the latest OPatch version
and other support related issues, please refer to document
293369.1 which is viewable from metalink.oracle.com

Oracle Home = /u01/OID
Location of Oracle Universal Installer components = /u01/OID/oui
Location of OraInstaller.jar = "/u01/OID/oui/jlib"
Oracle Universal Installer shared library = /u01/OID/oui/lib/hpunix/liboraInstaller.sl
Location of Oracle Inventory Pointer = /var/opt/oracle/oraInst.loc
Location of Oracle Inventory = /u01/OID/inventory
Path to Java = /u01/OID/jre/1.4.2/bin/java
Log file = /u01/OID/.patch_storage//*.log

Creating log file "/u01/OID/.patch_storage/LsInventory__12-12-2007_18-37-55.log"

Result:

Error occurred during initialization of VM
Unable to load native library: permission denied.

Please let me know as i am stuck with this.

Regards

Hi

Try running root.sh from oracle home as user root.

regards
Hrishy

I ran root.sh from OH(/amoidts1/OID) successfully ,but again when i did opatch lsinventory same error.

Hi

What are the contents of this logfile

"/u01/OID/.patch_storage/LsInventory__12-12-2007_18-37-55.log

regards
Hrishy

I even downloaded the new opatch version for 10105(1.0.0.0.57),here are the contents

Creating log file "/u01/OID/.patch_storage/LsInventory__12-13-2007_15-13-31.log"


Accessing inventory ... (retry 10 times, delay 30 seconds each time)

Invoking command "/u01/OID/jre/1.4.2/bin/java -classpath "/u01/OID/oui/jlib/OraInstaller.jar:/u01/OID/oui/jlib/srvm.jar:/u01/OID/OPatch/jlib/opatch.jar:/u01/OID/oui/jlib/xmlparserv2.jar:/u01/OID/oui/jlib/share.jar" -Doracle.installer.invPtrLoc=/var/opt/oracle/oraInst.loc -Dopatch.retry=10 -Dopatch.delay=30 opatch/LsInventory "/u01/OID/oui" "/u01/OID" opatch.pl 1.0.0.0.57 FALSE FALSE FALSE /var/opt/oracle/oraInst.loc"
Result:

Error occurred during initialization of VM
Unable to load native library: permission denied.


OPatch succeeded.
~

Hi

Whats the permissions on this file

/u01/OID/jre/1.4.2/lib/PA_RISC2.0/server/libjvm.sl

regards
Hrishy

Check permission on $ORACLE_HOME

I changed permission on this file earlier it was 600 and changed it to 755.

$ ll /u01/OID/jre/1.4.2/lib/PA_RISC2.0/server/libjvm.sl
-rwx------ 1 oracle dba 15409152 Nov 30 21:37 /u01/OID/jre/1.4.2/lib/PA_RISC2.0/server/libjvm.sl

Hi

Whats the output of SHLIB_PATH ?

regards
Hrishy

I set up these following environment variables during installation of the OID at session level.
SHLIB_PATH=$ORACLE_HOME/lib64:/usr/lib
LD_LIBRARY_PATH=$ORACLE_HOME/lib64:/usr/lib

Hi

Is your oracle binaries 64 bit ?

regards
Hrishy

$ env|grep ORA
ORACLE_BASE=/u01
ORACLE_SID=test1
ORACLE_ADMIN=/u01/admin
ORACLE_HOME=/u01/OID

$ export ORACLE_SID=test1
$ sqlplus '/ as sysdba'

SQL*Plus: Release 10.1.0.5.0 - Production on Mon Dec 17 19:09:39 2007

Copyright (c) 1982, 2005, Oracle. All rights reserved.


Connected to:
Oracle Database 10g Enterprise Edition Release 10.1.0.5.0 - 64bit Production
With the Partitioning, OLAP and Data Mining options

SQL> show parameter instance

NAME TYPE VALUE
------------------------------------ ----------- ------------------------------
active_instance_count integer
cluster_database_instances integer 1
instance_groups string
instance_name string test1
instance_number integer 0
instance_type string RDBMS
open_links_per_instance integer 4
parallel_instance_group string
parallel_server_instances integer 1

Hi

I am taking a wild guess here .

Can you go to $ORACLE_HOME/bin and then do a
relink all

and then try doing OPatch lsinventory and see what happens.

regards
Hrishy

Hi Hrishy ,I did relinked all this morning by taking everything down(databases,listeners,agents etc..) from the OH but getting same error ,here is the relink_lib.txt file attached.

Hi

Whats the permission on this file

libclntsh.sl.10.1

/u01/OID/lib/libclntsh.sl.10.1

regards
Hrishy

$ ll /u01/OID/lib/libclntsh.sl.10.1
-rwxr-x--x 1 oracle dba 19772920 Nov 30 21:53 /u01/OID/lib/libclntsh.sl.10.1