Hitachi SAN compatible with RAC ?

CRS install has been failing on the raw partition from the Hitachi SAN. Hitachi has no internal people with RAC experience on their SAN and cannot come up with even one customer using RAC.

Has anybody been successful with HDS-500 and RAC ?

Thank you

We've got a a 10gR1, 2-nodes RAC install on a Hitachi Thunder V9520 disk array and had no problem configuring the raw partitions.

Did you follow the install guide religiously ?

If so, first look up on metalink for your issue, and if you find nothing interesting, open a TAR with Oracle.

You can also give us some more details about the error you are getting. Maybe someone will have experienced the exact same problem. :)

BTW are you sure about the model ? I find nothing about a Hitachi "HDS-500" disk array...

Regards,

rbaraer

Thanks.

I have an SR open with Oracle and am trying to involve Hitachi support.

CRS install bombs during root.sh

Code:

---

[root@dr2db2 ~]# /orahome/app/oracle/product/10.1.2.0.2/CRS/root.sh
WARNING: directory '/orahome/app/oracle/product/10.1.2.0.2' is not owned by
root
WARNING: directory '/orahome/app/oracle/product' is not owned by root
WARNING: directory '/orahome/app/oracle' is not owned by root
WARNING: directory '/orahome/app' is not owned by root
Checking to see if Oracle CRS stack is already configured
/etc/oracle does not exist. Creating it now.

Setting the permissions on OCR backup directory
Setting up NS directories
Failed to upgrade Oracle Cluster Registry configuration

---

Code:

---



DATA COLLECTED
===============
LOG FILE
---------------
Filename =ocrconfig_11136.log:
=========================

Oracle Database 10g CRS Release 10.2.0.1.0 Production Copyright 1996, 2005 Oracle. All rights reserved.
2006-08-15 15:41:17.819: [ OCRCONF][48611328]ocrconfig starts...
2006-08-15 15:41:17.819: [ OCRCONF][48611328]Upgrading OCR data
2006-08-15 15:41:17.887: [ OCRRAW][48611328]propriogid:1: INVALID FORMAT
2006-08-15 15:41:17.888: [ OCRRAW][48611328]ibctx:1:ERROR: INVALID FORMAT
2006-08-15 15:41:17.888: [ OCRRAW][48611328]proprinit:problem reading the bootblock or superbloc 22

2006-08-15 15:41:17.888: [ default][48611328]a_init:7!: Backend init unsuccessful : [22]
2006-08-15 15:41:17.889: [ OCRCONF][48611328]Exporting OCR data to [OCRUPGRADEFILE]
2006-08-15 15:41:17.889: [ OCRAPI][48611328]a_init:7!: Backend init unsuccessful : [33]
2006-08-15 15:41:17.889: [ OCRCONF][48611328]There was no previous version of OCR. error:[PROC-33
: Oracle Cluster Registry is not configured]
2006-08-15 15:41:17.894: [ OCRRAW][48611328]propriogid:1: INVALID FORMAT
2006-08-15 15:41:17.894: [ OCRRAW][48611328]ibctx:1:ERROR: INVALID FORMAT
2006-08-15 15:41:17.894: [ OCRRAW][48611328]proprinit:problem reading the bootblock or superbloc 22

2006-08-15 15:41:17.894: [ default][48611328]a_init:7!: Backend init unsuccessful : [22]
2006-08-15 15:41:17.900: [ OCRRAW][48611328]propriogid:1: INVALID FORMAT
2006-08-15 15:41:17.900: [ OCRRAW][48611328]ibctx:1:ERROR: INVALID FORMAT
2006-08-15 15:41:17.900: [ OCRRAW][48611328]proprinit:problem reading the bootblock or superbloc 22

2006-08-15 15:41:17.905: [ OCRRAW][48611328]propriogid:1: INVALID FORMAT
2006-08-15 15:41:17.918: [ OCRRAW][48611328]propriowv: Vote information on disk 0 [/dev/r
aw/raw2] is adjusted from [0/0] to [2/2]
2006-08-15 15:41:17.923: [ OCRRAW][48611328]propriniconfig:No 92 configuration
2006-08-15 15:41:17.924: [ OCRAPI][48611328]a_init:6a: Backend init successful
2006-08-15 15:41:17.945: [ OCRCONF][48611328]Initialized DATABASE keys in OCR
2006-08-15 15:41:17.961: [ OCRCONF][48611328]csetskgfrblock0: clsfmt returned with error [4].
2006-08-15 15:41:17.961: [ OCRCONF][48611328]Failure in setting block0 [-1]
2006-08-15 15:41:17.961: [ OCRCONF][48611328]OCR block 0 is not set !
2006-08-15 15:41:17.962: [ OCRCONF][48611328]Exiting [status=failed]...

---

I'll get the correct model number at the shop this morning..

have you run the cluster verification utility?

CVU does not like the raw partitions. It says they are 'not shared'.

However Oracle says that the CVU has trouble recognizing SAN partitions and to proceed with the install of CRS.

Also I doubt very much its a shared problem. This root.sh cannot even run on the install node, let alone the other node. The errors are related to format and unexpected return code so I think the CVU is not helpful here.

Its a Hitachi ASM 500. Sorry about that HDS business, I get these Italian SANs all mixed up :D

Oracle gave me a patch that allowed us to format the OCR and voting disk. Now the problem may just be I need to run root.sh on node1 or wipe both clean and start fresh.

Devices formatted, now we need to get the CRS daemon up and running on both nodes..

[root@dr2db2 ~]# dd if=/dev/zero of=/dev/raw/raw2 bs=1048576 count=1000
1000+0 records in
1000+0 records out
[root@dr2db2 ~]# /orahome/app/oracle/product/10.1.2.0.2/CRS/root.sh
WARNING: directory '/orahome/app/oracle/product/10.1.2.0.2' is not owned by root
WARNING: directory '/orahome/app/oracle/product' is not owned by root
WARNING: directory '/orahome/app/oracle' is not owned by root
WARNING: directory '/orahome/app' is not owned by root
Checking to see if Oracle CRS stack is already configured

Setting the permissions on OCR backup directory
Setting up NS directories
Oracle Cluster Registry configuration upgraded successfully
WARNING: directory '/orahome/app/oracle/product/10.1.2.0.2' is not owned by root
WARNING: directory '/orahome/app/oracle/product' is not owned by root
WARNING: directory '/orahome/app/oracle' is not owned by root
WARNING: directory '/orahome/app' is not owned by root
Successfully accumulated necessary OCR keys.
Using ports: CSS=49895 CRS=49896 EVMC=49898 and EVMR=49897.
node :
node 1: dr2db2 dr2db2-eth2 dr2db2
node 2: dr2db1 dr2db1-eth2 dr2db1
Creating OCR keys for user 'root', privgrp 'root'..
Operation successful.
Now formatting voting device: /dev/raw/raw6
Format of 1 voting devices complete.
Startup will be queued to init within 90 seconds.
Adding daemons to inittab
Expecting the CRS daemons to be up within 600 seconds.
CSS is active on these nodes.
dr2db2
CSS is inactive on these nodes.
dr2db1
Local node checking complete.
Run root.sh on remaining nodes to start CRS daemons.

[root@dr2db2 ~]# ps -ef | grep ora
root 6572 2526 0 13:39 ? 00:00:00 sshd: oracle [priv]
oracle 6574 6572 0 13:39 ? 00:00:00 sshd: oracle@pts/1
oracle 6575 6574 0 13:39 pts/1 00:00:00 -bash
root 14172 2526 0 17:54 ? 00:00:00 sshd: oracle [priv]
oracle 14176 14172 0 17:55 ? 00:00:00 sshd: oracle@pts/2
oracle 14177 14176 0 17:55 pts/2 00:00:00 -bash
root 14682 1 0 17:57 ? 00:00:00 /bin/su -l oracle -c sh -c 'ulimit -c unlimited; cd /orahome/app/oracle/product/10.1.2.0.2/CRS/log/dr2db2/evmd; exec /orahome/app/oracle/product/10.1.2.0.2/CRS/bin/evmd '
root 14686 1 0 17:57 ? 00:00:00 /orahome/app/oracle/product/10.1.2.0.2/CRS/bin/crsd.bin reboot
oracle 14959 14682 0 17:58 ? 00:00:00 /orahome/app/oracle/product/10.1.2.0.2/CRS/bin/evmd.bin
root 15018 14942 0 17:58 ? 00:00:00 /bin/su -l oracle -c /bin/sh -c 'ulimit -c unlimited; cd /orahome/app/oracle/product/10.1.2.0.2/CRS/log/dr2db2/cssd; /orahome/app/oracle/product/10.1.2.0.2/CRS/bin/ocssd || exit $?'
oracle 15021 15018 0 17:58 ? 00:00:00 /bin/sh -c ulimit -c unlimited; cd /orahome/app/oracle/product/10.1.2.0.2/CRS/log/dr2db2/cssd; /orahome/app/oracle/product/10.1.2.0.2/CRS/bin/ocssd || exit $?
oracle 15057 15021 0 17:58 ? 00:00:00 /orahome/app/oracle/product/10.1.2.0.2/CRS/bin/ocssd.bin
root 15996 14206 0 17:59 pts/2 00:00:00 grep ora


crs_setperm crs_setperm.bin crs_start crs_start.bin crs_stat crs_stat.bin crs_stop crs_stop.bin
[root@dr2db2 ~]# /orahome/app/oracle/product/10.1.2.0.2/CRS/bin/crs_stat -t
CRS-0184: Cannot communicate with the CRS daemon.


on next node

[root@dr2db1 ~]# /orahome/app/oracle/product/10.1.2.0.2/CRS/root.sh
WARNING: directory '/orahome/app/oracle/product/10.1.2.0.2' is not owned by root
WARNING: directory '/orahome/app/oracle/product' is not owned by root
WARNING: directory '/orahome/app/oracle' is not owned by root
WARNING: directory '/orahome/app' is not owned by root
Checking to see if Oracle CRS stack is already configured
/etc/oracle does not exist. Creating it now.

Setting the permissions on OCR backup directory
Setting up NS directories
Oracle Cluster Registry configuration upgraded successfully
WARNING: directory '/orahome/app/oracle/product/10.1.2.0.2' is not owned by root
WARNING: directory '/orahome/app/oracle/product' is not owned by root
WARNING: directory '/orahome/app/oracle' is not owned by root
WARNING: directory '/orahome/app' is not owned by root
/orahome/app/oracle/product/10.1.2.0.2/CRS/bin/crsctl.bin: error while loading shared libraries: libstdc++.so.5: cannot open shared object file: No such file or directory
Failure initializing entries in /etc/oracle/scls_scr/dr2db1.


I think whats needed is a clean install.