Hitachi SAN compatible with RAC ?
DBAsupport.com Forums - Powered by vBulletin
Results 1 to 7 of 7

Thread: Hitachi SAN compatible with RAC ?

  1. #1
    Join Date
    May 2005
    Posts
    129

    Hitachi SAN compatible with RAC ?

    CRS install has been failing on the raw partition from the Hitachi SAN. Hitachi has no internal people with RAC experience on their SAN and cannot come up with even one customer using RAC.

    Has anybody been successful with HDS-500 and RAC ?

    Thank you

  2. #2
    Join Date
    May 2005
    Location
    France
    Posts
    34
    We've got a a 10gR1, 2-nodes RAC install on a Hitachi Thunder V9520 disk array and had no problem configuring the raw partitions.

    Did you follow the install guide religiously ?

    If so, first look up on metalink for your issue, and if you find nothing interesting, open a TAR with Oracle.

    You can also give us some more details about the error you are getting. Maybe someone will have experienced the exact same problem.

    BTW are you sure about the model ? I find nothing about a Hitachi "HDS-500" disk array...

    Regards,

    rbaraer

  3. #3
    Join Date
    May 2005
    Posts
    129
    Thanks.

    I have an SR open with Oracle and am trying to involve Hitachi support.

    CRS install bombs during root.sh

    Code:
    [root@dr2db2 ~]# /orahome/app/oracle/product/10.1.2.0.2/CRS/root.sh
    WARNING: directory '/orahome/app/oracle/product/10.1.2.0.2' is not owned by
    root
    WARNING: directory '/orahome/app/oracle/product' is not owned by root
    WARNING: directory '/orahome/app/oracle' is not owned by root
    WARNING: directory '/orahome/app' is not owned by root
    Checking to see if Oracle CRS stack is already configured
    /etc/oracle does not exist. Creating it now.
    
    Setting the permissions on OCR backup directory
    Setting up NS directories
    Failed to upgrade Oracle Cluster Registry configuration
    Code:
    
    DATA COLLECTED
    ===============
    LOG FILE
    ---------------
    Filename =ocrconfig_11136.log:
    =========================
    
    Oracle Database 10g CRS Release 10.2.0.1.0 Production Copyright 1996, 2005 Oracle. All rights reserved.
    2006-08-15 15:41:17.819: [ OCRCONF][48611328]ocrconfig starts...
    2006-08-15 15:41:17.819: [ OCRCONF][48611328]Upgrading OCR data
    2006-08-15 15:41:17.887: [ OCRRAW][48611328]propriogid:1: INVALID FORMAT
    2006-08-15 15:41:17.888: [ OCRRAW][48611328]ibctx:1:ERROR: INVALID FORMAT
    2006-08-15 15:41:17.888: [ OCRRAW][48611328]proprinit:problem reading the bootblock or superbloc 22
    
    2006-08-15 15:41:17.888: [ default][48611328]a_init:7!: Backend init unsuccessful : [22]
    2006-08-15 15:41:17.889: [ OCRCONF][48611328]Exporting OCR data to [OCRUPGRADEFILE]
    2006-08-15 15:41:17.889: [ OCRAPI][48611328]a_init:7!: Backend init unsuccessful : [33]
    2006-08-15 15:41:17.889: [ OCRCONF][48611328]There was no previous version of OCR. error:[PROC-33
    : Oracle Cluster Registry is not configured]
    2006-08-15 15:41:17.894: [ OCRRAW][48611328]propriogid:1: INVALID FORMAT
    2006-08-15 15:41:17.894: [ OCRRAW][48611328]ibctx:1:ERROR: INVALID FORMAT
    2006-08-15 15:41:17.894: [ OCRRAW][48611328]proprinit:problem reading the bootblock or superbloc 22
    
    2006-08-15 15:41:17.894: [ default][48611328]a_init:7!: Backend init unsuccessful : [22]
    2006-08-15 15:41:17.900: [ OCRRAW][48611328]propriogid:1: INVALID FORMAT
    2006-08-15 15:41:17.900: [ OCRRAW][48611328]ibctx:1:ERROR: INVALID FORMAT
    2006-08-15 15:41:17.900: [ OCRRAW][48611328]proprinit:problem reading the bootblock or superbloc 22
    
    2006-08-15 15:41:17.905: [ OCRRAW][48611328]propriogid:1: INVALID FORMAT
    2006-08-15 15:41:17.918: [ OCRRAW][48611328]propriowv: Vote information on disk 0 [/dev/r
    aw/raw2] is adjusted from [0/0] to [2/2]
    2006-08-15 15:41:17.923: [ OCRRAW][48611328]propriniconfig:No 92 configuration
    2006-08-15 15:41:17.924: [ OCRAPI][48611328]a_init:6a: Backend init successful
    2006-08-15 15:41:17.945: [ OCRCONF][48611328]Initialized DATABASE keys in OCR
    2006-08-15 15:41:17.961: [ OCRCONF][48611328]csetskgfrblock0: clsfmt returned with error [4].
    2006-08-15 15:41:17.961: [ OCRCONF][48611328]Failure in setting block0 [-1]
    2006-08-15 15:41:17.961: [ OCRCONF][48611328]OCR block 0 is not set !
    2006-08-15 15:41:17.962: [ OCRCONF][48611328]Exiting [status=failed]...
    I'll get the correct model number at the shop this morning..
    Last edited by roadwarriorDBA; 08-22-2006 at 09:37 AM.

  4. #4
    Join Date
    Jun 2000
    Location
    Madrid, Spain
    Posts
    7,447
    have you run the cluster verification utility?

  5. #5
    Join Date
    May 2005
    Posts
    129
    CVU does not like the raw partitions. It says they are 'not shared'.

    However Oracle says that the CVU has trouble recognizing SAN partitions and to proceed with the install of CRS.

    Also I doubt very much its a shared problem. This root.sh cannot even run on the install node, let alone the other node. The errors are related to format and unexpected return code so I think the CVU is not helpful here.

  6. #6
    Join Date
    May 2005
    Posts
    129
    Its a Hitachi ASM 500. Sorry about that HDS business, I get these Italian SANs all mixed up

  7. #7
    Join Date
    May 2005
    Posts
    129
    Oracle gave me a patch that allowed us to format the OCR and voting disk. Now the problem may just be I need to run root.sh on node1 or wipe both clean and start fresh.

    Devices formatted, now we need to get the CRS daemon up and running on both nodes..

    [root@dr2db2 ~]# dd if=/dev/zero of=/dev/raw/raw2 bs=1048576 count=1000
    1000+0 records in
    1000+0 records out
    [root@dr2db2 ~]# /orahome/app/oracle/product/10.1.2.0.2/CRS/root.sh
    WARNING: directory '/orahome/app/oracle/product/10.1.2.0.2' is not owned by root
    WARNING: directory '/orahome/app/oracle/product' is not owned by root
    WARNING: directory '/orahome/app/oracle' is not owned by root
    WARNING: directory '/orahome/app' is not owned by root
    Checking to see if Oracle CRS stack is already configured

    Setting the permissions on OCR backup directory
    Setting up NS directories
    Oracle Cluster Registry configuration upgraded successfully
    WARNING: directory '/orahome/app/oracle/product/10.1.2.0.2' is not owned by root
    WARNING: directory '/orahome/app/oracle/product' is not owned by root
    WARNING: directory '/orahome/app/oracle' is not owned by root
    WARNING: directory '/orahome/app' is not owned by root
    Successfully accumulated necessary OCR keys.
    Using ports: CSS=49895 CRS=49896 EVMC=49898 and EVMR=49897.
    node :
    node 1: dr2db2 dr2db2-eth2 dr2db2
    node 2: dr2db1 dr2db1-eth2 dr2db1
    Creating OCR keys for user 'root', privgrp 'root'..
    Operation successful.
    Now formatting voting device: /dev/raw/raw6
    Format of 1 voting devices complete.
    Startup will be queued to init within 90 seconds.
    Adding daemons to inittab
    Expecting the CRS daemons to be up within 600 seconds.
    CSS is active on these nodes.
    dr2db2
    CSS is inactive on these nodes.
    dr2db1
    Local node checking complete.
    Run root.sh on remaining nodes to start CRS daemons.

    [root@dr2db2 ~]# ps -ef | grep ora
    root 6572 2526 0 13:39 ? 00:00:00 sshd: oracle [priv]
    oracle 6574 6572 0 13:39 ? 00:00:00 sshd: oracle@pts/1
    oracle 6575 6574 0 13:39 pts/1 00:00:00 -bash
    root 14172 2526 0 17:54 ? 00:00:00 sshd: oracle [priv]
    oracle 14176 14172 0 17:55 ? 00:00:00 sshd: oracle@pts/2
    oracle 14177 14176 0 17:55 pts/2 00:00:00 -bash
    root 14682 1 0 17:57 ? 00:00:00 /bin/su -l oracle -c sh -c 'ulimit -c unlimited; cd /orahome/app/oracle/product/10.1.2.0.2/CRS/log/dr2db2/evmd; exec /orahome/app/oracle/product/10.1.2.0.2/CRS/bin/evmd '
    root 14686 1 0 17:57 ? 00:00:00 /orahome/app/oracle/product/10.1.2.0.2/CRS/bin/crsd.bin reboot
    oracle 14959 14682 0 17:58 ? 00:00:00 /orahome/app/oracle/product/10.1.2.0.2/CRS/bin/evmd.bin
    root 15018 14942 0 17:58 ? 00:00:00 /bin/su -l oracle -c /bin/sh -c 'ulimit -c unlimited; cd /orahome/app/oracle/product/10.1.2.0.2/CRS/log/dr2db2/cssd; /orahome/app/oracle/product/10.1.2.0.2/CRS/bin/ocssd || exit $?'
    oracle 15021 15018 0 17:58 ? 00:00:00 /bin/sh -c ulimit -c unlimited; cd /orahome/app/oracle/product/10.1.2.0.2/CRS/log/dr2db2/cssd; /orahome/app/oracle/product/10.1.2.0.2/CRS/bin/ocssd || exit $?
    oracle 15057 15021 0 17:58 ? 00:00:00 /orahome/app/oracle/product/10.1.2.0.2/CRS/bin/ocssd.bin
    root 15996 14206 0 17:59 pts/2 00:00:00 grep ora


    crs_setperm crs_setperm.bin crs_start crs_start.bin crs_stat crs_stat.bin crs_stop crs_stop.bin
    [root@dr2db2 ~]# /orahome/app/oracle/product/10.1.2.0.2/CRS/bin/crs_stat -t
    CRS-0184: Cannot communicate with the CRS daemon.


    on next node

    [root@dr2db1 ~]# /orahome/app/oracle/product/10.1.2.0.2/CRS/root.sh
    WARNING: directory '/orahome/app/oracle/product/10.1.2.0.2' is not owned by root
    WARNING: directory '/orahome/app/oracle/product' is not owned by root
    WARNING: directory '/orahome/app/oracle' is not owned by root
    WARNING: directory '/orahome/app' is not owned by root
    Checking to see if Oracle CRS stack is already configured
    /etc/oracle does not exist. Creating it now.

    Setting the permissions on OCR backup directory
    Setting up NS directories
    Oracle Cluster Registry configuration upgraded successfully
    WARNING: directory '/orahome/app/oracle/product/10.1.2.0.2' is not owned by root
    WARNING: directory '/orahome/app/oracle/product' is not owned by root
    WARNING: directory '/orahome/app/oracle' is not owned by root
    WARNING: directory '/orahome/app' is not owned by root
    /orahome/app/oracle/product/10.1.2.0.2/CRS/bin/crsctl.bin: error while loading shared libraries: libstdc++.so.5: cannot open shared object file: No such file or directory
    Failure initializing entries in /etc/oracle/scls_scr/dr2db1.


    I think whats needed is a clean install.

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •  



Click Here to Expand Forum to Full Width