DBAsupport.com Forums - Powered by vBulletin
Page 1 of 2 12 LastLast
Results 1 to 10 of 11

Thread: Speaking of bad disk setups *sigh*

Hybrid View

  1. #1
    Join Date
    Jul 2000
    Location
    Oxford, OH
    Posts
    117
    Ok guys and gals,

    I have the current disk setup

    Service Processor 0
    ======================================
    LUN 0 - 2 32 GB DRIVES IN RAID 1
    LUN 2 - 2 32 GB DRIVES IN RAID 1
    LUN 4 - 5 32 GB DRIVES IN RAID 5
    LUN 6 - 5 32 GB DRIVES IN RAID 5

    Service Processor 1
    ======================================
    LUN 1 - 2 32 GB DRIVES IN RAID 1
    LUN 3 - 2 32 GB DRIVES IN RAID 1
    LUN 5 - 5 32 GB DRIVES IN RAID 5
    LUN 7 - 5 32 GB DRIVES IN RAID 5

    My filesystem is set up so that:

    LUN 0: Unix Directories and Swap
    LUN 2:/u01 (Oracle Executables, control file, etc...)
    LUN 1:/u02 (Control File, Online Redo, Rollback Segments)
    LUN 3:/u03 (Control File)
    LUN 4-7: 4 pieces bound together into one huge partition
    which is /u04.
    SYSTEM, USERS, TOOLS, TEMP, FACT, DATA, and INDX are all here.

    At some point in time, hopefully by February, I will get another terrabyte Clariion array and will be able to move everything off of this array and reconfigure but until then, I'm stuck w/ this arrangement.

    Can anyone make suggestions as to how you might spread the data files out to minimize IO problems and include the reasoning behind it?

    Thanks :)

    Joe
    _________________________
    Joe Ramsey
    Senior Database Administrator
    dbaDirect, Inc.
    (877)687-3227

  2. #2
    Join Date
    May 2000
    Location
    ATLANTA, GA, USA
    Posts
    3,135
    When you use RAID 5 (/u04 partition), the data file itself spread across various physical disks. How ever TEMP data file need not be in /u04. This can be in /u01.

    Also 2nd members of REDO Log files can be configured in /u03.

  3. #3
    Join Date
    Jul 2000
    Location
    Oxford, OH
    Posts
    117
    Tamilselvan,

    Given the chance to reconfigure these disks totally, what would you suggest. I am going to be getting a new array in February and will have a chance to redo everything.

    I'm working on a solution and will post it for comments when I am finished trying to figure it all out. Basically this is a Data Warehouse. The fact tables obviously take up the majority of space (214GB or so). Everything else is pretty small in comparison. I could probably go totally Raid 0+1
    _________________________
    Joe Ramsey
    Senior Database Administrator
    dbaDirect, Inc.
    (877)687-3227

  4. #4
    Join Date
    Apr 2000
    Location
    Baltimore, MD
    Posts
    759

    Cool

    Raid 0+1 would be a good idea. The System, Users and Tools tablespaces probably has a low I/O to begin with. I would probably move them to a RAID 1 disk (to /u03 maybe!!), thus leaving the Data, Index and Fact tablespaces strictly on RAID 5 disks, since those are the most critical tablespaces.

  5. #5
    Join Date
    May 2000
    Location
    ATLANTA, GA, USA
    Posts
    3,135
    I would not recommend RAID 0+1 for Data Ware System because half of the available disks are used for mirroring. It is a waste.

    Wjramsey, could you post here how many physical disks and SCSI controllers that the box has? That would help me to reconfigure your system.



  6. #6
    Join Date
    Jul 2000
    Location
    Oxford, OH
    Posts
    117
    Talisman,

    There are currently 2 service processors in the system. There are 2 fiber channel controllers per block for a total of four controllers but only 2 are used (the others are for failover). Each SP has 4 LUN's assigned to it in the following configuration.

    SPa
    LUN0: 2 Drives in a Raid 1 configuration
    LUN2: 2 Drives in a Raid 1 configuration
    LUN4: 5 Drives in a Raid 5 configuration
    LUN6: 5 Drives in a Raid 5 configuration

    For a total of 14 drives

    SPb
    LUN1: 2 Drives in a Raid 1 configuration
    LUN3: 2 Drives in a Raid 1 configuration
    LUN5: 5 Drives in a Raid 5 configuration
    LUN7: 5 Drives in a Raid 5 configuration

    For a total of 14 drives

    That means 28-32GB drives and 2 additional hot spares for 30 total drives.

    The disk was originally set up w/ 64K stripe but supports 4,16, 64, 128, and 256K stripes.

    You can have between 3 and 16 drives in either of the Raid 0 or Raid 5 configurations.

    There is one fiber channel arbitrated loop per storage processor w/ each loop having 100MB/s of throughput for 200MB/s total throughput.

    The rotational speed of the drives are, of course, 10000RPM. There is a 1MB data buffer. The buffer to media transfer rates fall between 21.1 and 36.8 MB/s. Access Times are 5.7ms read and 6.5ms write. Rotational Latency is 2.99ms.

    Let me know if you need any further information. I know that it wouln't be totally Raid 10 - that temp doesn't need to have redundancy and such issues. I'm just wondering what combination of Raid Levels to stick out there to optimize.
    _________________________
    Joe Ramsey
    Senior Database Administrator
    dbaDirect, Inc.
    (877)687-3227

  7. #7
    Join Date
    Jul 2000
    Location
    Oxford, OH
    Posts
    117
    Is that enough information *laugh*
    _________________________
    Joe Ramsey
    Senior Database Administrator
    dbaDirect, Inc.
    (877)687-3227

  8. #8
    I don't even know that much information about myself let alone my hard drive configuration... you know your stuff... Aside of the serial numbers on the drives... what other information would you possibly be able to supply...
    Chester Ney
    CODY Computer Services
    System DBA

  9. #9
    Join Date
    May 2000
    Location
    ATLANTA, GA, USA
    Posts
    3,135
    Wjramsey,

    Let me work out, I will reply my answer very soon.

    How ever, I have a question:
    You said "The buffer to media transfer rates fall between 21.1 and 36.8 MB/s. ".

    What about the disk transfer rate? Is it same as 21.1 MB to 36.8 MB/sec?




  10. #10
    Join Date
    May 2000
    Location
    ATLANTA, GA, USA
    Posts
    3,135
    The following configuration may help you to get best performance from the available disks:

    Assumptions carefully considered:
    1. Degree of Striping and Mirroring
    2. Number of Available disks = 30
    3. Data Ware Application with many users that require mostly unique scans on its tables or indexes
    4. 2 Spare disks are also used for Striping
    5. 2 Controllers each with 100MB bandwidth
    6. 128K or 256K stripe would be better than 64K.

    Volume Name,Number of disks, Striping, Mirroring, Used for
    U01 2 No Yes Unix executables, Swap
    U02 2 No Yes Oracle executables, REDO LOG Members A
    U03 2 No Yes REDO LOG Members B
    U04 5 Yes, Degree of Striping 4 No Index-1 Tablespace
    U05 9 Yes, Degree of Striping 8 No Data-1 Tablespace
    U06 5 Yes, Degree of Striping 4 No System, and Temporary Tablespaces
    U07 5 Yes, Degree of Striping 4 No Rollback Tablespace
    Total 30


    Note 1:Reason for using 9 disks in u05:
    As you said the minimum transfer rate from buffer to media is around 21 MB/Sec, you can very well go up to 10 disks (10 disks * 21 MB=210 MB) in one striping. More distribute the data, More Parallel I/O for Reading can be engaged.

    Note 2:
    If your application is Data Warehouse with few users that require many range/full table scans, then RAID 3 is better option than RAID 5.

    Note 3:
    If you need more disk space for your DATA, you can use U07 volume. Create Rollback Tablespace in U06.

    Note 4:
    If your database is in NOARCHIVELOG mode, then you do not need U03. Use those 2 disks as HOT SPARE. However, if the database is n ARCHIVE mode, then you must have 2nd members of REDO LOG.


    Note 5:
    Why do you need less degree of striping for Index than for DATA.
    INDEXES require a lower degree of striping because the data in Indexes are always lesser than data in Tables.

    Note 6:
    Whatever be the RAID level, Never create INDEX Tablespace in DATA volume. This will definitely hurt performance.

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •  


Click Here to Expand Forum to Full Width