Load data to warehouse
DBAsupport.com Forums - Powered by vBulletin
Results 1 to 2 of 2

Thread: Load data to warehouse

  1. #1
    Join Date
    Oct 2002
    Location
    CA
    Posts
    67

    Load data to warehouse

    We are using Oracle Warehouse Builder product to load data into our warehouse. However, we have this huge package that takes 12 hours to load. I am just wondering, for a quick fix, we can replace some of the big tables with materialized view first, during the day, we can insert them into actual tables. Will this help speed up the process if so how much. The other obviouse thing is to index some of the tables. This package is very big, 120 page long. Any other suggestions.
    --------------------------------------
    It's not what the world does to you that matters. It's how you respond...

  2. #2
    Join Date
    Aug 2000
    Location
    Belgium
    Posts
    342
    'package is big' : it's a PL/SQL package

    This means you only use 1 cpu, and you cannot use parallisme to speed up the procedure.

    I would try to split it in 2 :
    1.
    a clean file to db load procedure -> using sql*ldr - direct load
    2.
    an etl procedure that processed the loaded data. Using partitioning on the staging-table it may be possible you can speed things up by executing the same procedures in parallel, just use another partition of the staging-table as your input for the procedure.

    HTH
    Gert

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •  


Click Here to Expand Forum to Full Width