Transferring huge amount of data - Page 3
DBAsupport.com Forums - Powered by vBulletin
Page 3 of 3 FirstFirst 123
Results 21 to 24 of 24

Thread: Transferring huge amount of data

  1. #21
    Join Date
    Dec 2002
    Location
    Bangalore ( India )
    Posts
    2,434
    Well i did a test using exp with compress running in background using pipes..

    the table had 6million records and was 3G big..

    export (exp) + compression (using pipe) took 4.5 mins
    export (exp) + cpmpression (serial task) took 6.0 mins

    hardly 1.5 mins difference and that compression took about 2 mins of this total time..

    PS, I should admit that i missed the gist of pipe.. your actalluy right..

    i had said before

    i meant LIO + CPU Time for compression is nearly equal to time required for PIO to local file system..
    indeed this is the case, from above test.. the time difference seen is solely because the process is a serial one and former is virtual parallelism..

    if we have the table of 20G, then there will still be a max difference of 5-10 mins (required for compression)

    I mentioned in my other post that point 2 was not very significant.. as was point 3.. and indeed it is.. your point 2 would be significant if it were a table to 100-200G.. i really suspect if that is the case..
    Last edited by abhaysk; 10-18-2007 at 05:50 AM.
    funky...

    "I Dont Want To Follow A Path, I would Rather Go Where There Is No Path And Leave A Trail."

    "Ego is the worst thing many have, try to overcome it & you will be the best, if not good, person on this earth"

  2. #22
    Join Date
    Dec 2001
    Location
    Tel-Aviv,Israel
    Posts
    233
    Hi folks,

    We tested yesterday transferring of 33,000,000 rows between two servers.
    We transferred one table.
    AVG_ROW_LEN=286
    total space=9GB

    We issued create table as select over DB link and it took 14 minutes.
    I think it's a good results.
    What do you say?

    Nir

  3. #23
    Join Date
    Dec 2002
    Location
    Bangalore ( India )
    Posts
    2,434
    had you done in parallel dml with no-logging then you could do still better..


    rgds
    abhay
    funky...

    "I Dont Want To Follow A Path, I would Rather Go Where There Is No Path And Leave A Trail."

    "Ego is the worst thing many have, try to overcome it & you will be the best, if not good, person on this earth"

  4. #24
    Join Date
    Dec 2001
    Location
    Tel-Aviv,Israel
    Posts
    233
    thanks abhay!

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •  


Click Here to Expand Forum to Full Width