9i External tables for ETL !!

[cruser3]

Looking at a daily upload of 3 dim. tabs. using X'tnl tables. Db:9.2.0.4 on Sol 2.8
Records: 8-10 Million/each !!

Plan to automate the file ref. as it comes in. This is a 5TB db. so if anyone has done this and if any issues would appreciate knowing esp. with regards to backup of the db which I do not forsee !!

[slimdave]

Use RMAN
!!!!!!!!!!!!

[cruser3]

tx -sd !!

Right now the db is in noarch mode backed up approx. every 90 days by a vendor like Syncsort.

However was wondering if someone had a setup like this as currently sqlldr is used!!

[slimdave]

Nothing wrong with noarch mode in a DWh environment, as long as your ETL + front end metadata is then kept in a seperate database under arch mode.

A useful practice (maybe idealistic) is that after the ETL procedure has performed a nologging op like this then it kicks off an RMAN incremental backup (maybe single channel to limit production impact).

[pando]

Originally posted by cruser3
tx -sd !!

Right now the db is in noarch mode backed up approx. every 90 days by a vendor like Syncsort.

Isnt Syncsort a awk like tool...?

[cruser3]

Syncsort is a firm in the backup/storage arena - offers tape backup and other storage solutions to firms with VLDB's/large envs.
website:syncsort.com

Again my query - does anyone have a setup of this sort and issues ?

[tamilselvan]

What is the backup time for 5 TB DB by Syncsort?

Tamil

[cruser3]

The backup time is 36 Hrs. - if everything goes well - i.e no problems with NBU/Tape Loaders !!

[pando]

we used syncsort sort of DWH support tool for ETL processes

http://www.syncsort.com/sort/infosu.htm

Guess you mean that backup express app made by the same company

[cruser3]

Yeah..for reasons of client confidentiality cannot post vendors name hence the comparison to syncsort. Ayways has anyone used 'xternal tables to implement the ETL solution as I described ?