Help - Search - Members - Calendar
Full Version: Best wat to load huge data
Oracle DBA Forums > Oracle > Oracle Forum
bostondba
Hi,

Like to know what is the best way to load huge data every week come from different resources.

1: Huge data
2: Load into one OR multiple tables
3: Data need clean up task also


Like to here from other ETL & Sr.DBA what they are doing in there databases.
Use ETL tools / build sql scripts or any other way...?



Thanks in advance
aussie_dba
I assume that the data is coming-in as standard flat files?

I do not like the ETL tools, as you can do better if you understand shell scripting in Oracle.

To load data fast, try the Oracle SQL*Loader utility:

http://www.dba-oracle.com/t_optimize_sql_l...performance.htm

You can also define the incoming files as external tables, and leave them outside of Oracle:

http://www.dba-oracle.com/t_sql_loader_sql...rnal_tables.htm

To learn shell scripting for Oracle, see Jon Emmon's book:

http://www.rampant-books.com/book_2007_1_shell_scripting.htm

"Data need clean up task also "

This is called "data scrubbing", and quite easy:

http://www.dba-oracle.com/t_online_systems...g_cleansing.htm
This is a "lo-fi" version of our main content. To view the full version with more information, formatting and images, please click here.
Invision Power Board © 2001-2014 Invision Power Services, Inc.