|
|
|
Supreme Being
Group: Forum Members
Last Login: 9/12/2008 10:03:50 AM
Posts: 116,
Visits: 18
|
|
I have an issue while loading data from sql server to Teradata database. It takes a very long time to load 100K rows. when i checked the log I guess it is doing a row level insert instead of a bulk load. Here is a part of the session log
MASTER> PETL_24006 Starting data movement.
MAPPING> TM_6660 Total Buffer Pool size is 12000000 bytes and Block size is 64000 bytes.
READER_1_1_1> DBG_21438 Reader: Source is [SA3ADLSQL02], user [ABCDEF]
READER_1_1_1> BLKR_16003 Initialization completed successfully.
WRITER_1_*_1> WRT_8148 Writer: Target is database [JQU], user [ABCDEF], bulk mode [N/A]
WRITER_1_*_1> CMN_1021 Database driver event...
CMN_1021 [Teradata Event Using array fetches. Teradata Event Using Single Row Inserts. connect string = [Siebel_Warehouse_Dev]. userid = [ABCDEF]]
WRITER_1_*_1> WRT_8124 Target Table JQU_ProspectOwnerTracker :SQL INSERT statement:
Now how can i set the option to do a BULK LOAD.? I remember there is a place to do that but I cant find it. I'd appreciate your help.
Thanks.
Feroz Shaik
|
|
|
|
|
Forum Newbie
Group: Forum Members
Last Login: 2/22/2008 11:39:56 AM
Posts: 1,
Visits: 3
|
|
It has been a while since I did informatic, but you set up a Teradata loader as a "writer" in the session tool.
you then set your target to file instead of database, and choose your teradata writer. If you need more details, I can try to research it more...
ZackHowe@comcast.net
Zack Howe
|
|
|
|
|
Forum Newbie
Group: Forum Members
Last Login: 9/12/2006 11:18:00 AM
Posts: 6,
Visits: 1
|
|
Hi Feroz,
To load 100K records, I would suggest to use fastload / mload utilities from teradata, instead of using an ODBC connection.
In workflow manager, you would need to define a "Loader" connection, that would use either fastload or mload (based on your requirement).
Then in your specific workflow, you would need use this loader connection (instead of the ODBC connection).
During execution, When informatica sees that it has to use the loader connection, it splits the execution in 2 steps -
1. it would create the control file, outfile by itself & dump the data into the out file.
2. Then it would take the out file as the input , invoke fastload / mload, & would load the data into the target table.
I'm sure this would save a LOT of time for you !!
Let me know if this works for you ..
Thanks & Regards,
Mahesh.
|
|
|
|
|
Supreme Being
Group: Forum Members
Last Login: 9/12/2008 10:03:50 AM
Posts: 116,
Visits: 18
|
|
Thanks Mahesh and all,
I used the external loader fastload option to load the data, It did save a lot of time.
Feroz Shaik
|
|
|
|
|
Forum Newbie
Group: Forum Members
Last Login: 7/28/2008 11:19:35 AM
Posts: 4,
Visits: 5
|
|
When i tried to use the Teradata_Mload_External_loader in the loader option in Informatica, i couldnt able to find in workflow manager Connection type as loader. i can view None,FTP , where i need to configure to get the Loader type in connection.
raja
Regards,
Rajendran
|
|
|
|