Please start any new threads on our new
site at https://forums.sqlteam.com. We've got lots of great SQL Server
experts to answer whatever question you can come up with.
| Author |
Topic |
|
Chinni
Yak Posting Veteran
95 Posts |
Posted - 2008-10-06 : 16:22:18
|
| I have task likeFlatfie -> derived column-> data conversion -> OLEDB destinationon data flow task it main purpose is to load data from flat file to table.(millions of records)OLEDB destinatio - fast loadDefault buffer row 15000(but loading only 8000)Buffersize - 12485760 ( deafult 102485760)Its taking long time to load and I tried likedata floeflat file - tabledata flowtable - derived - data conversion - ole db destinatio n...its taking double the timeAny suggestion to optimize the performance |
|
|
sodeep
Master Smack Fu Yak Hacker
7174 Posts |
Posted - 2008-10-06 : 16:29:26
|
| Does destination table has indexes in it? |
 |
|
|
Chinni
Yak Posting Veteran
95 Posts |
Posted - 2008-10-06 : 16:42:44
|
| yes one clustered and two non clustered indexes |
 |
|
|
sodeep
Master Smack Fu Yak Hacker
7174 Posts |
Posted - 2008-10-06 : 16:47:28
|
| Thats the reason it is slow because it has to insert in index pages as well for Clustered index so that Leaf level contains data and has to sort as well. |
 |
|
|
Chinni
Yak Posting Veteran
95 Posts |
Posted - 2008-10-06 : 17:03:13
|
| so there is no way to optimize itThanks |
 |
|
|
Chinni
Yak Posting Veteran
95 Posts |
Posted - 2008-10-07 : 11:30:13
|
| Is that a good idea to sortflat file - sort - data convesion - destination |
 |
|
|
|
|
|