Please start any new threads on our new site at https://forums.sqlteam.com. We've got lots of great SQL Server experts to answer whatever question you can come up with.

 All Forums
 General SQL Server Forums
 New to SQL Server Programming
 Optimization SSIS -loads

Author  Topic 

Chinni
Yak Posting Veteran

95 Posts

Posted - 2008-10-06 : 16:22:18
I have task like

Flatfie -> derived column-> data conversion -> OLEDB destination

on data flow task it main purpose is to load data from flat file to table.(millions of records)

OLEDB destinatio - fast load
Default buffer row 15000(but loading only 8000)
Buffersize - 12485760 ( deafult 102485760)

Its taking long time to load and I tried like

data floe
flat file - table
data flow
table - derived - data conversion - ole db destinatio n...its taking double the time

Any suggestion to optimize the performance

sodeep
Master Smack Fu Yak Hacker

7174 Posts

Posted - 2008-10-06 : 16:29:26
Does destination table has indexes in it?
Go to Top of Page

Chinni
Yak Posting Veteran

95 Posts

Posted - 2008-10-06 : 16:42:44
yes

one clustered and two non clustered indexes
Go to Top of Page

sodeep
Master Smack Fu Yak Hacker

7174 Posts

Posted - 2008-10-06 : 16:47:28
Thats the reason it is slow because it has to insert in index pages as well for Clustered index so that Leaf level contains data and has to sort as well.
Go to Top of Page

Chinni
Yak Posting Veteran

95 Posts

Posted - 2008-10-06 : 17:03:13
so there is no way to optimize it

Thanks
Go to Top of Page

Chinni
Yak Posting Veteran

95 Posts

Posted - 2008-10-07 : 11:30:13
Is that a good idea to sort

flat file - sort - data convesion - destination
Go to Top of Page
   

- Advertisement -