Please start any new threads on our new site at We've got lots of great SQL Server experts to answer whatever question you can come up with.

Our new SQL Server Forums are live! Come on over! We've restricted the ability to create new threads on these forums.

SQL Server Forums
Profile | Active Topics | Members | Search | Forum FAQ
Save Password
Forgot your Password?

 All Forums
 SQL Server 2008 Forums
 SSIS and Import/Export (2008)
 Data Cleansing Using SSIS 2008
 Reply to Topic
 Printer Friendly
Author Previous Topic Topic Next Topic  

Posting Yak Master

112 Posts

Posted - 10/24/2013 :  22:15:38  Show Profile  Reply with Quote
I got some Excel Data source with some Duplicate Data and Data Mismatch Values.
Like Customer Name and Their Address.

Name: Albert, Albart, Albert A, A Albert
Adress: 1st St, First St, First street, 1st street etc..

Need to Correct the Data and Remove the Duplication using SSIS. Currently I hv used Fuzzy Logic and cant able to Remove the Duplicate since there is no Reference Data, In this Ex Reference will be the same Excel data.
Help me some Logic to overcome this Data cleansing.


Very Important crosS Applying yaK Herder

52326 Posts

Posted - 10/25/2013 :  02:00:05  Show Profile  Reply with Quote
you need to have reference data in any case as you need to have a master set to which you do comparison. All previously explained ways work based on that.unless you do that system doesnt know which value to map each value to.

SQL Server MVP
Go to Top of Page
  Previous Topic Topic Next Topic  
 Reply to Topic
 Printer Friendly
Jump To:
SQL Server Forums © 2000-2009 SQLTeam Publishing, LLC Go To Top Of Page
This page was generated in 0.02 seconds. Powered By: Snitz Forums 2000