Please start any new threads on our new
site at https://forums.sqlteam.com. We've got lots of great SQL Server
experts to answer whatever question you can come up with.
| Author |
Topic |
|
yosiasz
Master Smack Fu Yak Hacker
1635 Posts |
 Posted - 2009-01-22 : 14:26:08
|
| Apologies if this is not the appropriate forum for this question, if so please guide me as to where I need to go.We have a legacy mainframe app from 1980s. Text based mainframe app, data integrity is below 5%. Data is replicated to SQL 2005 server. So BI decisions are made on this kind of data so you can imagine the decisions being made and the effects..let's just say things could be better. Also when writing apps that feed from this replicated data there are some unexpected results. Which made me thought of a MiniMart (datamart) via ETL every 15 minutes clean data, normalized.Where can I go to find any sort of ETL templates I can start out with for MiniMarts?Thanks! |
|
|
blindman
Master Smack Fu Yak Hacker
2365 Posts |
Posted - 2009-01-22 : 16:17:12
|
| Data integrity below 5%? Not sure how you would even measure that, but it can't be good.I don't see how creating a datamart is going to resolve your data integrity issues.________________________________________________If it is not practically useful, then it is practically useless.________________________________________________ |
 |
|
|
yosiasz
Master Smack Fu Yak Hacker
1635 Posts |
Posted - 2009-01-22 : 16:35:01
|
I clean up the data they way i want it to look.it is practically useful  |
|
|
|
blindman
Master Smack Fu Yak Hacker
2365 Posts |
Posted - 2009-01-23 : 10:02:07
|
| Then I am confused about exactly what business requirement you are trying to satisfy.What is your reason for creating a datamart?________________________________________________If it is not practically useful, then it is practically useless.________________________________________________ |
|
|
|
yosiasz
Master Smack Fu Yak Hacker
1635 Posts |
Posted - 2009-01-23 : 10:16:36
|
speed is one of them. the replicated data has no indeces and it is hogging up a major part of application we are writing for our sales department. A capacity planning tool, the users' biggest requirement is speed. We also have another tool that could use this datamart.the replicated data I speak of seems to be produced frmo transaction logs. it is just a dump of the mainframe data. no cleanup, dates in text field, monetary values in text field, BIN collation on almost every field. measurements entered different ways (1", 1 inch, 1 x 1, 1 1) These are the few of the many reasons.Show me the way blindman  |
|
|
|
blindman
Master Smack Fu Yak Hacker
2365 Posts |
Posted - 2009-01-23 : 10:55:55
|
| Speed of data entry, or speed or data retrieval?Are you witnessing performance issues when entering the data, or when using queries to retrieve data for reporting?Also, are you saying you currently have transactional replication in place, and you think this is causing performance problems?________________________________________________If it is not practically useful, then it is practically useless.________________________________________________ |
|
|
|
|
|
|
|
|
ETL Minimart