| Author |
Topic |
|
needmajorhelp
Starting Member
4 Posts |
 Posted - 2007-04-08 : 12:08:08
|
| I have a new business, and a part of that business includes receiving large amounts of data from time to time. I just found out yesterday that I'm going to be receiving about 1TB of data from an new client! I'm not set up at all for this large of a data set.I want to use SQL Server as my database. Can I load SQL on a Desktop PC without having to buy a server? How?I don't have a clue as to how I need to get set up for this data...hardware or software. Any advice you can give will be outstanding!!!!!Thanks. |
|
|
jezemine
Master Smack Fu Yak Hacker
2886 Posts |
Posted - 2007-04-08 : 14:28:05
|
1 TB of data is a lot for a beginner. SQL Server can handle it, but I would venture to say this will be too much for you if you have no experience with SQL Server. You can install SQL Server on a desktop no problem. but 1 TB of data is far too much for the average desktop box. Generally they come with only a few hundred gb drives. You'll need at least 2 TB space: 1 to store the data from your client in raw format (which is what btw? flat files? xml?), and another once it is imported into sql server.
www.elsasoft.org |
 |
|
|
dinakar
Master Smack Fu Yak Hacker
2507 Posts |
Posted - 2007-04-08 : 15:00:18
|
| The other part of the equation being, is that data being appended to what you already have or is it just a replacement. Is the data being received recurring or one time? If its an addendum, you need to reindex/update stats for all the tables that exploded. Once you get beyond the file/system level challenges, theres some you need to prepare for from the DB point of view.************************Life is short. Enjoy it.************************ |
|
|
|
needmajorhelp
Starting Member
4 Posts |
Posted - 2007-04-08 : 20:56:46
|
| Thanks for all of the help so far. I have worked with SQL Server at a previous employer...Using DTS to bring in data, creating indexes, changing field types, creating SQL code, stored procedures, etc. I've heard of something called MySql. I've heard that it's a scaled down SQL Server, and is good for desktops. Would this be a good thing for me to get if I can do this on a desktop??? I've found a desktop PC with 1.3 TB of storage. If the data was 500 MB instead of 1 TB, would that make a difference? |
|
|
|
jezemine
Master Smack Fu Yak Hacker
2886 Posts |
Posted - 2007-04-08 : 22:49:31
|
500mb as opposed to 1 tb makes a HUGE difference! that's a factor of 2000 right there. I am thinking perhaps you have GB and TB mixed up. 1000 MB = 1 GB. 1000 GB = 1 TB.I would stay far away from MySQL if you really are working with 1 TB.
www.elsasoft.org |
|
|
|
needmajorhelp
Starting Member
4 Posts |
Posted - 2007-04-09 : 20:09:42
|
| Typing mistake... 500 GB not mb. I can have my client give this to me in 2 installments, and work with smaller data sets. Would MySQL handle 500 GB? |
|
|
|
needmajorhelp
Starting Member
4 Posts |
Posted - 2007-04-09 : 20:20:40
|
| Let me re-phrase my question. Let's say you have 500 GB of data coming in, and don't have any hardware or software installed yet. You have a blank slate. What hardware would you install, and what version of SQL would you install? |
|
|
|
jezemine
Master Smack Fu Yak Hacker
2886 Posts |
Posted - 2007-04-09 : 23:06:53
|
I would want a server, not a desktop, with decent disks. also I would go with SQL Server over mysql with that amount of data. I have much less experience with mysql than sql server though. My impression is that mysql is more for smaller stuff.Perhaps most important though, is you need someone with some experience with large databases to put this together for you. Free advice on forums is worth what you pay for it. 
www.elsasoft.org |
|
|
|
cmdr_skywalker
Posting Yak Master
159 Posts |
Posted - 2007-04-10 : 01:10:12
|
| What are your business needs (Criticality, performance, etc.)? Are you going to support data analysis, reporting, support web application or just plain backup/archive purpose (in case something happen)? I'd like to give you a better input since I both used customized/beef up workstation and server. The decision was made based on the business requirements. If you can give us some, we might be able to give you better information so you can have better decision :).God bless.Jeffrey Perezwww.empoweredinformationsystems.comMay the Almighty God bless us all!www.empoweredinformationsystems.com |
|
|
|
|
Need some MAJOR help, PLEASE