| Author |
Topic |
|
Seventhnight
Master Smack Fu Yak Hacker
2878 Posts |
 Posted - 2004-09-02 : 11:33:35
|
| A few minutes ago, a co-worker of mine suggested that we convert or 2.5-3 million image document management system from storing the files in a neat little directory structure to storing them in a sql server. At the moment the DMS takes approx. 240g of file space.After a violent and unpleasant reaction, I have decided to ask for any thoughts or opinions on the matter.Corey |
|
|
mr_mist
Grunnio
1870 Posts |
Posted - 2004-09-02 : 11:34:40
|
| Don't do it.-------Moo. :) |
 |
|
|
spirit1
Cybernetic Yak Master
11752 Posts |
Posted - 2004-09-02 : 11:46:12
|
| my simple response to this is:hahahahahahahahawhat does he do again? is he going to do it for long???ok this may be rude but come on is he serious???Go with the flow & have fun! Else fight the flow :) |
|
|
|
jsmith8858
Dr. Cross Join
7423 Posts |
Posted - 2004-09-02 : 11:49:35
|
| Keep it in the filesystem. just store filenames and paths.- Jeff |
|
|
|
Seventhnight
Master Smack Fu Yak Hacker
2878 Posts |
Posted - 2004-09-02 : 11:56:00
|
Oh I have a system that works, but we are having problems backing up the large mount of data b/c its divided into many small compressed files. To address the backup problem, he suggested that if the images were in a database we would only have to backup 1 large file.quote:
what does he do again? is he going to do it for long???
Sometimes I really don't know what he does, but he seems to be doing 'it' indefinitely...  Another co-worker has taken over the backup responsibility from him recently as the backups kept failing and he just said "It worked, it just didn't byte verify at the end."I'm glad to see that my reaction wasn't off base.  Corey |
|
|
|
X002548
Not Just a Number
15586 Posts |
Posted - 2004-09-02 : 11:59:00
|
| What type of images?Brett8-) |
|
|
|
Seventhnight
Master Smack Fu Yak Hacker
2878 Posts |
Posted - 2004-09-02 : 12:03:42
|
| tifs.. mostly 40k, some multipage so they would be bigger.Corey |
|
|
|
spirit1
Cybernetic Yak Master
11752 Posts |
Posted - 2004-09-02 : 12:11:46
|
quote:
Originally posted by SeventhnightSometimes I really don't know what he does, but he seems to be doing 'it' indefinitely...
hey can i come and do his job (nothing  ) for his pay....Go with the flow & have fun! Else fight the flow :) |
|
|
|
Seventhnight
Master Smack Fu Yak Hacker
2878 Posts |
Posted - 2004-09-02 : 12:13:25
|
| bad thing is he probably makes twice my salary... (he's been in programming for 20+ years...) plus he's always got something on his nose.Corey |
|
|
|
spirit1
Cybernetic Yak Master
11752 Posts |
Posted - 2004-09-02 : 12:17:13
|
| Go with the flow & have fun! Else fight the flow :) |
|
|
|
X002548
Not Just a Number
15586 Posts |
Posted - 2004-09-02 : 12:26:03
|
quote:
Originally posted by Seventhnight
tifs.. mostly 40k, some multipage so they would be bigger.Corey
That's not what I meant and you know it......Ask him how long he'd think the backups would take?Brett8-)EDIT...let's see...40k * 3,000,000.... |
|
|
|
Seventhnight
Master Smack Fu Yak Hacker
2878 Posts |
Posted - 2004-09-02 : 12:29:28
|
| Well... honestly they are scanned documents from our business. Mostly application type forms and what not.Right now a full backup takes over 3 days. He seems to think it would be fast if it were only one file. I don't think he would appreciate me bringing it back up now.Corey |
|
|
|
MichaelP
Jedi Yak
2489 Posts |
Posted - 2004-09-02 : 13:31:11
|
| Ask him about the RESTORE time.Lets say you had some nasty failure and needed to restore. Right now, it takes 3 days to backup, so I think about the same amount of time to restore if not more. If you add the imaging into the equation, it's gonna take FOREVER to recover from a catostrophic failure (maybe as much as 5 days!!!).Images in SQL server are almost NEVER a good idea, esp. in a larger environment.Michael<Yoda>Use the Search page you must. Find the answer you will.</Yoda> |
|
|
|
X002548
Not Just a Number
15586 Posts |
Posted - 2004-09-02 : 13:45:25
|
| Tell him to use the force....Brett8-) |
|
|
|
mr_mist
Grunnio
1870 Posts |
Posted - 2004-09-02 : 14:44:37
|
| Right now though, you have an easy task determining what you need to back up based on what's changed on your filesystem. Stick them as images into sql server and this all becomes a whole load more involved, probably leaving you backing up everything muchly. :|-------Moo. :) |
|
|
|
Seventhnight
Master Smack Fu Yak Hacker
2878 Posts |
Posted - 2004-09-02 : 16:32:57
|
So in essence... quote:
Originally posted by mr_mist
Don't do it.-------Moo. :)
Thanks for all of the thoughs! Corey |
|
|
|
kselvia
Aged Yak Warrior
526 Posts |
Posted - 2004-09-02 : 19:01:58
|
| I have a 4 million document DMS system using the filesytem (~300GB) and backups only take 6 hours. Sounds like you need a better SAN, backup system, or defrag your disks. What about incremental backups? If he presses the issue we can load you up with 100 reasons (maybe I exagerate...) not to do it.--KenI want to die in my sleep like my grandfather, not screaming in terror like his passengers. |
|
|
|
geossl
Yak Posting Veteran
85 Posts |
Posted - 2004-09-02 : 21:49:35
|
| I also have a similar issue and wonder if it is good to store image/document data in a database. What is the pros and cons? |
|
|
|
kselvia
Aged Yak Warrior
526 Posts |
|
|
Seventhnight
Master Smack Fu Yak Hacker
2878 Posts |
Posted - 2004-09-02 : 23:03:20
|
| Hey Ken - I didn't realize you had such a similar system. Could you enlighten me on what you do for backup. We do incrementals and what not, but getting a full is difficult (thats the one that takes days). I would love to pass on your situation and solution to the guy pondering the problem.Corey |
|
|
|
derrickleggett
Pointy Haired Yak DBA
4184 Posts |
Posted - 2004-09-03 : 01:40:39
|
| How much space are you currently using for all these images? Also, don't you have some kind of an archive policy? I can't imagine anything taking 3 days to backup. That's crazy. They need to invest in a tape backup device integrated with the SAN fabric.MeanOldDBAderrickleggett@hotmail.comWhen life gives you a lemon, fire the DBA. |
|
|
|
Next Page
|
Your thoughts on Images