Please start any new threads on our new site at https://forums.sqlteam.com. We've got lots of great SQL Server experts to answer whatever question you can come up with.

 All Forums
 SQL Server 2005 Forums
 Transact-SQL (2005)
 How To Rapidly Query A Free-Text Field?

Author  Topic 

johnvm
Starting Member

18 Posts

Posted - 2007-08-20 : 17:01:29
Hey Guys,

I have a bit of a problem here. I'm trying to database news headlines and articles, and then allow them to be searchable.

queries, for instance, might look something like this:

select * from table where headline like '%word1%word2%word3%' order by datetime desc

The problem is, I get about 100,000 new headlines a day, and at the moment, on a Quad 2.6ghz box with 4GB RAM, even with only 300,000 articles in the database, it takes about 10 seconds to run that search. That means, with my current DB design, it's going to add about 3 secs/day to the length of my search to run.

That's pretty unacceptable.

What can I do to fix this? Database Engine Tuning Advisor offers no suggestions. I'm not using indexes, as I don't think indexing the headline field would result in any performance gain as the like queries could be matching the n'th word in the field.

How could I run queries like this at a high speed?

SwePeso
Patron Saint of Lost Yaks

30421 Posts

Posted - 2007-08-20 : 17:15:23
Have you tried the FullText Service?



E 12°55'05.25"
N 56°04'39.16"
Go to Top of Page

johnvm
Starting Member

18 Posts

Posted - 2007-08-20 : 17:24:00
Indeed I have not. I was not aware it existed, although since you just replied I have been googling it.

What type of performance gain could I expect for using fulltext service?
Go to Top of Page

rmiao
Master Smack Fu Yak Hacker

7266 Posts

Posted - 2007-08-20 : 22:17:00
I had a case before, query response time was 10 times faster after creating full text index. But it's not always get same performance gain in all cases, should test it in your system.
Go to Top of Page
   

- Advertisement -