For increase your server performance it is advisable but you need to distinguish between rebuilding the index & reorganising the indexes refer the following discussion
Following on from ahmeds08 - consider implementing a regular review of index usage - which is all basic information available via DMVs. During these reviews - work ith the app owners to discuss and analyse indexes that have have large amount of writes with very little or no reads. Usually a hint that that the index is added to but then not read. Of course, make sure there is a good understanding of the queries - before you start dropping indexes.