Interesting, I see you're using tf/idf and an SVM. Does the tf/idf improve a lot? I'd expect the SVM to take care of the weighting.