Do you feel tired and feverish? I had a sore, inflammed throat that would come and go whenever I was stressed or tired. I put up with it for ages until eventually I couldn't stop worrying about it because I had convinced myself that I had throat cancer. Anyway, it turns out that I have got Glandular Fever!
I think it is always worth a trip to the doctor. If only to put your mind at rest.