Yes, absolutely, it's called hyperacusis and or recruitment - it comes and goes with me, sometimes bad, sometimes ok. You can try wearing ear plugs in environments that are really noisy. The advice generally given out is not to protect your ears too much with ear plugs as this can make your ears more sensitive in the long run. Although ear plugs are advised for situations where people without these probs would also find noise too loud - for example the sound level in cinemas is generally too loud, and obviously noisy social environments with music etc...
I try to be simply be sensible about the ear plugs, if I am really suffering, then I use them, if things aren't too bad I don't. There have been discussions about this on this board before - try putting a few words in to the search engine -'ears' or 'hyperacusis' it will bring up the relevant posts.