It depends totally on the person.
Some guys look sexy as all hell with them, while others couldn't even attempt to look good with them. They just don't look right on some people.
My ex could pass it off as incredibly sexy, whereas my current partner would look hideous with one.
If that's what you want, then it's up to you. Just be sure you're not doing this for other people.