I know exactly what you are talking about....those are the ones that can scab over and start bleeding when you wash your face. I usually get them after popping a cyst.
Honestly, I use Neosporin on the "wound" at night....sometimes with a Band-Aid on top so that it doesn't smear on my pillowcase.
Even though it seems greasy, I only use it on small spots, so I haven't broken out from it. It also makes scarring less likely to occur. If you use a topical, just put it on beforehand and give it time to absorb into the skin.