I don't knwo any remedies for sure that would help, but I can say this:
DON'T RUB IT! When I can feel a big pimple coming, I would sometimes rub it and pick at it, which i have quit doing. All I know is that it made w/e that was coming worse, way worse!
The same thing happened to me a week ago, but I was lucky to prevent, for the second time, that painful deep cyst from coming up. This is what I put on that spot:
a.m. Polysporin
p.m. cortisone, wait 5 min., then tazorac cream.
Also, I took advil (max. recommended dosage) until the bump went away(4 days).