How can I make the pain go away if I have skin growing over one of my wisdom teeth and I'm pregnant.

Have you been to a dentist yet and let them check it out? That would be your best bet since you're pregnant because you have to be careful of any medication you take while being pregnant.