From my personal experience. I had all of my wisdom teeth removed at the age of 19 and 10 years later I had another one come in. That would make it a total of FIVE? Anyway, I had pretty horrible headaches and about that time noticed this new growth and had it removed. The headaches of this particular sort quit.
If the teeth are coming in and they seem to be causing pressure, you may need to see about having them removed.