I find this common amongst people who opt for shaving as a form of hair removal.
A lot of my girlfriends talk of similar situations.
I dont think it is anything to worry about but if it does get painful and puss is present it could mean an infection. Still nothing to worry about but if gets worse might want to get it checked out.
Otherwise exfoliating could help In order to remove dead skin cells to prevent ingrowns.
Im not sure if you've heard of a "below pants facial". A new concept, a rather odd concept personally, it is literally a facial for your nether regions.
They cleanse, exfoliate and moisturise your privates to reduce and prevent the occurance of ingrowns.
I'm not sure if you will be willing to go that far but thats something to think about.. You could try something similar but more D-I-Y?
Hope I helped