Not at all, if it helps you sleep. Sleep is at the top of your healthy priorities.
IMPORTANT: Make sure you have a netti pot or some source of saline rinse to keep nasal membranes moist and clear. Anti-histamines dry them out, leaving you with a pretty heavy chance of infection or bacterial growth. Once a day will do the trick with the netti. Remember to drink plenty of water too!