it makes sense, because your body thinks you basically have a cold, and since you are sick (ie have allergies), your body works harder to fight it. allergies affects people in many ways: fatigue, depression, memory loss, sleep disorders, ETC.
when you don't have allergies anymore, i gaurantee you will feel lots different, like a new person!