To judge the severity of a phobia or social anxiety, look to the level of effort that goes into avoidance and weigh the cost of this avoidance. Are there missed job opportunities or other unfortunate results?
Set boundaries so you do not feel used or put upon. You do not have to say yes to everything that is asked of you. Realize what is within your limitations and do not feel guilty if you have to say no.