So if it is epidyimitis, first of all, how long do I wait to see a doctor? And second, isn't a form of a chlamydia? So, is it safe to have sex with my wife? Ejaculation isn't painful, should I stop, or would it be best to get the semen out?

I wouldn't wait at all. That would give the infection time to spread. Epidyimitis and chlamydia are two different things. Epidyimitis I don't think is contagious, but chlamydia is a sexually transmitted disease. I don't know if ejaculating helps or not.