It is still possible though for him to have it, if he is the one that gave it to you. I say this because , just being with someone that has the virus will not mean they automatically get it. Even if the girl had/has it she can still have a regular normal pregnancy.
I think the best thing to do is for your husband to be tested if not already. The virus is just one big mess