In my opinion, he could have passed it to the genitals, but the risk is very low.. My best advice would be to see if you have any symptoms, it can take anywhere from 2-25 days, but since you already have the antibodies in your system I would say NO, I would be more concerned about you passing it to him oral through the kissing.. Remember you can pass the virus without symptoms so since you had one and even though in your opinion it was almost gone, the higher risk would be to him, not you..
I hope this helped, you can get more infor from the handbook, you can download from the web... take care...