I was recently diagnosed with Stage I (minimal) endo via laparscopy. I had no symptoms other than infertility and no family history. The endo was not on any of my reproductive organs. My doctor thinks that the white bloods cells from the endo are killing my eggs when I ovulate and the sperm.
Some people have endo and have no problems conceiving. Others have endo and have problems (like me). I've been TTC for 14 months with no luck.

My doctor has said I have a 45% live birth rate per cycle if I do IVF. Right now, I'm trying the IUI route because it's cheaper. Hopefully, this will work.
I guess you won't really know how the endo affects your fertility until you start tryng to conceive. If you suspect you may have endo, I would start TTC sooner rather than later because infertility treatments can take a long time (plus endo can progress).
I wish you the best of luck!