Working out 2 hours a day means your physical health is a major part of your life and your identity. However, does this cross over to your body image? Is it important for you to be in great shape - does that give you confidence with men? If so, not being able to work out as much may make you question your ability to keep your guy or you may think he wants someone who works out the way you used to.
Three things: 1) you aren't crazy, 2) your man should love you even if you can't work out all the time right now, 3) if your guy hasn't given you reason not to trust him, being paranoid about him possibly cheating will only push him away.