or does it not matter?

Just bringing back up incase someone missed it and could answer it for me.

Thanks

If it's cardio, do it first thing in the morning on an empty stomach. Wake up, have a tall glass of water, and start your exercise. Wait 30-60 minutes after your cardio is done before eating breakfast.

If you're doing weight training, you should aim to have a high protein meal no more than 1 hour prior to your weight training. Your weight training session should last no more than 1 hour. As soon as you're done, you should have a recovery drink that is high in simple carbs. This is necessary to replenish your muscle glycogen and prevent muscle breakdown. Within one hour of ending your workout, you should have a high protein meal.

Your before workout meal needs to contain a good amount of carbs aswell as a protein complement.

Well .. it depends on your goal. If your goal is to get into an exercise routine, then you should workout when you can.

I workout on an empty stomach because that is when I have time. =)

The time of day when you eat carbohydrate and protein is a factor to consider if you want to maximize muscle growth. The sugar that powers your training, in the form of muscle glycogen, must be "paid back," and protein must be available to supply your body with the building blocks it needs to repair muscle damage. A proper postworkout meal can replenish those energy stores and enhance amino-acid absorption.
As muscle-glycogen stores fall during exercise, the body calls upon protein, in the form of branched-chain amino acids (from dietary protein or muscle tissue), as a backup fuel source. The breakdown of protein to scavenge its amino acids is facilitated by a stress hormone called cortisol. High insulin levels resulting from a proper postworkout carb meal can suppress cortisol levels and may mitigate some of its effects.
Consume about 25% of your daily carbohydrate intake 1-2hrs after training. A person who eats 180 grams of protein a day should eat six nearly equal 30-gram servings per meal and throw in another 10 grams after training for good measure. Whey protein powders, which are higher in branched-chain amino acids, are an ideal postworkout protein source.

If your cardio goal is to burn fat, it's best to do cardio on an empty stomach so that energy is drawn from stored fat reserves rather than food. Then don't eat for the hour following your cardio session.

If you're workout is weight training, you should consume around 20 grams of protein and 20 grams of carbs about 30 minutes before your workout. Immediately after your weight workout, consume around 25 grams of protein and about 100 grams of simple carbs. About an hour after that, have a balanced protein and complex carb meal.