Hearing this might be enough for you to want to sign up for a workout class every day of your life — but there's a catch: "Over-exercising, calorie restriction, or anything that signals to your body that there's a stressful situation, can shut down your reproductive capacity," Dr. Hamilton explains. If your body is under too much stress from too much exercise, then that could reduce your desire and arousal, she says. Basically, it's important not to overdo your workouts , and stick to an activity that you enjoy and can sustain long-term.