"Sterile" is stretching it. Professionals in reproductive medicine will generally use that particular term in the direst of cases only, especially since many forms of infertility and subfertility can be...
Great question -- and the answer would depend on who you ask. I'm going to play it safe and toss out there a broadly generic and gender-neutral "endocrine (hormonal) issues" for both men and women.