While much evidence exists that male yeast infections can occur even without sexual contact, it is likely going to raise the question. How have you broken "the news" about this (or other) issues to your significant other? Avoidance only works for so long