I would think that would add intreats more then make someone apprehensive. You always see those porno titles " Slutty House Wives " and " Bang my Wife"
But also mentally its risky, so more likely then not its a turn on. A trill of banging another mans wife. The thrill of possibly getting caught and getting away with it.