"And the sex with Barry already wasn't very good or frequent, was it? [laughs]"