"was enough to make him neglect his wife."