"But it's very difficult to be around him right now."