"We could find a nice house on Pennsylvania Avenue, nothing ostentatious."